-- Logs begin at Tue 2022-09-06 20:30:12 UTC, end at Tue 2022-09-06 21:39:01 UTC. -- Sep 06 21:01:24.862482 dv-cinder-749155-11-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 06 21:01:24.871824 dv-cinder-749155-11-smb devstack@keystone.service[81766]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 06 21:01:24.873865 dv-cinder-749155-11-smb devstack@keystone.service[81766]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 6 21:01:24 2022] *** Sep 06 21:01:24.873865 dv-cinder-749155-11-smb devstack@keystone.service[81766]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 06 21:01:24.873865 dv-cinder-749155-11-smb devstack@keystone.service[81766]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 06 21:01:24.873865 dv-cinder-749155-11-smb devstack@keystone.service[81766]: nodename: dv-cinder-749155-11-smb Sep 06 21:01:24.873865 dv-cinder-749155-11-smb devstack@keystone.service[81766]: machine: x86_64 Sep 06 21:01:24.873865 dv-cinder-749155-11-smb devstack@keystone.service[81766]: clock source: unix Sep 06 21:01:24.873865 dv-cinder-749155-11-smb devstack@keystone.service[81766]: pcre jit disabled Sep 06 21:01:24.873865 dv-cinder-749155-11-smb devstack@keystone.service[81766]: detected number of CPU cores: 4 Sep 06 21:01:24.873865 dv-cinder-749155-11-smb devstack@keystone.service[81766]: current working directory: / Sep 06 21:01:24.873865 dv-cinder-749155-11-smb devstack@keystone.service[81766]: detected binary path: /usr/bin/uwsgi-core Sep 06 21:01:24.873865 dv-cinder-749155-11-smb devstack@keystone.service[81766]: your processes number limit is 47680 Sep 06 21:01:24.874468 dv-cinder-749155-11-smb devstack@keystone.service[81766]: your memory page size is 4096 bytes Sep 06 21:01:24.874468 dv-cinder-749155-11-smb devstack@keystone.service[81766]: detected max file descriptor number: 2048 Sep 06 21:01:24.874468 dv-cinder-749155-11-smb devstack@keystone.service[81766]: lock engine: pthread robust mutexes Sep 06 21:01:24.874468 dv-cinder-749155-11-smb devstack@keystone.service[81766]: thunder lock: enabled Sep 06 21:01:24.874468 dv-cinder-749155-11-smb devstack@keystone.service[81766]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 06 21:01:24.874468 dv-cinder-749155-11-smb devstack@keystone.service[81766]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 06 21:01:24.913723 dv-cinder-749155-11-smb devstack@keystone.service[81766]: Python main interpreter initialized at 0x5637fa43f9c0 Sep 06 21:01:24.913723 dv-cinder-749155-11-smb devstack@keystone.service[81766]: python threads support enabled Sep 06 21:01:24.913723 dv-cinder-749155-11-smb devstack@keystone.service[81766]: your server socket listen backlog is limited to 100 connections Sep 06 21:01:24.913723 dv-cinder-749155-11-smb devstack@keystone.service[81766]: your mercy for graceful operations on workers is 90 seconds Sep 06 21:01:24.914075 dv-cinder-749155-11-smb devstack@keystone.service[81766]: mapped 403077 bytes (393 KB) for 2 cores Sep 06 21:01:24.914182 dv-cinder-749155-11-smb devstack@keystone.service[81766]: *** Operational MODE: preforking *** Sep 06 21:01:24.914415 dv-cinder-749155-11-smb devstack@keystone.service[81766]: *** uWSGI is running in multiple interpreter mode *** Sep 06 21:01:24.914415 dv-cinder-749155-11-smb devstack@keystone.service[81766]: spawned uWSGI master process (pid: 81766) Sep 06 21:01:24.914615 dv-cinder-749155-11-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 06 21:01:24.915579 dv-cinder-749155-11-smb devstack@keystone.service[81766]: spawned uWSGI worker 1 (pid: 81777, cores: 1) Sep 06 21:01:24.915579 dv-cinder-749155-11-smb devstack@keystone.service[81766]: spawned uWSGI worker 2 (pid: 81778, cores: 1) Sep 06 21:01:24.917568 dv-cinder-749155-11-smb devstack@keystone.service[81766]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 06 21:01:29.248562 dv-cinder-749155-11-smb devstack@keystone.service[81777]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 21:01:29.248562 dv-cinder-749155-11-smb devstack@keystone.service[81777]: from cryptography.utils import int_from_bytes Sep 06 21:01:29.249455 dv-cinder-749155-11-smb devstack@keystone.service[81778]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 21:01:29.249455 dv-cinder-749155-11-smb devstack@keystone.service[81778]: from cryptography.utils import int_from_bytes Sep 06 21:01:29.249878 dv-cinder-749155-11-smb devstack@keystone.service[81777]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 21:01:29.249878 dv-cinder-749155-11-smb devstack@keystone.service[81777]: from cryptography.utils import int_from_bytes Sep 06 21:01:29.249988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 06 21:01:29.249988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: from cryptography.utils import int_from_bytes Sep 06 21:01:29.299966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 21:01:29.300158 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 06 21:01:29.300265 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 21:01:29.300340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 06 21:01:29.300405 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] command line args: [] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 21:01:29.300543 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] command line args: [] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 06 21:01:29.300655 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 21:01:29.300798 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 06 21:01:29.300890 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ================================================================================ {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 21:01:29.300970 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ================================================================================ {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 06 21:01:29.301053 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] admin_token = **** {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.301208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] admin_token = **** {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.301297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] config_dir = [] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.301458 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] config_dir = [] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.301549 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.301630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] config_source = [] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.301707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.301835 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] debug = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.301936 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] config_source = [] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.302017 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] debug = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.302094 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.302551 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.302647 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.302718 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.302784 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.302849 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.302849 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.302966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.303033 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.303099 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.303283 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] list_limit = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.303362 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] list_limit = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.303423 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] log_config_append = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.303488 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] log_config_append = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.303602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.303686 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.303755 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] log_dir = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.303814 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] log_dir = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.303932 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] log_file = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.304014 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] log_file = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.304191 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.304294 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.304432 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.304513 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.304678 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.304761 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.304925 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.305018 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.305082 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.305143 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.305270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.305358 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.305497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.305608 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.305796 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.305893 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.306017 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.306107 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.306249 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.306334 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.307078 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.307162 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.307326 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.307419 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.307577 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.307664 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.307826 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.307914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.308124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.308230 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.308612 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.81/identity {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.308691 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.81/identity {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.308775 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] publish_errors = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.308852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] publish_errors = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.309012 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.309094 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.309240 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.309376 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.309446 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.309560 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.309634 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.309770 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.309897 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.309979 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.310077 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] standard_threads = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.310157 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] standard_threads = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.310305 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.310390 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.310546 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.310623 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.310719 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.310795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.310894 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] use_journal = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.310971 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] use_journal = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.311049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] use_json = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.311125 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] use_json = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.311224 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] use_stderr = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.311302 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] use_stderr = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.311398 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] use_syslog = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.311476 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] use_syslog = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.311625 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.311703 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 06 21:01:29.312004 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.312182 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.312268 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.312340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.312487 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.312561 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.312686 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.312803 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.312909 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.313053 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.313144 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.313291 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.313376 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.313540 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.313624 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.313777 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.313856 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.314025 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.314103 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.314274 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.314352 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.314517 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.314595 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.314752 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.314835 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.314984 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.315067 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.315223 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.315301 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.315465 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.315542 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.315699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.315778 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.315933 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.316011 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.316218 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.316300 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.316465 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.316551 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.316699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.316784 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.316950 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.317029 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.317207 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.317292 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.317458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.317545 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.317703 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.317782 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.317932 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.318011 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.318157 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.318229 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.318385 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.318469 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.318619 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.318687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.318891 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.318977 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.319157 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.319249 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.319404 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.319483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.319635 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.319715 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.319868 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.319945 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.320118 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.322937 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.323078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.323155 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.323155 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.323281 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.323281 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.323424 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.323506 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.323583 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.323654 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.323728 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.323799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.323875 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.323946 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.324020 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.324090 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.324228 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.324362 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.324481 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.324580 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.324683 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.324780 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.324885 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.324983 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.325088 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.325187 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.325291 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.325376 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.325493 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.325608 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.325693 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.325820 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.325897 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.326023 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.326139 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.326221 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.326338 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.326413 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.326537 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.326613 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.326685 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.326799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.326874 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.327001 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.327117 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.327193 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.327314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.327390 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.327505 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.327587 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.327660 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.327732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.327803 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.327874 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.327939 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.328017 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.328084 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.328225 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.328294 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.328376 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.328449 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.328515 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.328592 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.328658 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.328723 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.328793 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.328867 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.328980 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.329108 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.329185 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.329302 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.329377 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.329444 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.329516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.329590 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.329663 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.329735 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.329799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.329868 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.329932 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.330078 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.330183 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.330257 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.330327 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.330397 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.330465 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.330538 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.330614 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.330691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.330766 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.330837 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.330906 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.330987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.331072 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.331145 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.331214 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.331280 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.331350 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.331419 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.331496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.331598 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.331678 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.331832 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.331911 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.332069 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.332190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.332352 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.332432 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.332595 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.332673 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.332830 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.332919 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.333072 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.333149 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.333305 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.333388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.333540 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.333627 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.333773 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.333851 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.334009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.334094 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.334246 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.334323 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.334557 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.334649 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.334795 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.334881 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.335025 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.335112 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.335262 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.335393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.335522 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.335647 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.335774 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.335907 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.336033 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.336187 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.336187 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.336441 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.336568 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.336701 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.336826 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.336952 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.336952 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] auth.external = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.337223 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.337357 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.337488 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.337488 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] auth.external = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.338221 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.338355 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.338495 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.338495 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] auth.password = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.338745 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.338873 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] auth.token = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.339008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.339134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.339266 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] auth.password = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.339393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.339520 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] auth.token = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.339645 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.339778 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.339906 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.340033 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.340187 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.340313 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.340448 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.340578 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.340643 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.340703 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.340823 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] credential.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.340964 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.341095 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.341224 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.341350 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.341477 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] credential.caching = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.341604 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.341732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.341880 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.342014 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.342142 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.342267 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.342393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.342520 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.342653 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.342781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.342909 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.343034 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.343158 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.343295 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.343432 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.343564 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.343564 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.343807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.343807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.344052 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.344318 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.344446 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.344573 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.344713 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.344843 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.344972 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.345109 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] federation.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.345236 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.345363 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.345501 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.345629 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.345754 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] federation.caching = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.345894 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.346021 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.346148 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.346274 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.346400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.346526 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.346661 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.346787 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.346915 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.347042 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.347184 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.347310 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.347445 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.347572 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.347705 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.347832 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.347933 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.348045 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.351656 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.351757 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.351839 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.351916 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.351991 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.352066 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity.caching = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.352185 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.352265 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.352339 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.352412 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.352484 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.352564 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.352647 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.352722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.352795 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.352868 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.352940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.353013 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.353094 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.353170 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.353254 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.353371 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.353982 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.354065 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.354150 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.354226 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.354304 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.354379 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.354379 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.354518 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.354592 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.354664 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.354736 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.354808 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.354881 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.354960 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.355035 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.355107 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.355180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.355252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.355323 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.355404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.355404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.355542 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.355615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.355687 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.355758 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.355839 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.355912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.355985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.356056 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.356146 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.356210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.356295 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.356370 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.356443 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.356557 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.356639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.356710 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.356781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.356843 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.356905 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.356975 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.357036 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.357096 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.357193 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.357278 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.357340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.357399 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.357459 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.357525 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.357601 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.357663 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.357723 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.357782 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.357842 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.357901 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.357968 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.358030 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.358097 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.358158 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.358218 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.358277 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.358345 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.358407 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.358467 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.358467 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.358572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.358632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.358700 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.358700 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.358862 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.358933 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.358993 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.359052 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.359125 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.359187 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.359247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.359247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.359353 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.359418 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.359487 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.359548 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.359607 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.359840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.359930 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.359994 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.360061 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.360244 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.360323 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.360568 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.360648 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.360711 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.360790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.360956 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.361037 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.361285 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.361364 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.361426 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.361495 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.361640 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.361719 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.361879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.361958 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.362099 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.362189 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.362322 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.362406 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.362559 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.362648 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.362791 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.362882 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.363038 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.363121 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.363304 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.363385 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.363548 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.363631 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.363777 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.363859 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.364023 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.364126 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.364283 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.364368 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.364517 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.364603 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.364749 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.364831 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.364982 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.365065 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.365223 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.365306 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.365469 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.365552 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.365706 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.365796 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.365955 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.366035 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.366181 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.366308 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.366464 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.366549 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.366645 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.366728 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.366883 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.367005 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.367118 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.367201 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.367359 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.367439 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.367595 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.367674 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.367825 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.367905 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.368060 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.368183 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.368319 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.368399 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] resource.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.368558 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.368639 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.368801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] resource.caching = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.368881 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.369176 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.369278 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.369468 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.369598 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.369730 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.369959 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.370089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.370221 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.370361 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.370494 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.370623 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.370751 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.370881 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.371012 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.371149 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] role.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.371289 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.371420 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] role.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.371548 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.371677 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.371805 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] role.caching = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.371942 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.372072 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] role.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.372221 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.372323 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.372418 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.372494 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.372581 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.372657 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.372731 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.372804 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.372876 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.372956 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.373084 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.373169 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.373244 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.373360 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.373442 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.373608 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.373698 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.373853 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.373935 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.374088 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.374169 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.374327 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.374409 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.374574 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.374728 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.374810 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.374965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.375056 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.375212 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.375446 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.375527 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.375685 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.375766 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.375928 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.376009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.376193 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.376282 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.376443 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.376525 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.376691 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.376774 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.376924 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.377180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.377260 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.377429 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.377518 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.377664 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.377747 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.377893 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.377974 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.378128 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.378218 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.378400 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.378640 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.378745 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.378828 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.378904 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.378986 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.379095 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.379178 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.379324 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.379407 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.379558 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] token.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.379650 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.379789 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.379870 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.380027 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] token.caching = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.380154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.380284 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.380416 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.380531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.380611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.380768 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.380857 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.381025 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.381108 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.381273 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.381354 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.381510 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.381591 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.381754 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.381837 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.381996 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.382084 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.382230 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.382310 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.382466 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.382587 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.382705 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.382787 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.382938 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.383021 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.383183 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.383265 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.383456 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.383547 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.383687 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.383777 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.383929 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.384012 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.connection = **** {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.384216 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.385938 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.386063 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.386149 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.connection = **** {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.386224 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.386298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.386298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.386438 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.386514 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.386588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.386666 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.386741 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.386814 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.386977 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.387055 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.387128 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.387201 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.387273 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.387345 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.387425 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.387500 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.387572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.387644 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.387716 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.387788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.387869 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.387943 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.388016 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.388088 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.388188 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.388262 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.388347 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.388347 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.388481 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.388554 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.388627 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.388699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81778) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 21:01:29.388781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.388781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 06 21:01:29.388912 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81777) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 06 21:01:29.419060 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.419290 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.419510 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.419810 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.420048 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.420298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.427895 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.428741 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.455753 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.455973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.457151 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.457387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.517545 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.517723 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.568822 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.568986 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.569070 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.569137 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.741336 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.741527 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.741612 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.741699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.741766 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.741894 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.742024 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.742111 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.742189 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.742328 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.742425 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.742547 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.771442 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.771560 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.771641 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.771706 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.771992 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.772140 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.772232 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.772313 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.772390 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.772486 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.772566 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.772642 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.772717 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.772792 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.784508 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.785007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.797493 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.797684 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.797776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.797916 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.798021 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.798141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.798232 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.798361 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.798445 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.798579 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.798665 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.798791 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.798874 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81777) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.799003 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81778) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 06 21:01:29.815752 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.815895 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.815976 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 06 21:01:29.816050 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 06 21:01:29.816317 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.816403 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.816518 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 06 21:01:29.816632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 06 21:01:29.816874 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.817287 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.817551 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.817814 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.818343 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.818674 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.818884 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.819144 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.829488 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.829605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.829766 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.829852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.830038 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.830123 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.830321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.830415 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.837365 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:29.837486 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:29.840813 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:29.840915 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:29.841099 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.841195 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.841376 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.841463 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.841654 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.841750 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.841935 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.842021 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.842195 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.842281 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.842463 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.842549 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.842732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.842815 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.843001 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.843084 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.843270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.843355 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.843650 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.843893 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.866126 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.866249 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.867559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:29.867650 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:29.867844 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.867930 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.872593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:29.872696 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:29.872874 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.872960 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.873153 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.873237 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.879404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:29.879492 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:29.879690 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.879811 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.885999 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:29.886251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:29.886338 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.886550 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.886636 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.886840 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.886930 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.887118 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.887204 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.887391 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.887475 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.887659 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.887752 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.887924 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.888009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.888213 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.903911 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.904029 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.904215 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.904303 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.908134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:29.908227 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:29.913256 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.913411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.913497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.913615 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.916256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:29.918003 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:29.919777 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:29.921786 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:29.923363 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.923463 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.923719 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.924007 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.924318 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.924614 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.925021 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.925321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.925606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.925888 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.926161 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.926476 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.940437 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:29.940754 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.941021 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.941283 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.942133 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:29.942426 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.942693 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.942957 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.949007 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.950414 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.950533 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.951938 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.952024 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.952329 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.953531 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.953803 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.954948 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:29.955236 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.955520 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.955801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.956224 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.956476 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:29.956760 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.957048 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.957331 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.957726 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.967841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:29.970441 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.970441 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.970441 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.970441 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.970441 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.970740 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:29.970817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.970890 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.970890 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.970890 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.970890 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.971141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.971254 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.985174 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:29.986883 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:29.988202 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:29.989837 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:29.991048 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.992585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.992728 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.994174 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:29.994319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.994593 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.994990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.995819 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:29.996121 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:29.996515 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.001336 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.002780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:30.002871 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.004297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:30.005688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.006134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.006541 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.006648 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.007257 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.007593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.007819 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.008118 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.015258 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:30.015573 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.017694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.017827 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:30.017827 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.017827 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.022835 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81777) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:30.023074 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.023356 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.023636 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.023914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.024047 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81778) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 06 21:01:30.024213 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.024356 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.024541 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.024709 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.024824 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.025053 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.025148 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.025877 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.026038 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.026153 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.026325 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.026428 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.026603 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.026731 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.026925 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.027007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.027196 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81777) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.027286 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.027527 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.027794 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.028058 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.028339 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81778) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 06 21:01:30.061594 dv-cinder-749155-11-smb devstack@keystone.service[81777]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5637fa43f9c0 pid: 81777 (default app) Sep 06 21:01:30.062420 dv-cinder-749155-11-smb devstack@keystone.service[81778]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5637fa43f9c0 pid: 81778 (default app) Sep 06 21:01:30.064993 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c1031-59bf-400d-aa90-e0cd9c8018cf None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:30.065287 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c1031-59bf-400d-aa90-e0cd9c8018cf None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:30.065568 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c1031-59bf-400d-aa90-e0cd9c8018cf None None] PATH_INFO: `/v3` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:30.069973 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1/1] 10.222.0.81 () {50 vars in 791 bytes} [Tue Sep 6 21:01:30 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:01:37.840642 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0add259-4950-4f60-9c94-3b8c77deacd2 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:37.841176 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0add259-4950-4f60-9c94-3b8c77deacd2 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:37.841176 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0add259-4950-4f60-9c94-3b8c77deacd2 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:37.845444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1/2] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:01:37 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:01:37.850789 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cda03-8fd3-47ab-a007-014d0b168bf7 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:37.851257 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cda03-8fd3-47ab-a007-014d0b168bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:37.851353 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95cda03-8fd3-47ab-a007-014d0b168bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:37.921404 dv-cinder-749155-11-smb devstack@keystone.service[81777]: INFO dbcounter [None req-f95cda03-8fd3-47ab-a007-014d0b168bf7 None None] Registered counter for database keystone Sep 06 21:01:37.940039 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG oslo_db.sqlalchemy.engines [None req-f95cda03-8fd3-47ab-a007-014d0b168bf7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81777) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 21:01:37.946231 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writer thread running {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 21:01:38.138934 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG passlib.handlers.bcrypt [None req-f95cda03-8fd3-47ab-a007-014d0b168bf7 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81777) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 06 21:01:38.139239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG passlib.handlers.bcrypt [None req-f95cda03-8fd3-47ab-a007-014d0b168bf7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81777) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 06 21:01:38.196641 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f95cda03-8fd3-47ab-a007-014d0b168bf7 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:01:38.198742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f95cda03-8fd3-47ab-a007-014d0b168bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:01:38.326780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 2/3] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:01:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 06 21:01:38.800444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0add259-4950-4f60-9c94-3b8c77deacd2 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:38.870547 dv-cinder-749155-11-smb devstack@keystone.service[81778]: INFO dbcounter [None req-f0add259-4950-4f60-9c94-3b8c77deacd2 None None] Registered counter for database keystone Sep 06 21:01:38.891968 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG oslo_db.sqlalchemy.engines [None req-f0add259-4950-4f60-9c94-3b8c77deacd2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81778) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 06 21:01:38.898395 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writer thread running {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 06 21:01:39.014672 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0add259-4950-4f60-9c94-3b8c77deacd2 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:39.018912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc86aa-d1eb-46b4-b07e-c37696f43fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:39.019532 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc86aa-d1eb-46b4-b07e-c37696f43fcf admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:39.019809 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc86aa-d1eb-46b4-b07e-c37696f43fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:39.020080 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc86aa-d1eb-46b4-b07e-c37696f43fcf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:39.028194 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc86aa-d1eb-46b4-b07e-c37696f43fcf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:01:39.079940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: WARNING keystone.common.rbac_enforcer.enforcer [None req-52cc86aa-d1eb-46b4-b07e-c37696f43fcf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 06 21:01:39.080263 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc86aa-d1eb-46b4-b07e-c37696f43fcf admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:01:39.091236 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 2/4] 10.222.0.81 () {58 vars in 1324 bytes} [Tue Sep 6 21:01:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 21:01:39.097138 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95cda03-8fd3-47ab-a007-014d0b168bf7 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:39.111860 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95cda03-8fd3-47ab-a007-014d0b168bf7 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:39.116242 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552b57b-c763-4abb-b3aa-6d4096ece3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:39.117353 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552b57b-c763-4abb-b3aa-6d4096ece3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:39.117636 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552b57b-c763-4abb-b3aa-6d4096ece3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:39.117911 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552b57b-c763-4abb-b3aa-6d4096ece3f6 admin admin] PATH_INFO: `/v3/projects/1e0790087f9147d99a7f175c2c23386d` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:39.119459 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3552b57b-c763-4abb-b3aa-6d4096ece3f6 admin admin] RBAC: Authorizing `identity:get_project(project_id=1e0790087f9147d99a7f175c2c23386d)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:01:39.172515 dv-cinder-749155-11-smb devstack@keystone.service[81777]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3552b57b-c763-4abb-b3aa-6d4096ece3f6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 06 21:01:39.172854 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3552b57b-c763-4abb-b3aa-6d4096ece3f6 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:01:39.177398 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 3/5] 10.222.0.81 () {56 vars in 1207 bytes} [Tue Sep 6 21:01:39 2022] GET /identity/v3/projects/1e0790087f9147d99a7f175c2c23386d => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:01:41.309294 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec13fd3-afcd-47e2-8e84-173844d9e318 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:41.309768 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec13fd3-afcd-47e2-8e84-173844d9e318 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:41.309857 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec13fd3-afcd-47e2-8e84-173844d9e318 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:41.313887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 3/6] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:01:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:01:41.319345 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09770395-e554-4488-a03e-274638168f5e None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:41.319761 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09770395-e554-4488-a03e-274638168f5e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:41.319907 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09770395-e554-4488-a03e-274638168f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:41.340262 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-09770395-e554-4488-a03e-274638168f5e None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:01:41.341772 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-09770395-e554-4488-a03e-274638168f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:01:41.349546 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 4/7] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:01:41 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 06 21:01:41.615683 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec13fd3-afcd-47e2-8e84-173844d9e318 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:41.628285 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec13fd3-afcd-47e2-8e84-173844d9e318 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:41.632715 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4984905-bd29-4af6-835a-f7eed6ea81cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:41.633319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4984905-bd29-4af6-835a-f7eed6ea81cc admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:41.633603 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4984905-bd29-4af6-835a-f7eed6ea81cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:41.633879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4984905-bd29-4af6-835a-f7eed6ea81cc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:41.642213 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4984905-bd29-4af6-835a-f7eed6ea81cc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:01:41.643985 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4984905-bd29-4af6-835a-f7eed6ea81cc admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:01:41.652745 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 4/8] 10.222.0.81 () {58 vars in 1324 bytes} [Tue Sep 6 21:01:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 21:01:41.658185 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09770395-e554-4488-a03e-274638168f5e None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:41.667860 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09770395-e554-4488-a03e-274638168f5e None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:41.672188 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f782ba-46d6-460b-8c73-9c5d2475d417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:41.672835 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f782ba-46d6-460b-8c73-9c5d2475d417 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:41.673113 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f782ba-46d6-460b-8c73-9c5d2475d417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:41.673385 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f782ba-46d6-460b-8c73-9c5d2475d417 admin admin] PATH_INFO: `/v3/users/9b67efb35ae049b5aa789d6ba0205b2e` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:41.674683 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f782ba-46d6-460b-8c73-9c5d2475d417 admin admin] RBAC: Authorizing `identity:get_user(user_id=9b67efb35ae049b5aa789d6ba0205b2e)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:01:41.676529 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f782ba-46d6-460b-8c73-9c5d2475d417 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:01:41.678035 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 5/9] 10.222.0.81 () {56 vars in 1198 bytes} [Tue Sep 6 21:01:41 2022] GET /identity/v3/users/9b67efb35ae049b5aa789d6ba0205b2e => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:01:43.901879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a4022-5bd6-407e-b60d-43f2b450612b None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:43.902453 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a4022-5bd6-407e-b60d-43f2b450612b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:43.902453 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a4022-5bd6-407e-b60d-43f2b450612b None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:43.903768 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 5/10] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:01:43.909470 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa929581-7b10-4b3b-8d7b-23809ab79c37 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:43.909903 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa929581-7b10-4b3b-8d7b-23809ab79c37 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:43.910085 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa929581-7b10-4b3b-8d7b-23809ab79c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:43.926770 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71df389-84ba-4ffa-ab49-c418a5d368b7 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:43.927037 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71df389-84ba-4ffa-ab49-c418a5d368b7 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:43.927359 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71df389-84ba-4ffa-ab49-c418a5d368b7 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:43.928779 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 6/11] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:01:43.934252 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-aa929581-7b10-4b3b-8d7b-23809ab79c37 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:01:43.934252 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-aa929581-7b10-4b3b-8d7b-23809ab79c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:01:43.934785 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58e929-2eec-40b5-8376-78a55342d5d3 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:43.935080 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58e929-2eec-40b5-8376-78a55342d5d3 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:43.935361 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58e929-2eec-40b5-8376-78a55342d5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:43.978613 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG passlib.handlers.bcrypt [None req-ab58e929-2eec-40b5-8376-78a55342d5d3 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81778) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 06 21:01:43.979510 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG passlib.handlers.bcrypt [None req-ab58e929-2eec-40b5-8376-78a55342d5d3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81778) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 06 21:01:44.011816 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 6/12] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:01:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:01:44.029140 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ab58e929-2eec-40b5-8376-78a55342d5d3 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:01:44.030864 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ab58e929-2eec-40b5-8376-78a55342d5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:01:44.133561 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 7/13] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:01:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 21:01:44.277723 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa929581-7b10-4b3b-8d7b-23809ab79c37 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:44.304072 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:01:44.386822 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa929581-7b10-4b3b-8d7b-23809ab79c37 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:44.402886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58e929-2eec-40b5-8376-78a55342d5d3 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:44.424736 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda52d3d-60ef-4ae9-9fa1-e65635be6564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:44.425428 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda52d3d-60ef-4ae9-9fa1-e65635be6564 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:44.425714 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda52d3d-60ef-4ae9-9fa1-e65635be6564 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:44.425994 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda52d3d-60ef-4ae9-9fa1-e65635be6564 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:44.437716 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda52d3d-60ef-4ae9-9fa1-e65635be6564 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:01:44.446728 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-dda52d3d-60ef-4ae9-9fa1-e65635be6564 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:01:44.446728 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:01:44.446728 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:01:44.446728 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:01:44.446728 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:01:44.446728 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:01:44.446728 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:01:44.446728 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:01:44.446728 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:01:44.446728 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:01:44.446728 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:01:44.446728 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:01:44.446728 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:01:44.446728 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:01:44.446728 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:01:44.446728 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:01:44.447813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:01:44.447813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:01:44.447813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:01:44.447813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:01:44.447813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:01:44.447813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:01:44.447813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:01:44.447813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:01:44.447813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:01:44.447813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:01:44.447813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:01:44.447813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:01:44.447813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:01:44.447813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:01:44.447813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:01:44.447813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:01:44.449123 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:01:44.449123 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:01:44.449123 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:01:44.449123 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:01:44.449123 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:01:44.449123 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:01:44.449123 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:01:44.449123 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:01:44.449123 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:01:44.449123 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:01:44.449123 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:01:44.449123 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:01:44.449123 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 7/14] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:01:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:01:44.453716 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda52d3d-60ef-4ae9-9fa1-e65635be6564 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:44.509026 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58e929-2eec-40b5-8376-78a55342d5d3 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:44.512737 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:01:44.538339 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:01:44.550926 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7510c12-5e70-48a7-a0ca-8c2112fb29c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:44.551792 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7510c12-5e70-48a7-a0ca-8c2112fb29c7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:44.552073 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7510c12-5e70-48a7-a0ca-8c2112fb29c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:44.552516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7510c12-5e70-48a7-a0ca-8c2112fb29c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:44.556889 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda52d3d-60ef-4ae9-9fa1-e65635be6564 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:44.593211 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da7c05-7332-4d37-9931-1936ff247df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:44.593837 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da7c05-7332-4d37-9931-1936ff247df1 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:44.594195 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da7c05-7332-4d37-9931-1936ff247df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:44.594403 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da7c05-7332-4d37-9931-1936ff247df1 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:44.595087 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da7c05-7332-4d37-9931-1936ff247df1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:01:44.595396 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da7c05-7332-4d37-9931-1936ff247df1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:01:44.596843 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da7c05-7332-4d37-9931-1936ff247df1 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:01:44.611114 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 8/15] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:01:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:01:44.616912 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da7c05-7332-4d37-9931-1936ff247df1 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:44.626259 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7510c12-5e70-48a7-a0ca-8c2112fb29c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:01:44.627764 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7510c12-5e70-48a7-a0ca-8c2112fb29c7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:01:44.721426 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da7c05-7332-4d37-9931-1936ff247df1 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:44.733776 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 8/16] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:01:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 21:01:44.739391 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7510c12-5e70-48a7-a0ca-8c2112fb29c7 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:44.742107 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:01:44.755868 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35347c59-ec8c-44fc-bf33-c4e53cce4bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:44.756537 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35347c59-ec8c-44fc-bf33-c4e53cce4bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:44.765559 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35347c59-ec8c-44fc-bf33-c4e53cce4bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:44.765559 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35347c59-ec8c-44fc-bf33-c4e53cce4bd6 None admin] PATH_INFO: `/v3/users/9b67efb35ae049b5aa789d6ba0205b2e` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:44.765559 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35347c59-ec8c-44fc-bf33-c4e53cce4bd6 None admin] RBAC: Authorizing `identity:get_user(user_id=9b67efb35ae049b5aa789d6ba0205b2e)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:01:44.765559 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35347c59-ec8c-44fc-bf33-c4e53cce4bd6 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:01:44.765559 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 9/17] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:01:44 2022] GET /identity/v3/users/9b67efb35ae049b5aa789d6ba0205b2e => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:01:44.767380 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35347c59-ec8c-44fc-bf33-c4e53cce4bd6 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:44.783918 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:01:44.836450 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7510c12-5e70-48a7-a0ca-8c2112fb29c7 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:44.867880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35347c59-ec8c-44fc-bf33-c4e53cce4bd6 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:44.873835 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5189445-2a7d-42df-a798-7aabd0338645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:44.874721 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5189445-2a7d-42df-a798-7aabd0338645 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:44.875004 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5189445-2a7d-42df-a798-7aabd0338645 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:44.875285 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5189445-2a7d-42df-a798-7aabd0338645 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:44.894297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5189445-2a7d-42df-a798-7aabd0338645 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:01:44.895772 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5189445-2a7d-42df-a798-7aabd0338645 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:01:44.906543 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e6735-f7ca-4a62-bee5-3ecf003b9552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:44.907183 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e6735-f7ca-4a62-bee5-3ecf003b9552 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:44.907465 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e6735-f7ca-4a62-bee5-3ecf003b9552 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:44.907744 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e6735-f7ca-4a62-bee5-3ecf003b9552 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:44.908886 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e6735-f7ca-4a62-bee5-3ecf003b9552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:01:44.912199 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e6735-f7ca-4a62-bee5-3ecf003b9552 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:01:44.912199 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 10/18] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:01:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:01:44.914717 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-d5189445-2a7d-42df-a798-7aabd0338645 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:01:44.914717 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:01:44.914717 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:01:44.914717 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:01:44.914717 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:01:44.914717 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:01:44.914717 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:01:44.914717 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:01:44.914717 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:01:44.914717 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:01:44.914717 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:01:44.914717 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:01:44.914717 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:01:44.914717 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:01:44.914717 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:01:44.914717 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:01:44.915978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:01:44.915978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:01:44.915978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:01:44.915978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:01:44.915978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:01:44.915978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:01:44.915978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:01:44.915978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:01:44.915978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:01:44.915978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:01:44.915978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:01:44.915978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:01:44.915978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:01:44.915978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:01:44.915978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:01:44.915978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:01:44.915978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:01:44.917541 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:01:44.917541 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:01:44.917541 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:01:44.917541 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 9/19] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:01:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:01:44.918001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e6735-f7ca-4a62-bee5-3ecf003b9552 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:44.922392 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5189445-2a7d-42df-a798-7aabd0338645 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:44.980575 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:01:44.999205 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:01:45.017524 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e6735-f7ca-4a62-bee5-3ecf003b9552 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:45.026768 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5189445-2a7d-42df-a798-7aabd0338645 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:45.051577 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02af368-1b0c-42aa-829a-1181f2096206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:45.052221 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02af368-1b0c-42aa-829a-1181f2096206 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:45.052507 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02af368-1b0c-42aa-829a-1181f2096206 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:45.052781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02af368-1b0c-42aa-829a-1181f2096206 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:45.053501 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02af368-1b0c-42aa-829a-1181f2096206 None admin] RBAC: Adding query filter params (role.id=fe9661f095094dd0931e0b96a1d6ef74, scope.domain.id=default, user.id=9b67efb35ae049b5aa789d6ba0205b2e) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:01:45.053810 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02af368-1b0c-42aa-829a-1181f2096206 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:01:45.055252 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02af368-1b0c-42aa-829a-1181f2096206 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:01:45.062261 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 11/20] 10.222.0.81 () {56 vars in 1322 bytes} [Tue Sep 6 21:01:44 2022] GET /identity/v3/role_assignments?user.id=9b67efb35ae049b5aa789d6ba0205b2e&scope.domain.id=default&role.id=fe9661f095094dd0931e0b96a1d6ef74 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:01:45.062365 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe864f7a-3494-4d4c-bc38-c02f90e08672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:45.062924 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe864f7a-3494-4d4c-bc38-c02f90e08672 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:45.063211 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe864f7a-3494-4d4c-bc38-c02f90e08672 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:45.063492 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe864f7a-3494-4d4c-bc38-c02f90e08672 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:45.064202 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe864f7a-3494-4d4c-bc38-c02f90e08672 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:01:45.064477 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe864f7a-3494-4d4c-bc38-c02f90e08672 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:01:45.065910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe864f7a-3494-4d4c-bc38-c02f90e08672 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:01:45.085539 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 10/21] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:01:47.386981 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60918373-f98e-44ef-8ac7-f9bc7fc3fec7 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:47.387514 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60918373-f98e-44ef-8ac7-f9bc7fc3fec7 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:47.387514 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60918373-f98e-44ef-8ac7-f9bc7fc3fec7 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:47.389177 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 12/22] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:01:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:01:47.394392 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c0ac5-0a8e-4005-853d-db8d3d462a14 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:47.394827 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c0ac5-0a8e-4005-853d-db8d3d462a14 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:47.394949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c0ac5-0a8e-4005-853d-db8d3d462a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:47.425304 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-7a8c0ac5-0a8e-4005-853d-db8d3d462a14 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:01:47.426841 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7a8c0ac5-0a8e-4005-853d-db8d3d462a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:01:47.514344 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 11/23] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:01:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:01:47.622160 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e1452-5f05-4c7e-b96c-56098d214ad3 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:47.622821 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e1452-5f05-4c7e-b96c-56098d214ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:47.623329 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e1452-5f05-4c7e-b96c-56098d214ad3 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:47.625194 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 13/24] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:01:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:01:47.630457 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdaf1e7-ad5d-4e02-9f1c-393c913b491c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:47.631021 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdaf1e7-ad5d-4e02-9f1c-393c913b491c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:47.631510 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdaf1e7-ad5d-4e02-9f1c-393c913b491c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:47.656199 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-4bdaf1e7-ad5d-4e02-9f1c-393c913b491c None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:01:47.657757 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4bdaf1e7-ad5d-4e02-9f1c-393c913b491c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:01:47.725606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:01:47.759426 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 12/25] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:01:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:01:47.928418 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920984d-0cfb-4a36-87d6-c42e8b9fa7bd None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:47.929087 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920984d-0cfb-4a36-87d6-c42e8b9fa7bd None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:47.929594 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d920984d-0cfb-4a36-87d6-c42e8b9fa7bd None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:47.931470 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 14/26] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:01:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:01:47.938645 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920984d-0cfb-4a36-87d6-c42e8b9fa7bd None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:47.946537 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b2347-fb23-41d0-9c61-c7cb61ff988a None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:47.950457 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b2347-fb23-41d0-9c61-c7cb61ff988a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:47.950996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b2347-fb23-41d0-9c61-c7cb61ff988a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:47.986714 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-882b2347-fb23-41d0-9c61-c7cb61ff988a None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:01:47.989354 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-882b2347-fb23-41d0-9c61-c7cb61ff988a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:01:48.129782 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d920984d-0cfb-4a36-87d6-c42e8b9fa7bd None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:48.138231 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 13/27] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:01:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:01:48.139411 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b2347-fb23-41d0-9c61-c7cb61ff988a None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:48.210154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe80c2-8940-4afd-b4be-d44b567a64b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:48.211151 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe80c2-8940-4afd-b4be-d44b567a64b1 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:48.211616 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe80c2-8940-4afd-b4be-d44b567a64b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:48.212078 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe80c2-8940-4afd-b4be-d44b567a64b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:48.253860 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe80c2-8940-4afd-b4be-d44b567a64b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:01:48.271382 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-cbbe80c2-8940-4afd-b4be-d44b567a64b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:01:48.271382 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:01:48.271382 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:01:48.271382 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:01:48.271382 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:01:48.271382 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:01:48.271382 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:01:48.271382 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:01:48.271382 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:01:48.271382 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:01:48.271382 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:01:48.271382 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:01:48.271382 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:01:48.271382 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:01:48.271382 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:01:48.271382 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:01:48.272276 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:01:48.272276 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:01:48.272276 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:01:48.272276 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:01:48.272276 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:01:48.272276 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:01:48.272276 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:01:48.272276 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:01:48.272276 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:01:48.272276 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:01:48.272276 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:01:48.272276 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:01:48.272276 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:01:48.272276 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:01:48.272276 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:01:48.272276 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:01:48.273040 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:01:48.273040 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:01:48.273040 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:01:48.273040 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:01:48.273040 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:01:48.273040 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:01:48.273040 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:01:48.273040 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:01:48.273040 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:01:48.273040 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:01:48.273040 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:01:48.273040 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:01:48.275411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 15/28] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:01:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:01:48.281600 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe80c2-8940-4afd-b4be-d44b567a64b1 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:48.328473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:01:48.378164 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b2347-fb23-41d0-9c61-c7cb61ff988a None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:48.396240 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:01:48.442970 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99fc849-331b-4703-aaaf-651831f330d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:48.443607 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fc849-331b-4703-aaaf-651831f330d3 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:48.443887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fc849-331b-4703-aaaf-651831f330d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:48.444180 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99fc849-331b-4703-aaaf-651831f330d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:48.458786 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe80c2-8940-4afd-b4be-d44b567a64b1 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:48.464299 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fc849-331b-4703-aaaf-651831f330d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:01:48.465722 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99fc849-331b-4703-aaaf-651831f330d3 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:01:48.492886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-c99fc849-331b-4703-aaaf-651831f330d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:01:48.492886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:01:48.492886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:01:48.492886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:01:48.492886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:01:48.492886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:01:48.492886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:01:48.492886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:01:48.492886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:01:48.492886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:01:48.492886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:01:48.492886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:01:48.492886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:01:48.492886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:01:48.492886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:01:48.492886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:01:48.493766 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:01:48.493766 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:01:48.493766 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:01:48.493766 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:01:48.493766 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:01:48.493766 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:01:48.493766 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:01:48.493766 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:01:48.493766 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:01:48.493766 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:01:48.493766 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:01:48.493766 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:01:48.493766 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:01:48.493766 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:01:48.493766 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:01:48.493766 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:01:48.493766 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:01:48.494621 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:01:48.494621 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:01:48.494621 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:01:48.495640 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 14/29] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:01:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:01:48.500731 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027d6ab-903f-4752-a6d3-5f8817b008a7 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:48.504425 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027d6ab-903f-4752-a6d3-5f8817b008a7 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:48.505588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027d6ab-903f-4752-a6d3-5f8817b008a7 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:48.511239 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 15/30] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:01:48 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:01:48.516007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027d6ab-903f-4752-a6d3-5f8817b008a7 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:48.537326 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39710bd-e8a9-40bd-b496-7c8248358d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:48.538517 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39710bd-e8a9-40bd-b496-7c8248358d91 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:48.539076 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39710bd-e8a9-40bd-b496-7c8248358d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:48.539527 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39710bd-e8a9-40bd-b496-7c8248358d91 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:48.540386 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39710bd-e8a9-40bd-b496-7c8248358d91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:01:48.540848 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39710bd-e8a9-40bd-b496-7c8248358d91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:01:48.543001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39710bd-e8a9-40bd-b496-7c8248358d91 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:01:48.559534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 16/31] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:01:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:01:48.564459 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b38bf1-aebe-499a-be33-39f4e6f900f5 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:48.564936 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b38bf1-aebe-499a-be33-39f4e6f900f5 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:48.565524 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b38bf1-aebe-499a-be33-39f4e6f900f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:48.597570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-75b38bf1-aebe-499a-be33-39f4e6f900f5 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:01:48.599588 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-75b38bf1-aebe-499a-be33-39f4e6f900f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:01:48.673093 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027d6ab-903f-4752-a6d3-5f8817b008a7 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:48.685543 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:01:48.700348 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 17/32] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:01:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:01:48.701630 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b38bf1-aebe-499a-be33-39f4e6f900f5 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:48.740017 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b806e56-16af-4783-888c-02f0584768ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:48.741027 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b806e56-16af-4783-888c-02f0584768ff None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:48.741592 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b806e56-16af-4783-888c-02f0584768ff None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:48.742066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b806e56-16af-4783-888c-02f0584768ff None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:48.742964 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b806e56-16af-4783-888c-02f0584768ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:01:48.743471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b806e56-16af-4783-888c-02f0584768ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:01:48.745147 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b806e56-16af-4783-888c-02f0584768ff None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:01:48.765026 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 16/33] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:01:48.766243 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b806e56-16af-4783-888c-02f0584768ff None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:48.802335 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:01:48.916698 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b38bf1-aebe-499a-be33-39f4e6f900f5 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:48.969098 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b806e56-16af-4783-888c-02f0584768ff None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:48.988369 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192996a8-fcbb-477f-a5c5-07f56d06609c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:48.989014 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192996a8-fcbb-477f-a5c5-07f56d06609c None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:48.989296 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192996a8-fcbb-477f-a5c5-07f56d06609c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:48.989566 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192996a8-fcbb-477f-a5c5-07f56d06609c None admin] PATH_INFO: `/v3/users/9b67efb35ae049b5aa789d6ba0205b2e` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:48.991487 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192996a8-fcbb-477f-a5c5-07f56d06609c None admin] RBAC: Authorizing `identity:get_user(user_id=9b67efb35ae049b5aa789d6ba0205b2e)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:01:48.992931 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192996a8-fcbb-477f-a5c5-07f56d06609c None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:01:48.998116 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 18/34] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:01:48 2022] GET /identity/v3/users/9b67efb35ae049b5aa789d6ba0205b2e => generated 247 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:01:48.998917 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192996a8-fcbb-477f-a5c5-07f56d06609c None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:49.036300 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4babe7c1-5808-4c4d-ab98-1259fee5f8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:49.036919 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babe7c1-5808-4c4d-ab98-1259fee5f8a1 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:49.037199 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babe7c1-5808-4c4d-ab98-1259fee5f8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:49.037469 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babe7c1-5808-4c4d-ab98-1259fee5f8a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:49.038393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4babe7c1-5808-4c4d-ab98-1259fee5f8a1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:01:49.040004 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4babe7c1-5808-4c4d-ab98-1259fee5f8a1 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:01:49.081796 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:01:49.122141 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192996a8-fcbb-477f-a5c5-07f56d06609c None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:49.159862 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4c7a0-68e9-4e72-973b-be95f5fe5390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:49.160525 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4c7a0-68e9-4e72-973b-be95f5fe5390 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:49.160802 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4c7a0-68e9-4e72-973b-be95f5fe5390 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:49.161072 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f4c7a0-68e9-4e72-973b-be95f5fe5390 None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:49.161861 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4c7a0-68e9-4e72-973b-be95f5fe5390 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:01:49.163693 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f4c7a0-68e9-4e72-973b-be95f5fe5390 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:01:49.283863 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 17/35] 10.222.0.81 () {60 vars in 1131 bytes} [Tue Sep 6 21:01:48 2022] POST /identity/v3/roles => generated 219 bytes in 518 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:01:49.284881 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4babe7c1-5808-4c4d-ab98-1259fee5f8a1 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:49.385557 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:01:49.391335 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 19/36] 10.222.0.81 () {60 vars in 1141 bytes} [Tue Sep 6 21:01:48 2022] POST /identity/v3/projects => generated 301 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:01:49.392723 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4c7a0-68e9-4e72-973b-be95f5fe5390 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:49.411850 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4babe7c1-5808-4c4d-ab98-1259fee5f8a1 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:49.472852 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118fad36-31f1-431a-a8b7-1cdf7ca1a6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:49.473536 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fad36-31f1-431a-a8b7-1cdf7ca1a6c6 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:49.473826 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fad36-31f1-431a-a8b7-1cdf7ca1a6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:49.474110 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118fad36-31f1-431a-a8b7-1cdf7ca1a6c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:49.480763 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118fad36-31f1-431a-a8b7-1cdf7ca1a6c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:01:49.482541 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118fad36-31f1-431a-a8b7-1cdf7ca1a6c6 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:01:49.486258 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 18/37] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:01:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:01:49.487719 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae63ec-ef02-4293-a581-46b2a49840e6 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:49.488015 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae63ec-ef02-4293-a581-46b2a49840e6 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:49.489874 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae63ec-ef02-4293-a581-46b2a49840e6 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:49.493035 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 19/38] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:01:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:01:49.493943 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae63ec-ef02-4293-a581-46b2a49840e6 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:49.550553 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f4c7a0-68e9-4e72-973b-be95f5fe5390 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:49.573321 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:01:49.600296 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342f821b-346c-4509-843c-994fad8070a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:49.600943 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f821b-346c-4509-843c-994fad8070a1 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:49.601232 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f821b-346c-4509-843c-994fad8070a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:49.601516 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f821b-346c-4509-843c-994fad8070a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:49.602218 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f821b-346c-4509-843c-994fad8070a1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:01:49.603836 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342f821b-346c-4509-843c-994fad8070a1 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:01:49.644532 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae63ec-ef02-4293-a581-46b2a49840e6 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:49.680046 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4d059-c7de-4fd5-8758-88eacf9ae282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:49.680756 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4d059-c7de-4fd5-8758-88eacf9ae282 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:49.681041 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4d059-c7de-4fd5-8758-88eacf9ae282 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:49.681324 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4d059-c7de-4fd5-8758-88eacf9ae282 None admin] PATH_INFO: `/v3/domains/default/users/9b67efb35ae049b5aa789d6ba0205b2e/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:49.683693 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4d059-c7de-4fd5-8758-88eacf9ae282 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9b67efb35ae049b5aa789d6ba0205b2e, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:01:49.685253 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4d059-c7de-4fd5-8758-88eacf9ae282 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:01:49.696500 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 20/39] 10.222.0.81 () {60 vars in 1131 bytes} [Tue Sep 6 21:01:49 2022] POST /identity/v3/roles => generated 225 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:01:49.697914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591999dc-c6a0-4d0d-b29d-638a4a9f50af None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:49.701307 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591999dc-c6a0-4d0d-b29d-638a4a9f50af None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:49.701307 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591999dc-c6a0-4d0d-b29d-638a4a9f50af None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:49.701307 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 21/40] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:01:49.701307 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462241cd-762a-414b-a1b9-51070d7af422 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:49.701307 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462241cd-762a-414b-a1b9-51070d7af422 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:49.701307 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462241cd-762a-414b-a1b9-51070d7af422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:49.721956 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-462241cd-762a-414b-a1b9-51070d7af422 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:01:49.723565 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-462241cd-762a-414b-a1b9-51070d7af422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:01:49.768132 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 20/41] 10.222.0.81 () {58 vars in 1361 bytes} [Tue Sep 6 21:01:49 2022] PUT /identity/v3/domains/default/users/9b67efb35ae049b5aa789d6ba0205b2e/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:01:49.768132 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89f059-cce1-4d89-bbcc-49c2bdc0c8f8 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:49.768132 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89f059-cce1-4d89-bbcc-49c2bdc0c8f8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:49.768132 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf89f059-cce1-4d89-bbcc-49c2bdc0c8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:49.780315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:01:49.788487 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-bf89f059-cce1-4d89-bbcc-49c2bdc0c8f8 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:01:49.790670 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-bf89f059-cce1-4d89-bbcc-49c2bdc0c8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:01:49.821958 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 22/42] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:01:49.874016 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 21/43] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:01:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:01:50.099028 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462241cd-762a-414b-a1b9-51070d7af422 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:50.141963 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89f059-cce1-4d89-bbcc-49c2bdc0c8f8 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:50.255758 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf89f059-cce1-4d89-bbcc-49c2bdc0c8f8 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:50.296866 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732ecbe-bf67-4429-b6b8-1aa1665032c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:50.297486 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732ecbe-bf67-4429-b6b8-1aa1665032c6 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:50.297766 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732ecbe-bf67-4429-b6b8-1aa1665032c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:50.298038 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732ecbe-bf67-4429-b6b8-1aa1665032c6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:50.299205 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5732ecbe-bf67-4429-b6b8-1aa1665032c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:01:50.300680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5732ecbe-bf67-4429-b6b8-1aa1665032c6 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:01:50.302654 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 22/44] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:01:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:01:50.308430 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732ecbe-bf67-4429-b6b8-1aa1665032c6 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:50.312381 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:01:50.326018 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462241cd-762a-414b-a1b9-51070d7af422 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:50.333431 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:01:50.361741 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c125f14-16a0-44f5-8aae-1ac79707a240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:50.362286 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c125f14-16a0-44f5-8aae-1ac79707a240 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:50.362585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c125f14-16a0-44f5-8aae-1ac79707a240 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:50.363353 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c125f14-16a0-44f5-8aae-1ac79707a240 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:50.364178 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c125f14-16a0-44f5-8aae-1ac79707a240 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:01:50.365520 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c125f14-16a0-44f5-8aae-1ac79707a240 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:01:50.413316 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732ecbe-bf67-4429-b6b8-1aa1665032c6 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:50.427221 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 23/45] 10.222.0.81 () {60 vars in 1131 bytes} [Tue Sep 6 21:01:50 2022] POST /identity/v3/roles => generated 223 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:01:50.456000 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0edd05f-368a-42c8-b63b-d301304dbb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:50.457002 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edd05f-368a-42c8-b63b-d301304dbb14 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:50.457476 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edd05f-368a-42c8-b63b-d301304dbb14 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:50.457900 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0edd05f-368a-42c8-b63b-d301304dbb14 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:50.458757 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0edd05f-368a-42c8-b63b-d301304dbb14 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:01:50.460589 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0edd05f-368a-42c8-b63b-d301304dbb14 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:01:50.538438 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 23/46] 10.222.0.81 () {60 vars in 1141 bytes} [Tue Sep 6 21:01:50 2022] POST /identity/v3/projects => generated 312 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:01:51.978914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61dded-5b3d-4c1e-bf53-e26704ebbed5 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:51.979467 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61dded-5b3d-4c1e-bf53-e26704ebbed5 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:51.979467 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61dded-5b3d-4c1e-bf53-e26704ebbed5 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:51.980860 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 24/47] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:01:51.986367 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343905d-ff6f-4f7f-ac7b-46b8ab72d853 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:51.986813 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343905d-ff6f-4f7f-ac7b-46b8ab72d853 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:51.986925 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343905d-ff6f-4f7f-ac7b-46b8ab72d853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:52.005615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-c343905d-ff6f-4f7f-ac7b-46b8ab72d853 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:01:52.006816 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c343905d-ff6f-4f7f-ac7b-46b8ab72d853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:01:52.061778 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:01:52.078832 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 24/48] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:01:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:01:52.349851 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61dded-5b3d-4c1e-bf53-e26704ebbed5 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:52.454316 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61dded-5b3d-4c1e-bf53-e26704ebbed5 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:52.489183 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b073da3-cf57-4225-ac3e-548296765057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:52.489896 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b073da3-cf57-4225-ac3e-548296765057 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:52.490176 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b073da3-cf57-4225-ac3e-548296765057 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:52.490453 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b073da3-cf57-4225-ac3e-548296765057 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:52.501507 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b073da3-cf57-4225-ac3e-548296765057 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:01:52.506368 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-0b073da3-cf57-4225-ac3e-548296765057 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:01:52.506368 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:01:52.506368 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:01:52.506368 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:01:52.506368 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:01:52.506368 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:01:52.506368 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:01:52.506368 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:01:52.506368 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:01:52.506368 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:01:52.506368 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:01:52.506368 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:01:52.506368 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:01:52.506368 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:01:52.506368 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:01:52.506368 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:01:52.507208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:01:52.507208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:01:52.507208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:01:52.507208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:01:52.507208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:01:52.507208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:01:52.507208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:01:52.507208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:01:52.507208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:01:52.507208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:01:52.507208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:01:52.507208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:01:52.507208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:01:52.507208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:01:52.507208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:01:52.507208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:01:52.507979 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:01:52.507979 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:01:52.507979 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:01:52.507979 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:01:52.507979 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:01:52.507979 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:01:52.507979 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:01:52.507979 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:01:52.507979 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:01:52.507979 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:01:52.507979 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:01:52.507979 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:01:52.507979 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 25/49] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:01:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:01:52.514734 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343905d-ff6f-4f7f-ac7b-46b8ab72d853 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:52.629066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343905d-ff6f-4f7f-ac7b-46b8ab72d853 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:52.662931 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6e927-02f2-4e32-8536-b66e4bf2f7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:52.663811 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6e927-02f2-4e32-8536-b66e4bf2f7ee None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:52.664121 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6e927-02f2-4e32-8536-b66e4bf2f7ee None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:52.664403 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6e927-02f2-4e32-8536-b66e4bf2f7ee None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:52.665071 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c6e927-02f2-4e32-8536-b66e4bf2f7ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:01:52.665378 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c6e927-02f2-4e32-8536-b66e4bf2f7ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:01:52.667346 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c6e927-02f2-4e32-8536-b66e4bf2f7ee None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:01:52.680206 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 25/50] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:01:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:01:52.686548 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b073da3-cf57-4225-ac3e-548296765057 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:52.703595 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c7c73-4cb1-4835-ba67-b785def13af9 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:52.703886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c7c73-4cb1-4835-ba67-b785def13af9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:52.704202 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29c7c73-4cb1-4835-ba67-b785def13af9 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:52.705617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 26/51] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:01:52.711000 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c933e7-057d-44f5-a8a5-8827f2eaa4d9 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:52.712400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c933e7-057d-44f5-a8a5-8827f2eaa4d9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:52.712400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c933e7-057d-44f5-a8a5-8827f2eaa4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:52.715473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:01:52.797827 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b073da3-cf57-4225-ac3e-548296765057 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:52.833589 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a8c933e7-057d-44f5-a8a5-8827f2eaa4d9 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:01:52.833939 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70512258-2a0b-40c2-b122-a940f832b54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:52.834588 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70512258-2a0b-40c2-b122-a940f832b54e None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:52.834793 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a8c933e7-057d-44f5-a8a5-8827f2eaa4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:01:52.834904 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70512258-2a0b-40c2-b122-a940f832b54e None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:52.835151 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70512258-2a0b-40c2-b122-a940f832b54e None admin] PATH_INFO: `/v3/users/9b67efb35ae049b5aa789d6ba0205b2e` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:52.836354 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70512258-2a0b-40c2-b122-a940f832b54e None admin] RBAC: Authorizing `identity:get_user(user_id=9b67efb35ae049b5aa789d6ba0205b2e)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:01:52.840458 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70512258-2a0b-40c2-b122-a940f832b54e None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:01:52.840458 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 26/52] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:01:52 2022] GET /identity/v3/users/9b67efb35ae049b5aa789d6ba0205b2e => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:01:52.845451 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70512258-2a0b-40c2-b122-a940f832b54e None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:52.883207 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:01:52.909368 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 27/53] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:01:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 21:01:52.949389 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:01:52.955986 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70512258-2a0b-40c2-b122-a940f832b54e None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:52.989570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fad10-0375-4f8a-bade-1477f49b778f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:52.990398 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fad10-0375-4f8a-bade-1477f49b778f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:52.990508 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fad10-0375-4f8a-bade-1477f49b778f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:52.990779 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fad10-0375-4f8a-bade-1477f49b778f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:52.991919 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fad10-0375-4f8a-bade-1477f49b778f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:01:52.993452 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fad10-0375-4f8a-bade-1477f49b778f None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:01:52.995049 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 27/54] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:01:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:01:53.001200 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c933e7-057d-44f5-a8a5-8827f2eaa4d9 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:53.100273 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c933e7-057d-44f5-a8a5-8827f2eaa4d9 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:53.133095 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e73d9a-a6f1-4133-972e-98f43ff3ecf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:53.133753 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e73d9a-a6f1-4133-972e-98f43ff3ecf8 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:53.133985 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e73d9a-a6f1-4133-972e-98f43ff3ecf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:53.134260 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e73d9a-a6f1-4133-972e-98f43ff3ecf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:53.135499 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e73d9a-a6f1-4133-972e-98f43ff3ecf8 None admin] RBAC: Adding query filter params (role.id=fe9661f095094dd0931e0b96a1d6ef74, scope.domain.id=default, user.id=9b67efb35ae049b5aa789d6ba0205b2e) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:01:53.135861 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e73d9a-a6f1-4133-972e-98f43ff3ecf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:01:53.137325 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e73d9a-a6f1-4133-972e-98f43ff3ecf8 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:01:53.145000 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 28/55] 10.222.0.81 () {56 vars in 1322 bytes} [Tue Sep 6 21:01:52 2022] GET /identity/v3/role_assignments?user.id=9b67efb35ae049b5aa789d6ba0205b2e&scope.domain.id=default&role.id=fe9661f095094dd0931e0b96a1d6ef74 => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:01:53.181715 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fad10-0375-4f8a-bade-1477f49b778f None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:53.294539 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fad10-0375-4f8a-bade-1477f49b778f None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:53.331329 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c642c8ca-433c-4cb1-bd0a-ffe8d57b4a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:53.331980 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642c8ca-433c-4cb1-bd0a-ffe8d57b4a02 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:53.332300 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642c8ca-433c-4cb1-bd0a-ffe8d57b4a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:53.332586 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c642c8ca-433c-4cb1-bd0a-ffe8d57b4a02 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:53.333734 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642c8ca-433c-4cb1-bd0a-ffe8d57b4a02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:01:53.335194 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c642c8ca-433c-4cb1-bd0a-ffe8d57b4a02 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:01:53.336814 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 28/56] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:01:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:01:53.342559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e73d9a-a6f1-4133-972e-98f43ff3ecf8 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:53.387876 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:01:53.444697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e73d9a-a6f1-4133-972e-98f43ff3ecf8 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:53.477793 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4978ff80-079e-4a03-ab25-4a87b0bef0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:53.478393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978ff80-079e-4a03-ab25-4a87b0bef0f2 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:53.478676 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978ff80-079e-4a03-ab25-4a87b0bef0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:53.479701 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4978ff80-079e-4a03-ab25-4a87b0bef0f2 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:53.480304 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978ff80-079e-4a03-ab25-4a87b0bef0f2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:01:53.481735 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4978ff80-079e-4a03-ab25-4a87b0bef0f2 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:01:53.558384 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 29/57] 10.222.0.81 () {60 vars in 1140 bytes} [Tue Sep 6 21:01:53 2022] POST /identity/v3/projects => generated 298 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:01:55.699104 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e048b-5dba-4479-8438-2647d2e8c27c None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:55.699642 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e048b-5dba-4479-8438-2647d2e8c27c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:55.699642 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e048b-5dba-4479-8438-2647d2e8c27c None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:55.701021 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 29/58] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:01:55.706270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cd6db-ee4d-4085-9dc9-dc15f1b872f1 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:55.706668 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cd6db-ee4d-4085-9dc9-dc15f1b872f1 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:55.706835 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56cd6db-ee4d-4085-9dc9-dc15f1b872f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:55.725030 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-c56cd6db-ee4d-4085-9dc9-dc15f1b872f1 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:01:55.726218 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c56cd6db-ee4d-4085-9dc9-dc15f1b872f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:01:55.790310 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 30/59] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:01:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:01:56.056413 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e048b-5dba-4479-8438-2647d2e8c27c None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:56.086502 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:01:56.155625 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e048b-5dba-4479-8438-2647d2e8c27c None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:56.189472 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dd375c-8410-49a9-9415-8c151e08c7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:56.190105 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd375c-8410-49a9-9415-8c151e08c7f1 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:56.190391 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd375c-8410-49a9-9415-8c151e08c7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:56.190670 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dd375c-8410-49a9-9415-8c151e08c7f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:56.191780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd375c-8410-49a9-9415-8c151e08c7f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:01:56.193247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dd375c-8410-49a9-9415-8c151e08c7f1 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:01:56.194793 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 30/60] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:01:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:01:56.200501 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56cd6db-ee4d-4085-9dc9-dc15f1b872f1 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:01:56.224197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:01:56.299631 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56cd6db-ee4d-4085-9dc9-dc15f1b872f1 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:01:56.331765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b8a40-ebd0-4bb5-8d2b-a61020db9d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:01:56.332353 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b8a40-ebd0-4bb5-8d2b-a61020db9d14 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:56.332640 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b8a40-ebd0-4bb5-8d2b-a61020db9d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:56.332916 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b8a40-ebd0-4bb5-8d2b-a61020db9d14 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:56.333559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b8a40-ebd0-4bb5-8d2b-a61020db9d14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:01:56.334999 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b8a40-ebd0-4bb5-8d2b-a61020db9d14 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:01:56.437689 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 31/61] 10.222.0.81 () {60 vars in 1132 bytes} [Tue Sep 6 21:01:56 2022] POST /identity/v3/users => generated 275 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:01:59.782647 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0ecb6-e20c-45ce-bc10-85b1a973666c None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:59.783684 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0ecb6-e20c-45ce-bc10-85b1a973666c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:59.784222 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a0ecb6-e20c-45ce-bc10-85b1a973666c None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:59.786065 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 31/62] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:01:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:01:59.791495 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af62d2-8188-49f5-9eb1-ba8cd6d7480c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:01:59.792420 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af62d2-8188-49f5-9eb1-ba8cd6d7480c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:01:59.792905 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af62d2-8188-49f5-9eb1-ba8cd6d7480c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:01:59.821160 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-44af62d2-8188-49f5-9eb1-ba8cd6d7480c None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:01:59.823240 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-44af62d2-8188-49f5-9eb1-ba8cd6d7480c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:01:59.906180 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 32/63] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:01:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:00.041718 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd40b0-accc-4d17-913e-82c8337a0513 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:00.042346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd40b0-accc-4d17-913e-82c8337a0513 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:00.042846 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cd40b0-accc-4d17-913e-82c8337a0513 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:00.044440 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 32/64] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:00.050056 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb635a-a766-4ced-907f-9f93aeb51f97 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:00.050592 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb635a-a766-4ced-907f-9f93aeb51f97 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:00.051071 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb635a-a766-4ced-907f-9f93aeb51f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:00.062667 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071b2ef-e08f-4c92-a2a9-cad23e35862b None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:00.063249 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071b2ef-e08f-4c92-a2a9-cad23e35862b None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:00.063732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0071b2ef-e08f-4c92-a2a9-cad23e35862b None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:00.065291 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 33/65] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:00.070330 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbacc8-4d52-467c-ac94-a8f09a117db5 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:00.070860 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbacc8-4d52-467c-ac94-a8f09a117db5 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:00.071337 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbacc8-4d52-467c-ac94-a8f09a117db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:00.092751 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a5bb635a-a766-4ced-907f-9f93aeb51f97 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:00.094443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a5bb635a-a766-4ced-907f-9f93aeb51f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:00.100641 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-78fbacc8-4d52-467c-ac94-a8f09a117db5 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:00.102073 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-78fbacc8-4d52-467c-ac94-a8f09a117db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:00.104440 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:00.241187 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 33/66] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:00.258570 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb635a-a766-4ced-907f-9f93aeb51f97 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:00.269343 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 34/67] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 21:02:00.337303 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a2f42-2b00-4f94-800e-ab98cec80ed5 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:00.337588 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a2f42-2b00-4f94-800e-ab98cec80ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:00.337791 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a2f42-2b00-4f94-800e-ab98cec80ed5 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:00.339379 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 35/68] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:02:00.344329 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942239a1-725e-4026-abf5-43f971e27c8c None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:00.344625 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942239a1-725e-4026-abf5-43f971e27c8c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:00.344909 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942239a1-725e-4026-abf5-43f971e27c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:00.374895 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-942239a1-725e-4026-abf5-43f971e27c8c None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:00.376129 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-942239a1-725e-4026-abf5-43f971e27c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:00.395252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb635a-a766-4ced-907f-9f93aeb51f97 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:00.422076 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:00.434195 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c7894d-d0cb-49e9-8088-e59d2844b435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:00.435038 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7894d-d0cb-49e9-8088-e59d2844b435 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:00.435469 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7894d-d0cb-49e9-8088-e59d2844b435 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:00.435914 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c7894d-d0cb-49e9-8088-e59d2844b435 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:00.445382 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:00.449183 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c7894d-d0cb-49e9-8088-e59d2844b435 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:00.456714 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-44c7894d-d0cb-49e9-8088-e59d2844b435 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:02:00.456714 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:00.456714 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:00.456714 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:00.456714 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:00.456714 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:00.456714 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:00.456714 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:00.456714 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:00.456714 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:00.456714 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:00.456714 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:00.456714 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:00.456714 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:00.456714 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:00.456714 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:00.457761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:00.457761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:00.457761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:00.457761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:00.457761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:00.457761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:00.457761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:00.457761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:00.457761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:00.457761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:00.457761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:00.457761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:00.457761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:00.457761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:00.457761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:00.457761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:00.459069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:00.459069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:00.459069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:00.459069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:00.459069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:00.459069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:00.459069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:00.459069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:00.459069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:00.459069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:00.459069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:02:00.459069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:00.461268 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 34/69] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:02:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:00.462601 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5cbec-64da-4c67-96ed-80c392f39cc3 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:00.463068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5cbec-64da-4c67-96ed-80c392f39cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:00.463477 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a5cbec-64da-4c67-96ed-80c392f39cc3 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:00.464987 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 35/70] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:00.471132 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5cbec-64da-4c67-96ed-80c392f39cc3 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:00.484408 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 36/71] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 21:02:00.485909 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e7c51-cc51-4eed-b996-15f152955917 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:00.486355 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e7c51-cc51-4eed-b996-15f152955917 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:00.486811 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1e7c51-cc51-4eed-b996-15f152955917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:00.507526 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-9d1e7c51-cc51-4eed-b996-15f152955917 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:00.509561 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-9d1e7c51-cc51-4eed-b996-15f152955917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:00.584742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 37/72] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:00.585834 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e7c51-cc51-4eed-b996-15f152955917 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:00.629424 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a5cbec-64da-4c67-96ed-80c392f39cc3 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:00.677153 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7f09b-0d45-4ed5-bf26-828750c2ac07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:00.677881 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7f09b-0d45-4ed5-bf26-828750c2ac07 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:00.678166 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7f09b-0d45-4ed5-bf26-828750c2ac07 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:00.678439 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7f09b-0d45-4ed5-bf26-828750c2ac07 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:00.679382 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff7f09b-0d45-4ed5-bf26-828750c2ac07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:00.679687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff7f09b-0d45-4ed5-bf26-828750c2ac07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:00.681613 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff7f09b-0d45-4ed5-bf26-828750c2ac07 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:00.688553 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:00.692055 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 36/73] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:00.693453 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7f09b-0d45-4ed5-bf26-828750c2ac07 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:00.699419 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1e7c51-cc51-4eed-b996-15f152955917 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:00.739164 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9195bd-bd63-40d1-86ba-14451ced731f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:00.740180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9195bd-bd63-40d1-86ba-14451ced731f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:00.740698 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9195bd-bd63-40d1-86ba-14451ced731f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:00.741202 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9195bd-bd63-40d1-86ba-14451ced731f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:00.752917 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9195bd-bd63-40d1-86ba-14451ced731f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:00.758509 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-5f9195bd-bd63-40d1-86ba-14451ced731f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:00.758509 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:00.758509 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:00.758509 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:00.758509 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:00.758509 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:00.758509 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:00.758509 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:00.758509 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:00.758509 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:00.758509 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:00.758509 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:00.758509 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:00.758509 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:00.758509 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:00.758509 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:00.759370 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:00.759370 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:00.759370 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:00.759370 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:00.759370 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:00.759370 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:00.759370 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:00.759370 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:00.759370 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:00.759370 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:00.759370 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:00.759370 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:00.759370 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:00.759370 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:00.759370 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:00.759370 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:00.760705 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:00.760705 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:00.760705 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:00.760705 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:00.760705 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:00.760705 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:00.760705 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:00.760705 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:00.760705 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:00.760705 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:00.760705 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:00.760705 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:02:00.763470 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 38/74] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:00.764678 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9195bd-bd63-40d1-86ba-14451ced731f None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:00.766862 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:00.813095 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7f09b-0d45-4ed5-bf26-828750c2ac07 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:00.848155 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e059ff3-ad00-45eb-9468-24a434ac697b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:00.849074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e059ff3-ad00-45eb-9468-24a434ac697b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:00.849358 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e059ff3-ad00-45eb-9468-24a434ac697b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:00.849633 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e059ff3-ad00-45eb-9468-24a434ac697b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:00.860193 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e059ff3-ad00-45eb-9468-24a434ac697b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:00.865807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-6e059ff3-ad00-45eb-9468-24a434ac697b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 21:02:00.865807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:00.865807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:00.865807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:00.865807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:00.865807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:00.865807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:00.865807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:00.865807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:00.865807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:00.865807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:00.865807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:00.865807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:00.865807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:00.865807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:00.865807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:00.867590 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:00.867590 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:00.867590 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:00.867590 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:00.867590 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:00.867590 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:00.867590 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:00.867590 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:00.867590 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:00.867590 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:00.867590 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:00.867590 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:00.867590 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:00.867590 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:00.867590 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:00.867590 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:00.869632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:00.869632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:00.869632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:00.869632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:00.869632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:00.869632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:00.869632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:00.869632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:00.869632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:00.869632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:00.869632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 21:02:00.869632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:00.869632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 37/75] 10.222.0.81 () {56 vars in 1114 bytes} [Tue Sep 6 21:02:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:00.869632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e059ff3-ad00-45eb-9468-24a434ac697b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:00.884364 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9195bd-bd63-40d1-86ba-14451ced731f None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:00.923014 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec670a2-9065-46e5-b268-c8d8db3ad5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:00.923653 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec670a2-9065-46e5-b268-c8d8db3ad5ba None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:00.923935 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec670a2-9065-46e5-b268-c8d8db3ad5ba None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:00.924252 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec670a2-9065-46e5-b268-c8d8db3ad5ba None admin] PATH_INFO: `/v3/users/9b67efb35ae049b5aa789d6ba0205b2e` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:00.925418 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec670a2-9065-46e5-b268-c8d8db3ad5ba None admin] RBAC: Authorizing `identity:get_user(user_id=9b67efb35ae049b5aa789d6ba0205b2e)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:00.926894 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec670a2-9065-46e5-b268-c8d8db3ad5ba None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:00.928579 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 39/76] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:02:00 2022] GET /identity/v3/users/9b67efb35ae049b5aa789d6ba0205b2e => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:00.929356 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec670a2-9065-46e5-b268-c8d8db3ad5ba None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:00.950084 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:00.992489 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e059ff3-ad00-45eb-9468-24a434ac697b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:01.025710 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:01.040442 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e04776-8c9a-46d4-a366-4ad527832b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:01.041100 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e04776-8c9a-46d4-a366-4ad527832b24 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:01.041394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e04776-8c9a-46d4-a366-4ad527832b24 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:01.041668 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e04776-8c9a-46d4-a366-4ad527832b24 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:01.042345 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e04776-8c9a-46d4-a366-4ad527832b24 None admin] RBAC: Adding query filter params (name=member) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:01.042653 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e04776-8c9a-46d4-a366-4ad527832b24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:01.043962 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec670a2-9065-46e5-b268-c8d8db3ad5ba None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:01.044083 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e04776-8c9a-46d4-a366-4ad527832b24 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:01.053155 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 38/77] 10.222.0.81 () {56 vars in 1101 bytes} [Tue Sep 6 21:02:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:01.054276 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e04776-8c9a-46d4-a366-4ad527832b24 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:01.087478 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b31ee5-20fd-4868-9387-f8d76ac41bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:01.088183 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b31ee5-20fd-4868-9387-f8d76ac41bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:01.088466 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b31ee5-20fd-4868-9387-f8d76ac41bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:01.088738 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b31ee5-20fd-4868-9387-f8d76ac41bc7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:01.089889 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b31ee5-20fd-4868-9387-f8d76ac41bc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:01.091362 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b31ee5-20fd-4868-9387-f8d76ac41bc7 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:01.092972 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 40/78] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:02:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:01.093746 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b31ee5-20fd-4868-9387-f8d76ac41bc7 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:01.173696 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e04776-8c9a-46d4-a366-4ad527832b24 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:01.194099 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:01.210880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b31ee5-20fd-4868-9387-f8d76ac41bc7 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:01.214437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177e2f0-874a-47d0-94da-640d3d2e1872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:01.215531 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177e2f0-874a-47d0-94da-640d3d2e1872 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:01.216042 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177e2f0-874a-47d0-94da-640d3d2e1872 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:01.216597 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177e2f0-874a-47d0-94da-640d3d2e1872 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:01.231775 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177e2f0-874a-47d0-94da-640d3d2e1872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:01.236690 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-2177e2f0-874a-47d0-94da-640d3d2e1872 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:01.236690 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:01.236690 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:01.236690 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:01.236690 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:01.236690 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:01.236690 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:01.236690 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:01.236690 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:01.236690 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:01.236690 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:01.236690 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:01.236690 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:01.236690 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:01.236690 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:01.236690 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:01.237540 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:01.237540 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:01.237540 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:01.237540 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:01.237540 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:01.237540 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:01.237540 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:01.237540 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:01.237540 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:01.237540 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:01.237540 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:01.237540 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:01.237540 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:01.237540 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:01.237540 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:01.237540 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:01.238297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:01.238297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:01.238297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:01.238297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:01.238297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:01.238297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:01.238297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:01.238297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:01.238297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:01.238297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:01.238297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:01.238297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:01.238297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 39/79] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:01.239121 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177e2f0-874a-47d0-94da-640d3d2e1872 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:01.253927 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ba2c2-65b2-49cf-988c-00092d3c49a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:01.254561 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ba2c2-65b2-49cf-988c-00092d3c49a6 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:01.254842 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ba2c2-65b2-49cf-988c-00092d3c49a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:01.255185 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ba2c2-65b2-49cf-988c-00092d3c49a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:01.255863 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ba2c2-65b2-49cf-988c-00092d3c49a6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:01.256283 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ba2c2-65b2-49cf-988c-00092d3c49a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:01.257738 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ba2c2-65b2-49cf-988c-00092d3c49a6 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:01.266622 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 41/80] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:02:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:01.267585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ba2c2-65b2-49cf-988c-00092d3c49a6 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:01.300481 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:01.354792 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177e2f0-874a-47d0-94da-640d3d2e1872 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:01.382496 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ba2c2-65b2-49cf-988c-00092d3c49a6 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:01.389080 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2918432-74a4-489e-8d6b-ffd2828b2aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:01.389694 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2918432-74a4-489e-8d6b-ffd2828b2aef None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:01.389980 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2918432-74a4-489e-8d6b-ffd2828b2aef None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:01.390261 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2918432-74a4-489e-8d6b-ffd2828b2aef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:01.417248 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eca3d1-02e4-4f48-bad8-df3ba4de4a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:01.417924 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eca3d1-02e4-4f48-bad8-df3ba4de4a3c None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:01.418214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eca3d1-02e4-4f48-bad8-df3ba4de4a3c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:01.418496 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eca3d1-02e4-4f48-bad8-df3ba4de4a3c None admin] PATH_INFO: `/v3/users/b318067cc95941c9b611879f7240b4ee` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:01.432951 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eca3d1-02e4-4f48-bad8-df3ba4de4a3c None admin] RBAC: Authorizing `identity:get_user(user_id=b318067cc95941c9b611879f7240b4ee)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:01.434362 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eca3d1-02e4-4f48-bad8-df3ba4de4a3c None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:01.436017 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 42/81] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:02:01 2022] GET /identity/v3/users/b318067cc95941c9b611879f7240b4ee => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:01.436790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eca3d1-02e4-4f48-bad8-df3ba4de4a3c None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:01.440111 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:01.459641 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2918432-74a4-489e-8d6b-ffd2828b2aef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:01.461158 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2918432-74a4-489e-8d6b-ffd2828b2aef None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:01.511284 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:01.551511 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eca3d1-02e4-4f48-bad8-df3ba4de4a3c None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:01.576444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 40/82] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:02:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 21:02:01.577306 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2918432-74a4-489e-8d6b-ffd2828b2aef None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:01.595521 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca90ec-a500-4b5a-9cee-c69e2513f644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:01.596178 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca90ec-a500-4b5a-9cee-c69e2513f644 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:01.596475 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca90ec-a500-4b5a-9cee-c69e2513f644 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:01.596756 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca90ec-a500-4b5a-9cee-c69e2513f644 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:01.597417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca90ec-a500-4b5a-9cee-c69e2513f644 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:01.598882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca90ec-a500-4b5a-9cee-c69e2513f644 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:01.689694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 43/83] 10.222.0.81 () {60 vars in 1132 bytes} [Tue Sep 6 21:02:01 2022] POST /identity/v3/users => generated 289 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:02:01.690057 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2918432-74a4-489e-8d6b-ffd2828b2aef None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:01.690446 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca90ec-a500-4b5a-9cee-c69e2513f644 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:01.745200 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a85ea-71c7-4b60-a946-74009b8f322b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:01.746208 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a85ea-71c7-4b60-a946-74009b8f322b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:01.746632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a85ea-71c7-4b60-a946-74009b8f322b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:01.746917 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a85ea-71c7-4b60-a946-74009b8f322b None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:01.747619 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a85ea-71c7-4b60-a946-74009b8f322b None admin] RBAC: Adding query filter params (name=member) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:01.747927 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a85ea-71c7-4b60-a946-74009b8f322b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:01.749399 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6a85ea-71c7-4b60-a946-74009b8f322b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:01.758919 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 41/84] 10.222.0.81 () {56 vars in 1101 bytes} [Tue Sep 6 21:02:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:01.759852 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a85ea-71c7-4b60-a946-74009b8f322b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:01.770832 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:01.771597 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:01.820992 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca90ec-a500-4b5a-9cee-c69e2513f644 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:01.859585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d8358-9858-45ae-be25-48646fc860ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:01.860273 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d8358-9858-45ae-be25-48646fc860ab None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:01.860557 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d8358-9858-45ae-be25-48646fc860ab None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:01.860836 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130d8358-9858-45ae-be25-48646fc860ab None admin] PATH_INFO: `/v3/users/b318067cc95941c9b611879f7240b4ee` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:01.861994 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d8358-9858-45ae-be25-48646fc860ab None admin] RBAC: Authorizing `identity:get_user(user_id=b318067cc95941c9b611879f7240b4ee)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:01.863459 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130d8358-9858-45ae-be25-48646fc860ab None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:01.865262 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 44/85] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:02:01 2022] GET /identity/v3/users/b318067cc95941c9b611879f7240b4ee => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:01.866139 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d8358-9858-45ae-be25-48646fc860ab None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:01.878933 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a85ea-71c7-4b60-a946-74009b8f322b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:01.916810 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0f0b0-0e2f-4c83-b6e1-3566d88884a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:01.917475 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0f0b0-0e2f-4c83-b6e1-3566d88884a4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:01.917762 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0f0b0-0e2f-4c83-b6e1-3566d88884a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:01.918035 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0f0b0-0e2f-4c83-b6e1-3566d88884a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:01.997117 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0f0b0-0e2f-4c83-b6e1-3566d88884a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:01.998801 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0f0b0-0e2f-4c83-b6e1-3566d88884a4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:02.008177 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:02.047325 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130d8358-9858-45ae-be25-48646fc860ab None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:02.076363 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:02.090933 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6eb313-80de-4444-bfbf-453ab55e6657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:02.091928 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6eb313-80de-4444-bfbf-453ab55e6657 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:02.092959 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6eb313-80de-4444-bfbf-453ab55e6657 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:02.093406 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6eb313-80de-4444-bfbf-453ab55e6657 None admin] PATH_INFO: `/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:02.095307 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6eb313-80de-4444-bfbf-453ab55e6657 None admin] RBAC: Authorizing `identity:get_project(project_id=d3beaaf3de6a4ec9857978f70d555f6a)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:02.097757 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6eb313-80de-4444-bfbf-453ab55e6657 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:02.100595 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 45/86] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:01 2022] GET /identity/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:02.101925 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6eb313-80de-4444-bfbf-453ab55e6657 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:02.121759 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 42/87] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:02:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 21:02:02.122645 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0f0b0-0e2f-4c83-b6e1-3566d88884a4 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:02.226043 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6eb313-80de-4444-bfbf-453ab55e6657 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:02.254393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0f0b0-0e2f-4c83-b6e1-3566d88884a4 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:02.263022 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:02.276581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6114819-d285-44b1-95a9-e6b9a171f6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:02.277491 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6114819-d285-44b1-95a9-e6b9a171f6e2 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:02.277922 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6114819-d285-44b1-95a9-e6b9a171f6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:02.278761 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6114819-d285-44b1-95a9-e6b9a171f6e2 None admin] PATH_INFO: `/v3/users/b318067cc95941c9b611879f7240b4ee` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:02.280330 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6114819-d285-44b1-95a9-e6b9a171f6e2 None admin] RBAC: Authorizing `identity:get_user(user_id=b318067cc95941c9b611879f7240b4ee)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:02.282595 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6114819-d285-44b1-95a9-e6b9a171f6e2 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:02.284968 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 46/88] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:02:02 2022] GET /identity/v3/users/b318067cc95941c9b611879f7240b4ee => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:02.285942 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6114819-d285-44b1-95a9-e6b9a171f6e2 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:02.299864 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f73b12-412d-4384-8178-44ee0375562c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:02.300701 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f73b12-412d-4384-8178-44ee0375562c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:02.301085 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f73b12-412d-4384-8178-44ee0375562c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:02.301807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f73b12-412d-4384-8178-44ee0375562c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:02.374438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:02.381489 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f73b12-412d-4384-8178-44ee0375562c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:02.384070 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f73b12-412d-4384-8178-44ee0375562c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:02.417055 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6114819-d285-44b1-95a9-e6b9a171f6e2 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:02.460630 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1b87e-b08c-4883-80b2-f7ade8fff8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:02.461790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1b87e-b08c-4883-80b2-f7ade8fff8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:02.462229 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1b87e-b08c-4883-80b2-f7ade8fff8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:02.462669 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1b87e-b08c-4883-80b2-f7ade8fff8d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:02.464427 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1b87e-b08c-4883-80b2-f7ade8fff8d0 None admin] RBAC: Adding query filter params (role.id=fe9661f095094dd0931e0b96a1d6ef74, scope.project.id=d3beaaf3de6a4ec9857978f70d555f6a, user.id=9b67efb35ae049b5aa789d6ba0205b2e) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:02.464963 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1b87e-b08c-4883-80b2-f7ade8fff8d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:02.466862 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1b87e-b08c-4883-80b2-f7ade8fff8d0 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:02.473898 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 47/89] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:02:02 2022] GET /identity/v3/role_assignments?user.id=9b67efb35ae049b5aa789d6ba0205b2e&scope.project.id=d3beaaf3de6a4ec9857978f70d555f6a&role.id=fe9661f095094dd0931e0b96a1d6ef74 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:02.475146 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1b87e-b08c-4883-80b2-f7ade8fff8d0 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:02.512290 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 43/90] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:02:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 21:02:02.513252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f73b12-412d-4384-8178-44ee0375562c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:02.522160 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:02.608289 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1b87e-b08c-4883-80b2-f7ade8fff8d0 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:02.639508 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:02.648853 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79531e44-525c-4fe4-927f-b2078cb5fb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:02.649740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79531e44-525c-4fe4-927f-b2078cb5fb5e None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:02.650177 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79531e44-525c-4fe4-927f-b2078cb5fb5e None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:02.651132 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79531e44-525c-4fe4-927f-b2078cb5fb5e None admin] PATH_INFO: `/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:02.652571 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79531e44-525c-4fe4-927f-b2078cb5fb5e None admin] RBAC: Authorizing `identity:get_project(project_id=d3beaaf3de6a4ec9857978f70d555f6a)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:02.654258 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79531e44-525c-4fe4-927f-b2078cb5fb5e None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:02.657039 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 48/91] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:02 2022] GET /identity/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:02.658263 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79531e44-525c-4fe4-927f-b2078cb5fb5e None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:02.713815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f73b12-412d-4384-8178-44ee0375562c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:02.781501 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79531e44-525c-4fe4-927f-b2078cb5fb5e None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:02.796688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae8251-2824-4f89-95f3-71008f74ca8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:02.797341 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae8251-2824-4f89-95f3-71008f74ca8c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:02.797624 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae8251-2824-4f89-95f3-71008f74ca8c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:02.797932 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae8251-2824-4f89-95f3-71008f74ca8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:02.834866 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1ce8f-8c49-47a3-8d00-a0082b11e1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:02.838859 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1ce8f-8c49-47a3-8d00-a0082b11e1df None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:02.838859 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1ce8f-8c49-47a3-8d00-a0082b11e1df None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:02.838859 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1ce8f-8c49-47a3-8d00-a0082b11e1df None admin] PATH_INFO: `/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:02.838859 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1ce8f-8c49-47a3-8d00-a0082b11e1df None admin] RBAC: Authorizing `identity:get_project(project_id=d3beaaf3de6a4ec9857978f70d555f6a)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:02.840176 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1ce8f-8c49-47a3-8d00-a0082b11e1df None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:02.841973 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 49/92] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:02 2022] GET /identity/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:02.842845 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1ce8f-8c49-47a3-8d00-a0082b11e1df None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:02.926076 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae8251-2824-4f89-95f3-71008f74ca8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:02.927561 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae8251-2824-4f89-95f3-71008f74ca8c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:02.937107 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:02.939721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:02.990893 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1ce8f-8c49-47a3-8d00-a0082b11e1df None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:03.081475 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14aec97-46a9-4de6-9a49-564564a7a6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:03.082082 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 44/93] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:02:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 21:02:03.082329 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14aec97-46a9-4de6-9a49-564564a7a6d7 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:03.082430 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae8251-2824-4f89-95f3-71008f74ca8c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:03.082619 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14aec97-46a9-4de6-9a49-564564a7a6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:03.082895 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14aec97-46a9-4de6-9a49-564564a7a6d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:03.083633 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14aec97-46a9-4de6-9a49-564564a7a6d7 None admin] RBAC: Adding query filter params (role.id=be70fb8abf3148dda8e8e51be3a212e6, scope.project.id=d3beaaf3de6a4ec9857978f70d555f6a, user.id=b318067cc95941c9b611879f7240b4ee) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:03.083945 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14aec97-46a9-4de6-9a49-564564a7a6d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:03.085420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14aec97-46a9-4de6-9a49-564564a7a6d7 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:03.102985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 50/94] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:02:02 2022] GET /identity/v3/role_assignments?user.id=b318067cc95941c9b611879f7240b4ee&scope.project.id=d3beaaf3de6a4ec9857978f70d555f6a&role.id=be70fb8abf3148dda8e8e51be3a212e6 => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:03.104279 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14aec97-46a9-4de6-9a49-564564a7a6d7 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:03.211130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae8251-2824-4f89-95f3-71008f74ca8c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:03.226900 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:03.300844 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15039a6-5c97-44f4-b74f-4967172c9dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:03.301487 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15039a6-5c97-44f4-b74f-4967172c9dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:03.301771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15039a6-5c97-44f4-b74f-4967172c9dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:03.302047 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15039a6-5c97-44f4-b74f-4967172c9dc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:03.302799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15039a6-5c97-44f4-b74f-4967172c9dc2 None admin] RBAC: Adding query filter params (role.id=c1dd3aa5113d434ab8306e2453a5ba6a, scope.project.id=d3beaaf3de6a4ec9857978f70d555f6a, user.id=b318067cc95941c9b611879f7240b4ee) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:03.303111 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15039a6-5c97-44f4-b74f-4967172c9dc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:03.304592 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15039a6-5c97-44f4-b74f-4967172c9dc2 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:03.319159 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 45/95] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:02:03 2022] GET /identity/v3/role_assignments?user.id=b318067cc95941c9b611879f7240b4ee&scope.project.id=d3beaaf3de6a4ec9857978f70d555f6a&role.id=c1dd3aa5113d434ab8306e2453a5ba6a => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:03.351334 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14aec97-46a9-4de6-9a49-564564a7a6d7 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:03.404906 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:03.426030 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272b20a-c4c4-4ccc-996f-712172a71280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:03.426719 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272b20a-c4c4-4ccc-996f-712172a71280 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:03.427011 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272b20a-c4c4-4ccc-996f-712172a71280 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:03.427292 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272b20a-c4c4-4ccc-996f-712172a71280 None admin] PATH_INFO: `/v3/projects/ed10cd8a9aeb4529b95b4f22bd6dbd3b` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:03.428868 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272b20a-c4c4-4ccc-996f-712172a71280 None admin] RBAC: Authorizing `identity:get_project(project_id=ed10cd8a9aeb4529b95b4f22bd6dbd3b)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:03.430440 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272b20a-c4c4-4ccc-996f-712172a71280 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:03.432197 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 51/96] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:03 2022] GET /identity/v3/projects/ed10cd8a9aeb4529b95b4f22bd6dbd3b => generated 312 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:03.438292 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15039a6-5c97-44f4-b74f-4967172c9dc2 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:03.584440 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15039a6-5c97-44f4-b74f-4967172c9dc2 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:03.631755 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ebb05-dc5d-4b4b-af3a-5fcc2dc07e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:03.632314 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ebb05-dc5d-4b4b-af3a-5fcc2dc07e23 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:03.632600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ebb05-dc5d-4b4b-af3a-5fcc2dc07e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:03.632872 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ebb05-dc5d-4b4b-af3a-5fcc2dc07e23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:03.633606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ebb05-dc5d-4b4b-af3a-5fcc2dc07e23 None admin] RBAC: Adding query filter params (role.id=be70fb8abf3148dda8e8e51be3a212e6, scope.project.id=ed10cd8a9aeb4529b95b4f22bd6dbd3b, user.id=b318067cc95941c9b611879f7240b4ee) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:03.633915 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ebb05-dc5d-4b4b-af3a-5fcc2dc07e23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:03.635380 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ebb05-dc5d-4b4b-af3a-5fcc2dc07e23 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:03.648216 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 46/97] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:02:03 2022] GET /identity/v3/role_assignments?user.id=b318067cc95941c9b611879f7240b4ee&scope.project.id=ed10cd8a9aeb4529b95b4f22bd6dbd3b&role.id=be70fb8abf3148dda8e8e51be3a212e6 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:04.533147 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fb9f4-9c21-47c5-9ba0-4e8a1cca147d None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:04.533638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fb9f4-9c21-47c5-9ba0-4e8a1cca147d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:04.533710 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4fb9f4-9c21-47c5-9ba0-4e8a1cca147d None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:04.535473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 52/98] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:04.541490 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3c60f-e93c-47a2-a3bb-1965a89bdded None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:04.542311 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3c60f-e93c-47a2-a3bb-1965a89bdded None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:04.542784 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd3c60f-e93c-47a2-a3bb-1965a89bdded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:04.565158 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8fd3c60f-e93c-47a2-a3bb-1965a89bdded None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:04.566680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8fd3c60f-e93c-47a2-a3bb-1965a89bdded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:04.605741 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:04.621063 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ddf43-2b1c-454b-a7a8-9530d7368147 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:04.621341 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ddf43-2b1c-454b-a7a8-9530d7368147 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:04.621625 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ddf43-2b1c-454b-a7a8-9530d7368147 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:04.623161 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 53/99] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:04.631900 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29166fd5-03ad-4666-8ad9-473a12a39537 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:04.632215 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29166fd5-03ad-4666-8ad9-473a12a39537 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:04.632783 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29166fd5-03ad-4666-8ad9-473a12a39537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:04.673903 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-29166fd5-03ad-4666-8ad9-473a12a39537 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:04.675120 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-29166fd5-03ad-4666-8ad9-473a12a39537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:04.690057 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 47/100] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:04.819832 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 54/101] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:05.032369 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3c60f-e93c-47a2-a3bb-1965a89bdded None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:05.139784 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd3c60f-e93c-47a2-a3bb-1965a89bdded None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:05.177212 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca74425-5fd7-477a-8735-19d98041a73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:05.177951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca74425-5fd7-477a-8735-19d98041a73b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:05.178151 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca74425-5fd7-477a-8735-19d98041a73b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:05.178496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca74425-5fd7-477a-8735-19d98041a73b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:05.179632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca74425-5fd7-477a-8735-19d98041a73b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:05.181123 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca74425-5fd7-477a-8735-19d98041a73b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:05.182766 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 48/102] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:02:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:05.188571 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29166fd5-03ad-4666-8ad9-473a12a39537 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:05.297261 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29166fd5-03ad-4666-8ad9-473a12a39537 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:05.325930 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:05.335081 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51c998-4907-4ed7-8c7e-d27aa5932a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:05.335715 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51c998-4907-4ed7-8c7e-d27aa5932a3d None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:05.335990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51c998-4907-4ed7-8c7e-d27aa5932a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:05.336306 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c51c998-4907-4ed7-8c7e-d27aa5932a3d None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:05.336987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c51c998-4907-4ed7-8c7e-d27aa5932a3d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:05.344415 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c51c998-4907-4ed7-8c7e-d27aa5932a3d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:05.364426 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca74425-5fd7-477a-8735-19d98041a73b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:05.418861 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:05.472594 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 55/103] 10.222.0.81 () {60 vars in 1141 bytes} [Tue Sep 6 21:02:05 2022] POST /identity/v3/projects => generated 302 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:02:05.522934 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca74425-5fd7-477a-8735-19d98041a73b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:05.578241 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb43aef-d613-4b1f-875c-6b368cb766f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:05.578971 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb43aef-d613-4b1f-875c-6b368cb766f9 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:05.579192 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb43aef-d613-4b1f-875c-6b368cb766f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:05.579466 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb43aef-d613-4b1f-875c-6b368cb766f9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:05.595128 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb43aef-d613-4b1f-875c-6b368cb766f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:05.600437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-bcb43aef-d613-4b1f-875c-6b368cb766f9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 21:02:05.600437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:05.600437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:05.600437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:05.600437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:05.600437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:05.600437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:05.600437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:05.600437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:05.600437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:05.600437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:05.600437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:05.600437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:05.600437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:05.600437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:05.600437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:05.601360 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:05.601360 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:05.601360 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:05.601360 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:05.601360 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:05.601360 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:05.601360 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:05.601360 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:05.601360 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:05.601360 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:05.601360 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:05.601360 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:05.601360 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:05.601360 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:05.601360 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:05.601360 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:05.602130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:05.602130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:05.602130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:05.602130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:05.602130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:05.602130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:05.602130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:05.602130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:05.602130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:05.602130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:05.602130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 21:02:05.602130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:05.602130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 49/104] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:02:05.609765 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51c998-4907-4ed7-8c7e-d27aa5932a3d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:05.763599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c51c998-4907-4ed7-8c7e-d27aa5932a3d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:05.810827 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7dec99-809b-4a58-921b-7ed10142ca67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:05.811844 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7dec99-809b-4a58-921b-7ed10142ca67 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:05.812351 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7dec99-809b-4a58-921b-7ed10142ca67 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:05.812829 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7dec99-809b-4a58-921b-7ed10142ca67 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:05.813713 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7dec99-809b-4a58-921b-7ed10142ca67 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:05.814241 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7dec99-809b-4a58-921b-7ed10142ca67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:05.815913 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7dec99-809b-4a58-921b-7ed10142ca67 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:05.828892 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 56/105] 10.222.0.81 () {56 vars in 1101 bytes} [Tue Sep 6 21:02:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:05.836665 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb43aef-d613-4b1f-875c-6b368cb766f9 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:05.929971 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d033aa2-452b-4a8f-8441-2131bf51a45b None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:05.930333 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d033aa2-452b-4a8f-8441-2131bf51a45b None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:05.930579 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d033aa2-452b-4a8f-8441-2131bf51a45b None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:05.932122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 57/106] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:05.945290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74d4d0-77fb-4284-815a-34054e370990 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:05.945597 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74d4d0-77fb-4284-815a-34054e370990 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:05.945853 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74d4d0-77fb-4284-815a-34054e370990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:05.981187 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-ba74d4d0-77fb-4284-815a-34054e370990 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:05.982386 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ba74d4d0-77fb-4284-815a-34054e370990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:05.986564 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:06.002261 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb43aef-d613-4b1f-875c-6b368cb766f9 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:06.069475 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:06.083613 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25bb16b-5cba-4953-b0ca-45da4683f058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:06.087244 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bb16b-5cba-4953-b0ca-45da4683f058 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:06.087244 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bb16b-5cba-4953-b0ca-45da4683f058 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:06.087244 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25bb16b-5cba-4953-b0ca-45da4683f058 None admin] PATH_INFO: `/v3/users/c8345b59cd9043f3998e19d0ff7fccd8` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:06.105963 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25bb16b-5cba-4953-b0ca-45da4683f058 None admin] RBAC: Authorizing `identity:get_user(user_id=c8345b59cd9043f3998e19d0ff7fccd8)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:06.107670 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25bb16b-5cba-4953-b0ca-45da4683f058 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:06.110870 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 50/107] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:02:05 2022] GET /identity/v3/users/c8345b59cd9043f3998e19d0ff7fccd8 => generated 289 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:06.117783 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25bb16b-5cba-4953-b0ca-45da4683f058 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:06.125036 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 58/108] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 21:02:06.191041 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bfb88-2365-4029-a49d-42914d2d1e3c None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:06.191556 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bfb88-2365-4029-a49d-42914d2d1e3c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:06.192009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bfb88-2365-4029-a49d-42914d2d1e3c None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:06.193662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 59/109] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:02:06.199546 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befa008-1b05-4151-9f2c-f84d0a514019 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:06.200128 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befa008-1b05-4151-9f2c-f84d0a514019 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:06.200552 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befa008-1b05-4151-9f2c-f84d0a514019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:06.241816 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25bb16b-5cba-4953-b0ca-45da4683f058 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:06.245621 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-1befa008-1b05-4151-9f2c-f84d0a514019 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:06.247036 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1befa008-1b05-4151-9f2c-f84d0a514019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:06.300992 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4acdc7a-b3b5-49b1-b316-d446633b080d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:06.301630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acdc7a-b3b5-49b1-b316-d446633b080d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:06.301920 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acdc7a-b3b5-49b1-b316-d446633b080d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:06.302231 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4acdc7a-b3b5-49b1-b316-d446633b080d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:06.342109 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:06.380037 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4acdc7a-b3b5-49b1-b316-d446633b080d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:06.381917 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4acdc7a-b3b5-49b1-b316-d446633b080d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:06.434096 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 60/110] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 06 21:02:06.551040 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befa008-1b05-4151-9f2c-f84d0a514019 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:06.554403 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 51/111] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:02:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 21:02:06.561599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4acdc7a-b3b5-49b1-b316-d446633b080d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:06.701204 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:06.768962 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:06.772054 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befa008-1b05-4151-9f2c-f84d0a514019 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:06.811277 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3a5f0-4dec-415a-9bb1-5e3701b09b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:06.812253 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3a5f0-4dec-415a-9bb1-5e3701b09b85 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:06.812692 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3a5f0-4dec-415a-9bb1-5e3701b09b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:06.813466 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3a5f0-4dec-415a-9bb1-5e3701b09b85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:06.823009 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4acdc7a-b3b5-49b1-b316-d446633b080d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:06.833891 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3a5f0-4dec-415a-9bb1-5e3701b09b85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:06.839229 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-2bf3a5f0-4dec-415a-9bb1-5e3701b09b85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:02:06.839229 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:06.839229 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:06.839229 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:06.839229 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:06.839229 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:06.839229 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:06.839229 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:06.839229 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:06.839229 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:06.839229 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:06.839229 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:06.839229 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:06.839229 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:06.839229 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:06.839229 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:06.846026 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:06.846026 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:06.846026 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:06.846026 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:06.846026 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:06.846026 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:06.846026 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:06.846026 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:06.846026 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:06.846026 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:06.846026 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:06.846026 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:06.846026 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:06.846026 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:06.846026 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:06.846026 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:06.846986 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:06.846986 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:06.846986 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:06.846986 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:06.846986 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:06.846986 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:06.846986 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:06.846986 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:06.846986 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:06.846986 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:06.846986 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:02:06.846986 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:02:06.846986 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 61/112] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:02:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:02:06.851802 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3a5f0-4dec-415a-9bb1-5e3701b09b85 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:06.921505 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002aacf-be89-4da8-9b5b-fdd4f8654adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:06.922169 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002aacf-be89-4da8-9b5b-fdd4f8654adc None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:06.922448 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002aacf-be89-4da8-9b5b-fdd4f8654adc None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:06.922912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002aacf-be89-4da8-9b5b-fdd4f8654adc None admin] PATH_INFO: `/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:06.924211 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002aacf-be89-4da8-9b5b-fdd4f8654adc None admin] RBAC: Authorizing `identity:get_project(project_id=d3beaaf3de6a4ec9857978f70d555f6a)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:06.925793 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002aacf-be89-4da8-9b5b-fdd4f8654adc None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:06.927591 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 52/113] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:06 2022] GET /identity/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a => generated 298 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:06.934246 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002aacf-be89-4da8-9b5b-fdd4f8654adc None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:06.970171 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3a5f0-4dec-415a-9bb1-5e3701b09b85 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:07.019217 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2962d9ef-4bc4-4a26-b1c3-5ea910e415f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:07.020375 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962d9ef-4bc4-4a26-b1c3-5ea910e415f4 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:07.020729 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962d9ef-4bc4-4a26-b1c3-5ea910e415f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:07.021645 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2962d9ef-4bc4-4a26-b1c3-5ea910e415f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:07.022727 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2962d9ef-4bc4-4a26-b1c3-5ea910e415f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:07.023112 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2962d9ef-4bc4-4a26-b1c3-5ea910e415f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:07.025034 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2962d9ef-4bc4-4a26-b1c3-5ea910e415f4 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:07.038477 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 62/114] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:07.040173 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddb33f-8a07-4891-b6f7-5a1c29cb23f3 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:07.040444 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddb33f-8a07-4891-b6f7-5a1c29cb23f3 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:07.040621 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ddb33f-8a07-4891-b6f7-5a1c29cb23f3 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:07.042526 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 63/115] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:07.045178 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ddb33f-8a07-4891-b6f7-5a1c29cb23f3 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:07.071444 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:07.081806 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002aacf-be89-4da8-9b5b-fdd4f8654adc None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:07.104087 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:07.125614 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513f295-427c-4aea-8999-3c744b016544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:07.126225 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513f295-427c-4aea-8999-3c744b016544 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:07.126510 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513f295-427c-4aea-8999-3c744b016544 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:07.126788 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513f295-427c-4aea-8999-3c744b016544 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:07.127527 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513f295-427c-4aea-8999-3c744b016544 None admin] RBAC: Adding query filter params (role.id=c45e700ef009486aa6e596465c62a5f1, scope.project.id=d3beaaf3de6a4ec9857978f70d555f6a, user.id=c8345b59cd9043f3998e19d0ff7fccd8) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:07.127838 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513f295-427c-4aea-8999-3c744b016544 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:07.129377 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513f295-427c-4aea-8999-3c744b016544 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:07.135548 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 53/116] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:02:06 2022] GET /identity/v3/role_assignments?user.id=c8345b59cd9043f3998e19d0ff7fccd8&scope.project.id=d3beaaf3de6a4ec9857978f70d555f6a&role.id=c45e700ef009486aa6e596465c62a5f1 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:07.146733 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513f295-427c-4aea-8999-3c744b016544 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:07.181220 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ddb33f-8a07-4891-b6f7-5a1c29cb23f3 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:07.229858 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc020bd5-da4d-41a9-9a3e-ff803d0082ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:07.230810 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc020bd5-da4d-41a9-9a3e-ff803d0082ab None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:07.231253 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc020bd5-da4d-41a9-9a3e-ff803d0082ab None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:07.231717 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc020bd5-da4d-41a9-9a3e-ff803d0082ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:07.250627 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc020bd5-da4d-41a9-9a3e-ff803d0082ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:07.256241 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-cc020bd5-da4d-41a9-9a3e-ff803d0082ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:07.256241 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:07.256241 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:07.256241 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:07.256241 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:07.256241 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:07.256241 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:07.256241 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:07.256241 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:07.256241 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:07.256241 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:07.256241 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:07.256241 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:07.256241 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:07.256241 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:07.256241 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:07.257180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:07.257180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:07.257180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:07.257180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:07.257180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:07.257180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:07.257180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:07.257180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:07.257180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:07.257180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:07.257180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:07.257180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:07.257180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:07.257180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:07.257180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:07.257180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:07.257943 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:07.257943 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:07.257943 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:07.257943 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:07.257943 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:07.257943 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:07.257943 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:07.257943 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:07.257943 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:07.257943 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:07.257943 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:07.257943 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:02:07.260393 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 64/117] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:07.272950 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2030cb1-cc6b-4172-90c6-1e5a359918c7 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:07.273540 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2030cb1-cc6b-4172-90c6-1e5a359918c7 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:07.274017 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2030cb1-cc6b-4172-90c6-1e5a359918c7 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:07.276001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 65/118] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:07.277659 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dc001-df8e-4e8a-abe6-2b2ae8150a1f None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:07.278141 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dc001-df8e-4e8a-abe6-2b2ae8150a1f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:07.278637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dc001-df8e-4e8a-abe6-2b2ae8150a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:07.298210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513f295-427c-4aea-8999-3c744b016544 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:07.300523 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-aa3dc001-df8e-4e8a-abe6-2b2ae8150a1f None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:07.302302 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-aa3dc001-df8e-4e8a-abe6-2b2ae8150a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:07.360144 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22553c99-f0b8-4dc6-9937-b7f4d5276de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:07.363459 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22553c99-f0b8-4dc6-9937-b7f4d5276de7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:07.363740 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22553c99-f0b8-4dc6-9937-b7f4d5276de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:07.364016 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22553c99-f0b8-4dc6-9937-b7f4d5276de7 None admin] PATH_INFO: `/v3/users/9b67efb35ae049b5aa789d6ba0205b2e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:07.367331 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22553c99-f0b8-4dc6-9937-b7f4d5276de7 None admin] RBAC: Authorizing `identity:get_user(user_id=9b67efb35ae049b5aa789d6ba0205b2e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:07.368817 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22553c99-f0b8-4dc6-9937-b7f4d5276de7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:07.371759 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 54/119] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:02:07 2022] GET /identity/v3/users/9b67efb35ae049b5aa789d6ba0205b2e => generated 247 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:07.372388 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22553c99-f0b8-4dc6-9937-b7f4d5276de7 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:07.411285 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 66/120] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:07.413342 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680adc36-45a2-4c0d-a5e1-f735349b6149 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:07.413896 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680adc36-45a2-4c0d-a5e1-f735349b6149 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:07.414394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680adc36-45a2-4c0d-a5e1-f735349b6149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:07.433600 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-680adc36-45a2-4c0d-a5e1-f735349b6149 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:07.435164 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-680adc36-45a2-4c0d-a5e1-f735349b6149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:07.443659 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:07.452563 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:07.510413 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 67/121] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:07.517162 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680adc36-45a2-4c0d-a5e1-f735349b6149 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:07.543149 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22553c99-f0b8-4dc6-9937-b7f4d5276de7 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:07.587498 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1275e-6310-4e9e-bca8-76780af9ab19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:07.588172 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1275e-6310-4e9e-bca8-76780af9ab19 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:07.588461 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1275e-6310-4e9e-bca8-76780af9ab19 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:07.588796 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1275e-6310-4e9e-bca8-76780af9ab19 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:07.589500 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1275e-6310-4e9e-bca8-76780af9ab19 None admin] RBAC: Adding query filter params (name=member) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:07.589808 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1275e-6310-4e9e-bca8-76780af9ab19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:07.591270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1275e-6310-4e9e-bca8-76780af9ab19 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:07.599675 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 55/122] 10.222.0.81 () {56 vars in 1101 bytes} [Tue Sep 6 21:02:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:07.606411 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1275e-6310-4e9e-bca8-76780af9ab19 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:07.694780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680adc36-45a2-4c0d-a5e1-f735349b6149 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:07.757673 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32da71b-55c0-4084-acc1-9cdc7876650a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:07.758673 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32da71b-55c0-4084-acc1-9cdc7876650a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:07.759175 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32da71b-55c0-4084-acc1-9cdc7876650a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:07.760287 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32da71b-55c0-4084-acc1-9cdc7876650a None admin] PATH_INFO: `/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:07.764518 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32da71b-55c0-4084-acc1-9cdc7876650a None admin] RBAC: Authorizing `identity:get_project(project_id=d3beaaf3de6a4ec9857978f70d555f6a)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:07.766215 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32da71b-55c0-4084-acc1-9cdc7876650a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:07.768450 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 68/123] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:07 2022] GET /identity/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:07.774315 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32da71b-55c0-4084-acc1-9cdc7876650a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:07.790540 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1275e-6310-4e9e-bca8-76780af9ab19 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:07.795609 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:07.812612 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:07.842922 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c06397-7f07-4d6a-a314-e0c8ea53c72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:07.843582 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c06397-7f07-4d6a-a314-e0c8ea53c72b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:07.843873 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c06397-7f07-4d6a-a314-e0c8ea53c72b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:07.844251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c06397-7f07-4d6a-a314-e0c8ea53c72b None admin] PATH_INFO: `/v3/users/b318067cc95941c9b611879f7240b4ee` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:07.846272 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c06397-7f07-4d6a-a314-e0c8ea53c72b None admin] RBAC: Authorizing `identity:get_user(user_id=b318067cc95941c9b611879f7240b4ee)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:07.847743 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c06397-7f07-4d6a-a314-e0c8ea53c72b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:07.849709 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 56/124] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:02:07 2022] GET /identity/v3/users/b318067cc95941c9b611879f7240b4ee => generated 275 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:07.850519 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c06397-7f07-4d6a-a314-e0c8ea53c72b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:07.959299 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32da71b-55c0-4084-acc1-9cdc7876650a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:07.965729 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c06397-7f07-4d6a-a314-e0c8ea53c72b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:08.001057 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd543bc-305d-4819-a4a4-6185e757045e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:08.001714 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd543bc-305d-4819-a4a4-6185e757045e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:08.002004 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd543bc-305d-4819-a4a4-6185e757045e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:08.002287 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd543bc-305d-4819-a4a4-6185e757045e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:08.003692 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a878f64-c1b0-4a76-8b7e-fdf5eb68fc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:08.004773 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a878f64-c1b0-4a76-8b7e-fdf5eb68fc93 None admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:08.005060 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a878f64-c1b0-4a76-8b7e-fdf5eb68fc93 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:08.005391 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a878f64-c1b0-4a76-8b7e-fdf5eb68fc93 None admin] PATH_INFO: `/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a/users/9b67efb35ae049b5aa789d6ba0205b2e/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:08.007406 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a878f64-c1b0-4a76-8b7e-fdf5eb68fc93 None admin] RBAC: Authorizing `identity:create_grant(project_id=d3beaaf3de6a4ec9857978f70d555f6a, user_id=9b67efb35ae049b5aa789d6ba0205b2e, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:08.009098 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a878f64-c1b0-4a76-8b7e-fdf5eb68fc93 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:08.013901 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd543bc-305d-4819-a4a4-6185e757045e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:08.019315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-1dd543bc-305d-4819-a4a4-6185e757045e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:08.019315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:08.019315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:08.019315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:08.019315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:08.019315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:08.019315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:08.019315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:08.019315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:08.019315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:08.019315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:08.019315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:08.019315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:08.019315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:08.019315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:08.019315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:08.020216 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:08.020216 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:08.020216 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:08.020216 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:08.020216 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:08.020216 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:08.020216 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:08.020216 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:08.020216 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:08.020216 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:08.020216 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:08.020216 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:08.020216 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:08.020216 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:08.020216 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:08.020216 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:08.021375 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:08.021375 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:08.021375 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:08.021375 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:08.021375 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:08.021375 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:08.021375 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:08.021375 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:08.021375 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:08.021375 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:08.021375 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:08.021375 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:08.021375 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 57/125] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:08.021375 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd543bc-305d-4819-a4a4-6185e757045e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:08.068852 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:08.078597 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 69/126] 10.222.0.81 () {58 vars in 1439 bytes} [Tue Sep 6 21:02:07 2022] PUT /identity/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a/users/9b67efb35ae049b5aa789d6ba0205b2e/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:02:08.088281 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a878f64-c1b0-4a76-8b7e-fdf5eb68fc93 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:08.203208 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd543bc-305d-4819-a4a4-6185e757045e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:08.250392 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5781b7-e8d0-4f37-a73c-3af02587b277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:08.251052 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5781b7-e8d0-4f37-a73c-3af02587b277 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:08.251338 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5781b7-e8d0-4f37-a73c-3af02587b277 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:08.251617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5781b7-e8d0-4f37-a73c-3af02587b277 None admin] PATH_INFO: `/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:08.253948 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5781b7-e8d0-4f37-a73c-3af02587b277 None admin] RBAC: Authorizing `identity:get_project(project_id=d3beaaf3de6a4ec9857978f70d555f6a)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:08.255451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5781b7-e8d0-4f37-a73c-3af02587b277 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:08.257254 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 58/127] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:08 2022] GET /identity/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:08.258074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5781b7-e8d0-4f37-a73c-3af02587b277 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:08.268422 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:08.326742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a878f64-c1b0-4a76-8b7e-fdf5eb68fc93 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:08.374482 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946ff32-314b-4789-a095-f70d89f62746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:08.375415 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946ff32-314b-4789-a095-f70d89f62746 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:08.375869 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946ff32-314b-4789-a095-f70d89f62746 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:08.376420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946ff32-314b-4789-a095-f70d89f62746 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:08.393676 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946ff32-314b-4789-a095-f70d89f62746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:08.405602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-f946ff32-314b-4789-a095-f70d89f62746 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 21:02:08.405602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:08.405602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:08.405602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:08.405602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:08.405602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:08.405602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:08.405602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:08.405602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:08.405602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:08.405602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:08.405602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:08.405602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:08.405602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:08.405602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:08.405602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:08.406536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:08.406536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:08.406536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:08.406536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:08.406536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:08.406536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:08.406536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:08.406536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:08.406536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:08.406536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:08.406536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:08.406536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:08.406536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:08.406536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:08.406536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:08.406536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:08.407309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:08.407309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:08.407309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:08.407309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:08.407309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:08.407309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:08.407309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:08.407309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:08.407309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:08.407309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:08.407309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 21:02:08.407309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:02:08.408462 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 70/128] 10.222.0.81 () {56 vars in 1114 bytes} [Tue Sep 6 21:02:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:08.409369 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946ff32-314b-4789-a095-f70d89f62746 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:08.424632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5781b7-e8d0-4f37-a73c-3af02587b277 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:08.436083 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:08.469995 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570fe98-a94e-4f71-b0c6-7b860888bac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:08.470627 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570fe98-a94e-4f71-b0c6-7b860888bac3 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:08.470912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570fe98-a94e-4f71-b0c6-7b860888bac3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:08.471190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570fe98-a94e-4f71-b0c6-7b860888bac3 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:08.471891 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570fe98-a94e-4f71-b0c6-7b860888bac3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:08.472204 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570fe98-a94e-4f71-b0c6-7b860888bac3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:08.473592 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570fe98-a94e-4f71-b0c6-7b860888bac3 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:08.497610 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 59/129] 10.222.0.81 () {56 vars in 1101 bytes} [Tue Sep 6 21:02:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:08.498544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570fe98-a94e-4f71-b0c6-7b860888bac3 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:08.608565 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946ff32-314b-4789-a095-f70d89f62746 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:08.660707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:08.673817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faec3a2e-7499-4a64-96c3-7edaf24a8cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:08.674801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec3a2e-7499-4a64-96c3-7edaf24a8cc5 None admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:08.675249 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec3a2e-7499-4a64-96c3-7edaf24a8cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:08.681963 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faec3a2e-7499-4a64-96c3-7edaf24a8cc5 None admin] PATH_INFO: `/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a/users/b318067cc95941c9b611879f7240b4ee/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:08.683166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec3a2e-7499-4a64-96c3-7edaf24a8cc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=d3beaaf3de6a4ec9857978f70d555f6a, user_id=b318067cc95941c9b611879f7240b4ee, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:08.684880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faec3a2e-7499-4a64-96c3-7edaf24a8cc5 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:08.702782 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570fe98-a94e-4f71-b0c6-7b860888bac3 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:08.740344 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a775d5-bbae-49c5-81c0-79c3f9e6f290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:08.741308 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a775d5-bbae-49c5-81c0-79c3f9e6f290 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:08.741874 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a775d5-bbae-49c5-81c0-79c3f9e6f290 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:08.742158 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a775d5-bbae-49c5-81c0-79c3f9e6f290 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:08.742841 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a775d5-bbae-49c5-81c0-79c3f9e6f290 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:08.743149 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a775d5-bbae-49c5-81c0-79c3f9e6f290 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:08.744592 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a775d5-bbae-49c5-81c0-79c3f9e6f290 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:08.754959 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 60/130] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:02:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:08.756676 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a775d5-bbae-49c5-81c0-79c3f9e6f290 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:08.798884 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 71/131] 10.222.0.81 () {58 vars in 1439 bytes} [Tue Sep 6 21:02:08 2022] PUT /identity/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a/users/b318067cc95941c9b611879f7240b4ee/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:02:08.799405 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:08.801992 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57584a79-7f56-4518-b4e2-fa13f1210a4f None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:08.802576 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57584a79-7f56-4518-b4e2-fa13f1210a4f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:08.803053 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57584a79-7f56-4518-b4e2-fa13f1210a4f None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:08.805992 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 72/132] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:08.810959 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57584a79-7f56-4518-b4e2-fa13f1210a4f None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:08.894333 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a775d5-bbae-49c5-81c0-79c3f9e6f290 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:08.975221 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3602977-1c30-47c3-bb1d-b8a8f7017732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:08.976187 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3602977-1c30-47c3-bb1d-b8a8f7017732 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:08.976483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3602977-1c30-47c3-bb1d-b8a8f7017732 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:08.976765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3602977-1c30-47c3-bb1d-b8a8f7017732 None admin] PATH_INFO: `/v3/users/b318067cc95941c9b611879f7240b4ee` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:08.982234 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3602977-1c30-47c3-bb1d-b8a8f7017732 None admin] RBAC: Authorizing `identity:get_user(user_id=b318067cc95941c9b611879f7240b4ee)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:08.984130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3602977-1c30-47c3-bb1d-b8a8f7017732 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:08.985866 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 61/133] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:02:08 2022] GET /identity/v3/users/b318067cc95941c9b611879f7240b4ee => generated 275 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:08.992277 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa488ca7-4c36-48fe-880e-ea0c160353b9 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:08.992568 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa488ca7-4c36-48fe-880e-ea0c160353b9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:08.992843 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa488ca7-4c36-48fe-880e-ea0c160353b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:09.019780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57584a79-7f56-4518-b4e2-fa13f1210a4f None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:09.036406 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-aa488ca7-4c36-48fe-880e-ea0c160353b9 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:09.037828 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-aa488ca7-4c36-48fe-880e-ea0c160353b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:09.065806 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59524a-717f-4282-8bec-42259658a1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:09.066462 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59524a-717f-4282-8bec-42259658a1fd None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:09.066746 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59524a-717f-4282-8bec-42259658a1fd None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:09.067033 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e59524a-717f-4282-8bec-42259658a1fd None admin] PATH_INFO: `/v3/users/b318067cc95941c9b611879f7240b4ee` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:09.072893 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e59524a-717f-4282-8bec-42259658a1fd None admin] RBAC: Authorizing `identity:get_user(user_id=b318067cc95941c9b611879f7240b4ee)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:09.074441 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e59524a-717f-4282-8bec-42259658a1fd None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:09.076113 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 73/134] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:02:08 2022] GET /identity/v3/users/b318067cc95941c9b611879f7240b4ee => generated 275 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:09.077259 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59524a-717f-4282-8bec-42259658a1fd None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:09.112838 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 62/135] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:09.113774 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa488ca7-4c36-48fe-880e-ea0c160353b9 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:09.143412 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:09.147276 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:09.190642 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e59524a-717f-4282-8bec-42259658a1fd None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:09.225340 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa488ca7-4c36-48fe-880e-ea0c160353b9 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:09.275702 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1832a11-a6f6-4d98-8e6e-56969cc263f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:09.276561 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1832a11-a6f6-4d98-8e6e-56969cc263f6 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:09.276940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1832a11-a6f6-4d98-8e6e-56969cc263f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:09.277227 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1832a11-a6f6-4d98-8e6e-56969cc263f6 None admin] PATH_INFO: `/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:09.278374 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1832a11-a6f6-4d98-8e6e-56969cc263f6 None admin] RBAC: Authorizing `identity:get_project(project_id=d3beaaf3de6a4ec9857978f70d555f6a)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:09.279826 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1832a11-a6f6-4d98-8e6e-56969cc263f6 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:09.281698 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 63/136] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:09 2022] GET /identity/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:09.287366 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1832a11-a6f6-4d98-8e6e-56969cc263f6 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:09.290248 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad75bd-016a-40ef-aaf8-ae2a496338d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:09.291536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad75bd-016a-40ef-aaf8-ae2a496338d2 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:09.291829 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad75bd-016a-40ef-aaf8-ae2a496338d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:09.292131 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad75bd-016a-40ef-aaf8-ae2a496338d2 None admin] PATH_INFO: `/v3/projects/ed10cd8a9aeb4529b95b4f22bd6dbd3b` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:09.293560 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad75bd-016a-40ef-aaf8-ae2a496338d2 None admin] RBAC: Authorizing `identity:get_project(project_id=ed10cd8a9aeb4529b95b4f22bd6dbd3b)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:09.295006 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bad75bd-016a-40ef-aaf8-ae2a496338d2 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:09.296824 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 74/137] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:09 2022] GET /identity/v3/projects/ed10cd8a9aeb4529b95b4f22bd6dbd3b => generated 312 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:09.302307 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad75bd-016a-40ef-aaf8-ae2a496338d2 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:09.399765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1832a11-a6f6-4d98-8e6e-56969cc263f6 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:09.403741 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:09.438099 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f1199-1c20-4f11-b67d-c3baa9e4ff92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:09.438773 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f1199-1c20-4f11-b67d-c3baa9e4ff92 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:09.439062 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f1199-1c20-4f11-b67d-c3baa9e4ff92 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:09.439345 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f1199-1c20-4f11-b67d-c3baa9e4ff92 None admin] PATH_INFO: `/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a/users/b318067cc95941c9b611879f7240b4ee/roles/c1dd3aa5113d434ab8306e2453a5ba6a` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:09.441828 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f1199-1c20-4f11-b67d-c3baa9e4ff92 None admin] RBAC: Authorizing `identity:create_grant(project_id=d3beaaf3de6a4ec9857978f70d555f6a, user_id=b318067cc95941c9b611879f7240b4ee, role_id=c1dd3aa5113d434ab8306e2453a5ba6a)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:09.443298 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f1199-1c20-4f11-b67d-c3baa9e4ff92 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:09.498306 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad75bd-016a-40ef-aaf8-ae2a496338d2 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:09.524164 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 64/138] 10.222.0.81 () {58 vars in 1439 bytes} [Tue Sep 6 21:02:09 2022] PUT /identity/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a/users/b318067cc95941c9b611879f7240b4ee/roles/c1dd3aa5113d434ab8306e2453a5ba6a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:02:09.529057 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:09.537523 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ed5fa-987e-47ce-86ca-980c555fdaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:09.538935 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ed5fa-987e-47ce-86ca-980c555fdaea None admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:09.539431 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ed5fa-987e-47ce-86ca-980c555fdaea None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:09.539925 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ed5fa-987e-47ce-86ca-980c555fdaea None admin] PATH_INFO: `/v3/projects/ed10cd8a9aeb4529b95b4f22bd6dbd3b/users/b318067cc95941c9b611879f7240b4ee/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:09.543540 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ed5fa-987e-47ce-86ca-980c555fdaea None admin] RBAC: Authorizing `identity:create_grant(project_id=ed10cd8a9aeb4529b95b4f22bd6dbd3b, user_id=b318067cc95941c9b611879f7240b4ee, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:09.546309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ed5fa-987e-47ce-86ca-980c555fdaea None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:09.581554 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f1199-1c20-4f11-b67d-c3baa9e4ff92 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:09.634145 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 75/139] 10.222.0.81 () {58 vars in 1439 bytes} [Tue Sep 6 21:02:09 2022] PUT /identity/v3/projects/ed10cd8a9aeb4529b95b4f22bd6dbd3b/users/b318067cc95941c9b611879f7240b4ee/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:02:09.700291 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f1199-1c20-4f11-b67d-c3baa9e4ff92 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:09.739896 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b20f61-9448-4923-98bb-963b39a3b448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:09.740923 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b20f61-9448-4923-98bb-963b39a3b448 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:09.741369 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b20f61-9448-4923-98bb-963b39a3b448 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:09.741798 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b20f61-9448-4923-98bb-963b39a3b448 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:09.743321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b20f61-9448-4923-98bb-963b39a3b448 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:09.745115 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b20f61-9448-4923-98bb-963b39a3b448 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:09.747010 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 65/140] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:02:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:09.752890 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ed5fa-987e-47ce-86ca-980c555fdaea None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:09.761767 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd1d30-42dd-4232-854e-678bb8f68037 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:09.762299 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd1d30-42dd-4232-854e-678bb8f68037 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:09.762730 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd1d30-42dd-4232-854e-678bb8f68037 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:09.764351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 66/141] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:09.770164 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3128ac-aff4-426a-9f28-f60b845d571b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:09.770685 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3128ac-aff4-426a-9f28-f60b845d571b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:09.771115 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3128ac-aff4-426a-9f28-f60b845d571b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:09.809527 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-7d3128ac-aff4-426a-9f28-f60b845d571b None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:09.811485 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7d3128ac-aff4-426a-9f28-f60b845d571b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:09.840499 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:09.896070 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 67/142] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 21:02:09.945781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ed5fa-987e-47ce-86ca-980c555fdaea None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:09.995853 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf3a15-23ce-48ae-b9f3-5ce12d7173f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:09.996431 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf3a15-23ce-48ae-b9f3-5ce12d7173f3 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:09.996721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf3a15-23ce-48ae-b9f3-5ce12d7173f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:09.997001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf3a15-23ce-48ae-b9f3-5ce12d7173f3 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:09.997676 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf3a15-23ce-48ae-b9f3-5ce12d7173f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:09.999130 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf3a15-23ce-48ae-b9f3-5ce12d7173f3 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:10.107582 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 76/143] 10.222.0.81 () {60 vars in 1132 bytes} [Tue Sep 6 21:02:09 2022] POST /identity/v3/users => generated 283 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:02:10.215569 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3128ac-aff4-426a-9f28-f60b845d571b None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:10.355627 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3128ac-aff4-426a-9f28-f60b845d571b None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:10.392926 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b2f12-29b1-4808-9744-c28022a463da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:10.393581 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b2f12-29b1-4808-9744-c28022a463da None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:10.393869 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b2f12-29b1-4808-9744-c28022a463da None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:10.394148 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b2f12-29b1-4808-9744-c28022a463da None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:10.407656 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b2f12-29b1-4808-9744-c28022a463da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:10.412769 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-8f9b2f12-29b1-4808-9744-c28022a463da None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 21:02:10.412769 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:10.412769 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:10.412769 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:10.412769 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:10.412769 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:10.412769 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:10.412769 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:10.412769 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:10.412769 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:10.412769 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:10.412769 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:10.412769 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:10.412769 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:10.412769 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:10.412769 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:10.413888 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:10.413888 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:10.413888 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:10.413888 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:10.413888 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:10.413888 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:10.413888 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:10.413888 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:10.413888 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:10.413888 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:10.413888 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:10.413888 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:10.413888 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:10.413888 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:10.413888 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:10.413888 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:10.414638 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:10.414638 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:10.414638 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:10.414638 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:10.414638 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:10.414638 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:10.414638 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:10.414638 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:10.414638 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:10.414638 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:10.414638 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 21:02:10.414638 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:10.414638 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 68/144] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:10.420587 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf3a15-23ce-48ae-b9f3-5ce12d7173f3 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:10.477986 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:10.541931 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf3a15-23ce-48ae-b9f3-5ce12d7173f3 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:10.578191 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2abec-ef7c-4d7b-934f-8d72092f32d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:10.578818 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2abec-ef7c-4d7b-934f-8d72092f32d5 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:10.579102 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2abec-ef7c-4d7b-934f-8d72092f32d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:10.579381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2abec-ef7c-4d7b-934f-8d72092f32d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:10.580056 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2abec-ef7c-4d7b-934f-8d72092f32d5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:10.580385 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2abec-ef7c-4d7b-934f-8d72092f32d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:10.581904 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a2abec-ef7c-4d7b-934f-8d72092f32d5 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:10.593847 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 77/145] 10.222.0.81 () {56 vars in 1101 bytes} [Tue Sep 6 21:02:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:10.599142 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b2f12-29b1-4808-9744-c28022a463da None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:10.628516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:10.741103 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b2f12-29b1-4808-9744-c28022a463da None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:10.790734 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab4f50-aa50-4ac0-ad12-41970237b511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:10.792336 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab4f50-aa50-4ac0-ad12-41970237b511 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:10.792812 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab4f50-aa50-4ac0-ad12-41970237b511 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:10.793277 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab4f50-aa50-4ac0-ad12-41970237b511 None admin] PATH_INFO: `/v3/users/c8345b59cd9043f3998e19d0ff7fccd8` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:10.800940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab4f50-aa50-4ac0-ad12-41970237b511 None admin] RBAC: Authorizing `identity:get_user(user_id=c8345b59cd9043f3998e19d0ff7fccd8)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:10.803029 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ab4f50-aa50-4ac0-ad12-41970237b511 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:10.804947 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 69/146] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:02:10 2022] GET /identity/v3/users/c8345b59cd9043f3998e19d0ff7fccd8 => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:10.811022 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2abec-ef7c-4d7b-934f-8d72092f32d5 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:10.976041 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2abec-ef7c-4d7b-934f-8d72092f32d5 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:10.979548 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:11.021441 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30d141e-8438-4e70-923f-f74daaed2022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:11.022096 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d141e-8438-4e70-923f-f74daaed2022 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:11.022376 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d141e-8438-4e70-923f-f74daaed2022 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:11.022650 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30d141e-8438-4e70-923f-f74daaed2022 None admin] PATH_INFO: `/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:11.024913 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d141e-8438-4e70-923f-f74daaed2022 None admin] RBAC: Authorizing `identity:get_project(project_id=d3beaaf3de6a4ec9857978f70d555f6a)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:11.027252 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30d141e-8438-4e70-923f-f74daaed2022 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:11.029389 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 78/147] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:10 2022] GET /identity/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:11.035192 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab4f50-aa50-4ac0-ad12-41970237b511 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:11.158677 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:11.177747 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab4f50-aa50-4ac0-ad12-41970237b511 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:11.215619 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f66803-6f40-4a59-b79a-50dc4a1e6863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:11.216326 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f66803-6f40-4a59-b79a-50dc4a1e6863 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:11.216614 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f66803-6f40-4a59-b79a-50dc4a1e6863 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:11.216890 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f66803-6f40-4a59-b79a-50dc4a1e6863 None admin] PATH_INFO: `/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a/users/c8345b59cd9043f3998e19d0ff7fccd8/roles/c45e700ef009486aa6e596465c62a5f1` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:11.219722 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f66803-6f40-4a59-b79a-50dc4a1e6863 None admin] RBAC: Authorizing `identity:create_grant(project_id=d3beaaf3de6a4ec9857978f70d555f6a, user_id=c8345b59cd9043f3998e19d0ff7fccd8, role_id=c45e700ef009486aa6e596465c62a5f1)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:11.221204 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f66803-6f40-4a59-b79a-50dc4a1e6863 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:11.308973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 70/148] 10.222.0.81 () {58 vars in 1439 bytes} [Tue Sep 6 21:02:11 2022] PUT /identity/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a/users/c8345b59cd9043f3998e19d0ff7fccd8/roles/c45e700ef009486aa6e596465c62a5f1 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:02:11.630329 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462bdc6-719d-4e2b-8d14-b24f5d36a42e None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:11.630747 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462bdc6-719d-4e2b-8d14-b24f5d36a42e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:11.630926 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e462bdc6-719d-4e2b-8d14-b24f5d36a42e None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:11.632546 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 79/149] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:11.638448 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9de10-45dd-4a3d-978b-ddc22ca78e71 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:11.638732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9de10-45dd-4a3d-978b-ddc22ca78e71 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:11.639013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9de10-45dd-4a3d-978b-ddc22ca78e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:11.669171 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-90e9de10-45dd-4a3d-978b-ddc22ca78e71 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:11.670387 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-90e9de10-45dd-4a3d-978b-ddc22ca78e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:11.760464 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 71/150] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:11.906261 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d2813-a916-463a-b037-8a3b55eaeedf None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:11.906550 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d2813-a916-463a-b037-8a3b55eaeedf None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:11.906731 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d2813-a916-463a-b037-8a3b55eaeedf None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:11.908086 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 80/151] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:11.915031 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3aca8a-52ab-4a37-a111-32acf62bfb24 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:11.915315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3aca8a-52ab-4a37-a111-32acf62bfb24 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:11.915597 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3aca8a-52ab-4a37-a111-32acf62bfb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:11.938080 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-de3aca8a-52ab-4a37-a111-32acf62bfb24 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:11.939272 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-de3aca8a-52ab-4a37-a111-32acf62bfb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:12.026508 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 72/152] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:12.157770 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d2813-a916-463a-b037-8a3b55eaeedf None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:12.283994 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d2813-a916-463a-b037-8a3b55eaeedf None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:12.327644 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7ee27-3057-494b-bae7-126e310f84a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:12.328325 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7ee27-3057-494b-bae7-126e310f84a8 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:12.328602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7ee27-3057-494b-bae7-126e310f84a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:12.328877 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c7ee27-3057-494b-bae7-126e310f84a8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:12.345640 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c7ee27-3057-494b-bae7-126e310f84a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:12.351104 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-62c7ee27-3057-494b-bae7-126e310f84a8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:02:12.351104 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:12.351104 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:12.351104 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:12.351104 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:12.351104 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:12.351104 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:12.351104 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:12.351104 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:12.351104 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:12.351104 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:12.351104 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:12.351104 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:12.351104 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:12.351104 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:12.351104 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:12.352239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:12.352239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:12.352239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:12.352239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:12.352239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:12.352239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:12.352239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:12.352239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:12.352239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:12.352239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:12.352239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:12.352239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:12.352239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:12.352239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:12.352239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:12.352239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:12.354691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:12.354691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:12.354691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:12.354691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:12.354691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:12.354691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:12.354691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:12.354691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:12.354691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:12.354691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:12.354691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:02:12.354691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:02:12.354691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 81/153] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:02:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:12.358908 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3aca8a-52ab-4a37-a111-32acf62bfb24 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:12.367905 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:12.415478 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7ee27-3057-494b-bae7-126e310f84a8 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:12.509878 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:12.533502 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3aca8a-52ab-4a37-a111-32acf62bfb24 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:12.618264 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf6f85-10f6-4d9f-8f1b-d71d41001931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:12.618938 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf6f85-10f6-4d9f-8f1b-d71d41001931 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:12.619221 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf6f85-10f6-4d9f-8f1b-d71d41001931 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:12.619502 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf6f85-10f6-4d9f-8f1b-d71d41001931 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:12.625022 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf6f85-10f6-4d9f-8f1b-d71d41001931 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:12.625350 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf6f85-10f6-4d9f-8f1b-d71d41001931 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:12.626824 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbf6f85-10f6-4d9f-8f1b-d71d41001931 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:12.639353 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 73/154] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:12.644975 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf6f85-10f6-4d9f-8f1b-d71d41001931 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:12.728208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c7ee27-3057-494b-bae7-126e310f84a8 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:12.739319 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a670e9-cdb2-484c-9f76-8f520cbd39bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:12.740408 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a670e9-cdb2-484c-9f76-8f520cbd39bc None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:12.740918 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a670e9-cdb2-484c-9f76-8f520cbd39bc None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:12.741403 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a670e9-cdb2-484c-9f76-8f520cbd39bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:12.762315 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a670e9-cdb2-484c-9f76-8f520cbd39bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:12.767531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-49a670e9-cdb2-484c-9f76-8f520cbd39bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:12.767531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:12.767531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:12.767531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:12.767531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:12.767531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:12.767531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:12.767531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:12.767531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:12.767531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:12.767531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:12.767531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:12.767531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:12.767531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:12.767531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:12.767531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:12.768585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:12.768585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:12.768585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:12.768585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:12.768585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:12.768585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:12.768585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:12.768585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:12.768585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:12.768585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:12.768585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:12.768585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:12.768585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:12.768585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:12.768585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:12.768585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:12.769417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:12.769417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:12.769417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:12.769417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:12.769417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:12.769417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:12.769417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:12.769417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:12.769417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:12.769417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:12.769417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:12.769417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:02:12.771827 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 82/155] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:02:12.781144 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a670e9-cdb2-484c-9f76-8f520cbd39bc None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:12.802397 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:12.846904 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf6f85-10f6-4d9f-8f1b-d71d41001931 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:12.899723 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:12.904911 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ad316-f080-4a58-9c99-5abf34e17b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:12.905559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ad316-f080-4a58-9c99-5abf34e17b8e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:12.905849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ad316-f080-4a58-9c99-5abf34e17b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:12.906130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ad316-f080-4a58-9c99-5abf34e17b8e None admin] PATH_INFO: `/v3/users/9b67efb35ae049b5aa789d6ba0205b2e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:12.907338 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ad316-f080-4a58-9c99-5abf34e17b8e None admin] RBAC: Authorizing `identity:get_user(user_id=9b67efb35ae049b5aa789d6ba0205b2e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:12.908897 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ad316-f080-4a58-9c99-5abf34e17b8e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:12.910493 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 74/156] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:02:12 2022] GET /identity/v3/users/9b67efb35ae049b5aa789d6ba0205b2e => generated 247 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:12.912381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a670e9-cdb2-484c-9f76-8f520cbd39bc None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:12.916317 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ad316-f080-4a58-9c99-5abf34e17b8e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:12.971672 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada56df-c879-43b5-b3e3-1ccf5ae219f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:12.972730 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada56df-c879-43b5-b3e3-1ccf5ae219f7 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:12.973239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada56df-c879-43b5-b3e3-1ccf5ae219f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:12.973718 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada56df-c879-43b5-b3e3-1ccf5ae219f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:12.974614 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada56df-c879-43b5-b3e3-1ccf5ae219f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:12.975127 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada56df-c879-43b5-b3e3-1ccf5ae219f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:12.976807 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ada56df-c879-43b5-b3e3-1ccf5ae219f7 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:12.990606 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 83/157] 10.222.0.81 () {56 vars in 1101 bytes} [Tue Sep 6 21:02:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:12.997259 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada56df-c879-43b5-b3e3-1ccf5ae219f7 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:13.090259 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ad316-f080-4a58-9c99-5abf34e17b8e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:13.156932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada56df-c879-43b5-b3e3-1ccf5ae219f7 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:13.188123 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9806a79-83fe-44e0-983d-8970dd99b519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:13.188123 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9806a79-83fe-44e0-983d-8970dd99b519 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:13.188123 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9806a79-83fe-44e0-983d-8970dd99b519 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:13.188123 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9806a79-83fe-44e0-983d-8970dd99b519 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:13.196453 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:13.211347 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f438b-b88d-472d-bd39-142f55d92aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:13.213273 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f438b-b88d-472d-bd39-142f55d92aee None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:13.213787 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f438b-b88d-472d-bd39-142f55d92aee None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:13.214276 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f438b-b88d-472d-bd39-142f55d92aee None admin] PATH_INFO: `/v3/users/b318067cc95941c9b611879f7240b4ee` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:13.220916 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f438b-b88d-472d-bd39-142f55d92aee None admin] RBAC: Authorizing `identity:get_user(user_id=b318067cc95941c9b611879f7240b4ee)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:13.222820 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580f438b-b88d-472d-bd39-142f55d92aee None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:13.224781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 84/158] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:02:12 2022] GET /identity/v3/users/b318067cc95941c9b611879f7240b4ee => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:13.231442 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f438b-b88d-472d-bd39-142f55d92aee None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:13.269519 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:13.299718 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9806a79-83fe-44e0-983d-8970dd99b519 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:13.301231 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9806a79-83fe-44e0-983d-8970dd99b519 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:13.437345 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f438b-b88d-472d-bd39-142f55d92aee None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:13.445937 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 75/159] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:02:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 21:02:13.451197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9806a79-83fe-44e0-983d-8970dd99b519 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:13.504834 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b7c95-6d68-4c75-8a72-2b1b2c81ce9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:13.505463 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b7c95-6d68-4c75-8a72-2b1b2c81ce9a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:13.505742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b7c95-6d68-4c75-8a72-2b1b2c81ce9a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:13.506015 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b7c95-6d68-4c75-8a72-2b1b2c81ce9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:13.520998 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:13.630972 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9806a79-83fe-44e0-983d-8970dd99b519 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:13.681023 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab6f7a-619b-4018-9b3a-25a52439b394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:13.682233 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab6f7a-619b-4018-9b3a-25a52439b394 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:13.682509 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab6f7a-619b-4018-9b3a-25a52439b394 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:13.682782 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab6f7a-619b-4018-9b3a-25a52439b394 None admin] PATH_INFO: `/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:13.684079 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab6f7a-619b-4018-9b3a-25a52439b394 None admin] RBAC: Authorizing `identity:get_project(project_id=d3beaaf3de6a4ec9857978f70d555f6a)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:13.685639 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab6f7a-619b-4018-9b3a-25a52439b394 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:13.687772 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 76/160] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:13 2022] GET /identity/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:13.688944 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b7c95-6d68-4c75-8a72-2b1b2c81ce9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:13.690453 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b7c95-6d68-4c75-8a72-2b1b2c81ce9a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:13.700212 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab6f7a-619b-4018-9b3a-25a52439b394 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:13.747372 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:13.855226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab6f7a-619b-4018-9b3a-25a52439b394 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:13.870102 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:13.909004 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34824864-3ea5-4283-8bad-166d85c9cc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:13.909634 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34824864-3ea5-4283-8bad-166d85c9cc28 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:13.909912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34824864-3ea5-4283-8bad-166d85c9cc28 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:13.910182 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34824864-3ea5-4283-8bad-166d85c9cc28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:13.910992 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34824864-3ea5-4283-8bad-166d85c9cc28 None admin] RBAC: Adding query filter params (role.id=fe9661f095094dd0931e0b96a1d6ef74, scope.project.id=d3beaaf3de6a4ec9857978f70d555f6a, user.id=9b67efb35ae049b5aa789d6ba0205b2e) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:13.911298 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34824864-3ea5-4283-8bad-166d85c9cc28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:13.912770 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34824864-3ea5-4283-8bad-166d85c9cc28 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:13.924305 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 77/161] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:02:13 2022] GET /identity/v3/role_assignments?user.id=9b67efb35ae049b5aa789d6ba0205b2e&scope.project.id=d3beaaf3de6a4ec9857978f70d555f6a&role.id=fe9661f095094dd0931e0b96a1d6ef74 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:13.935333 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 85/162] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:02:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 704 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 21:02:13.941304 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34824864-3ea5-4283-8bad-166d85c9cc28 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:13.993016 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40d073-1fcf-41b5-9e50-561281f2db4a None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:13.993376 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40d073-1fcf-41b5-9e50-561281f2db4a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:13.993574 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40d073-1fcf-41b5-9e50-561281f2db4a None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:13.995633 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 86/163] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:02:14.001811 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884499b-165a-4df4-8842-2185cef37eb1 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:14.002160 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884499b-165a-4df4-8842-2185cef37eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:14.002345 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884499b-165a-4df4-8842-2185cef37eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:14.041690 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c884499b-165a-4df4-8842-2185cef37eb1 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:14.042932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c884499b-165a-4df4-8842-2185cef37eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:14.102100 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34824864-3ea5-4283-8bad-166d85c9cc28 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:14.163705 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446b6c7-1ec0-462a-a539-5a04b02817a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:14.164345 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446b6c7-1ec0-462a-a539-5a04b02817a0 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:14.164727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446b6c7-1ec0-462a-a539-5a04b02817a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:14.165003 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446b6c7-1ec0-462a-a539-5a04b02817a0 None admin] PATH_INFO: `/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:14.168908 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e446b6c7-1ec0-462a-a539-5a04b02817a0 None admin] RBAC: Authorizing `identity:get_project(project_id=d3beaaf3de6a4ec9857978f70d555f6a)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:14.170396 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e446b6c7-1ec0-462a-a539-5a04b02817a0 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:14.172154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 78/164] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:13 2022] GET /identity/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:14.179147 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446b6c7-1ec0-462a-a539-5a04b02817a0 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:14.230829 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:14.258525 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 87/165] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 21:02:14.260759 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d32068-e8cf-448e-b7dd-9f9a3e9efcce None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:14.261262 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d32068-e8cf-448e-b7dd-9f9a3e9efcce None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:14.261753 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d32068-e8cf-448e-b7dd-9f9a3e9efcce None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:14.263324 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 88/166] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:14.272874 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924b819-1455-4354-9f8d-da240c0ead8e None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:14.273487 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924b819-1455-4354-9f8d-da240c0ead8e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:14.273971 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924b819-1455-4354-9f8d-da240c0ead8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:14.311383 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-3924b819-1455-4354-9f8d-da240c0ead8e None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:14.312981 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-3924b819-1455-4354-9f8d-da240c0ead8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:14.383754 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:14.407647 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446b6c7-1ec0-462a-a539-5a04b02817a0 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:14.425077 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 89/167] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 21:02:14.484838 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7c07e-6907-4c20-a056-8964b6d88fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:14.485451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7c07e-6907-4c20-a056-8964b6d88fc7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:14.485735 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7c07e-6907-4c20-a056-8964b6d88fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:14.486010 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7c07e-6907-4c20-a056-8964b6d88fc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:14.486748 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7c07e-6907-4c20-a056-8964b6d88fc7 None admin] RBAC: Adding query filter params (role.id=be70fb8abf3148dda8e8e51be3a212e6, scope.project.id=d3beaaf3de6a4ec9857978f70d555f6a, user.id=b318067cc95941c9b611879f7240b4ee) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:14.487058 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7c07e-6907-4c20-a056-8964b6d88fc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:14.488540 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7c07e-6907-4c20-a056-8964b6d88fc7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:14.496161 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 79/168] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:02:14 2022] GET /identity/v3/role_assignments?user.id=b318067cc95941c9b611879f7240b4ee&scope.project.id=d3beaaf3de6a4ec9857978f70d555f6a&role.id=be70fb8abf3148dda8e8e51be3a212e6 => generated 608 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:14.862637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924b819-1455-4354-9f8d-da240c0ead8e None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:14.989065 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924b819-1455-4354-9f8d-da240c0ead8e None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:15.031905 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb44a4-87cd-46d0-8a86-4bcbea0a4dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:15.032641 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb44a4-87cd-46d0-8a86-4bcbea0a4dfb None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:15.032927 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb44a4-87cd-46d0-8a86-4bcbea0a4dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:15.033200 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb44a4-87cd-46d0-8a86-4bcbea0a4dfb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:15.049592 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb44a4-87cd-46d0-8a86-4bcbea0a4dfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:15.054701 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-e1cb44a4-87cd-46d0-8a86-4bcbea0a4dfb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 21:02:15.054701 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:15.054701 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:15.054701 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:15.054701 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:15.054701 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:15.054701 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:15.054701 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:15.054701 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:15.054701 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:15.054701 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:15.054701 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:15.054701 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:15.054701 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:15.054701 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:15.054701 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:15.055623 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:15.055623 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:15.055623 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:15.055623 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:15.055623 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:15.055623 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:15.055623 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:15.055623 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:15.055623 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:15.055623 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:15.055623 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:15.055623 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:15.055623 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:15.055623 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:15.055623 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:15.055623 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:15.057089 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:15.057089 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:15.057089 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:15.057089 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:15.057089 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:15.057089 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:15.057089 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:15.057089 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:15.057089 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:15.057089 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:15.057089 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 21:02:15.057089 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:02:15.057089 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 90/169] 10.222.0.81 () {56 vars in 1114 bytes} [Tue Sep 6 21:02:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:15.065243 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7c07e-6907-4c20-a056-8964b6d88fc7 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:15.070085 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb44a4-87cd-46d0-8a86-4bcbea0a4dfb None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:15.132980 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:15.230122 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:15.239579 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7c07e-6907-4c20-a056-8964b6d88fc7 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:15.284876 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71cb4d-a5e4-4e4e-91a9-40507d54ff86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:15.285513 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71cb4d-a5e4-4e4e-91a9-40507d54ff86 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:15.285800 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71cb4d-a5e4-4e4e-91a9-40507d54ff86 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:15.286077 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f71cb4d-a5e4-4e4e-91a9-40507d54ff86 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:15.286767 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f71cb4d-a5e4-4e4e-91a9-40507d54ff86 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:15.287071 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f71cb4d-a5e4-4e4e-91a9-40507d54ff86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:15.293008 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f71cb4d-a5e4-4e4e-91a9-40507d54ff86 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:15.302162 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb44a4-87cd-46d0-8a86-4bcbea0a4dfb None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:15.307165 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 80/170] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:02:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:15.317630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71cb4d-a5e4-4e4e-91a9-40507d54ff86 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:15.353874 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d0987-e8fe-4399-94d5-d6680933c98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:15.354600 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d0987-e8fe-4399-94d5-d6680933c98a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:15.354880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d0987-e8fe-4399-94d5-d6680933c98a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:15.355155 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d0987-e8fe-4399-94d5-d6680933c98a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:15.377704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d0987-e8fe-4399-94d5-d6680933c98a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:15.382649 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-2d9d0987-e8fe-4399-94d5-d6680933c98a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:15.382649 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:15.382649 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:15.382649 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:15.382649 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:15.382649 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:15.382649 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:15.382649 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:15.382649 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:15.382649 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:15.382649 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:15.382649 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:15.382649 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:15.382649 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:15.382649 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:15.382649 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:15.383581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:15.383581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:15.383581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:15.383581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:15.383581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:15.383581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:15.383581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:15.383581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:15.383581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:15.383581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:15.383581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:15.383581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:15.383581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:15.383581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:15.383581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:15.383581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:15.384562 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:15.384562 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:15.384562 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:15.384562 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:15.384562 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:15.384562 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:15.384562 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:15.384562 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:15.384562 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:15.384562 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:15.384562 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:15.384562 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:02:15.384562 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 91/171] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:02:15.390493 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d0987-e8fe-4399-94d5-d6680933c98a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:15.528852 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f71cb4d-a5e4-4e4e-91a9-40507d54ff86 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:15.562784 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d0987-e8fe-4399-94d5-d6680933c98a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:15.565174 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:15.609707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afb651-fcb4-4c72-bf2d-b61acfa5d343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:15.610489 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afb651-fcb4-4c72-bf2d-b61acfa5d343 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:15.610843 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afb651-fcb4-4c72-bf2d-b61acfa5d343 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:15.611212 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afb651-fcb4-4c72-bf2d-b61acfa5d343 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:15.612310 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afb651-fcb4-4c72-bf2d-b61acfa5d343 None admin] RBAC: Adding query filter params (name=member) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:15.612801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afb651-fcb4-4c72-bf2d-b61acfa5d343 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:15.614405 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afb651-fcb4-4c72-bf2d-b61acfa5d343 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:15.614512 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b675db4-0636-4d35-a1d5-dae9785644aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:15.615061 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b675db4-0636-4d35-a1d5-dae9785644aa None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:15.615350 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b675db4-0636-4d35-a1d5-dae9785644aa None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:15.615622 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b675db4-0636-4d35-a1d5-dae9785644aa None admin] PATH_INFO: `/v3/users/b318067cc95941c9b611879f7240b4ee` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:15.621097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b675db4-0636-4d35-a1d5-dae9785644aa None admin] RBAC: Authorizing `identity:get_user(user_id=b318067cc95941c9b611879f7240b4ee)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:15.622938 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b675db4-0636-4d35-a1d5-dae9785644aa None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:15.623951 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 92/172] 10.222.0.81 () {56 vars in 1101 bytes} [Tue Sep 6 21:02:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:15.624664 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 81/173] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:02:15 2022] GET /identity/v3/users/b318067cc95941c9b611879f7240b4ee => generated 275 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:15.625356 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c780e8-64e5-4e80-9ee5-ddafb3632058 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:15.625639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c780e8-64e5-4e80-9ee5-ddafb3632058 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:15.625911 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c780e8-64e5-4e80-9ee5-ddafb3632058 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:15.627393 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 93/174] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:15.633252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2acb3-69f8-4b29-8757-f88c9a1b6b43 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:15.633572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2acb3-69f8-4b29-8757-f88c9a1b6b43 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:15.633853 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f2acb3-69f8-4b29-8757-f88c9a1b6b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:15.637176 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c780e8-64e5-4e80-9ee5-ddafb3632058 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:15.665646 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-97f2acb3-69f8-4b29-8757-f88c9a1b6b43 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:15.666936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-97f2acb3-69f8-4b29-8757-f88c9a1b6b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:15.722905 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:15.787509 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 82/175] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:15.788730 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2acb3-69f8-4b29-8757-f88c9a1b6b43 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:15.821385 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c780e8-64e5-4e80-9ee5-ddafb3632058 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:15.898853 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9387159-f36d-437e-9b18-ac6954ed2e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:15.899723 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9387159-f36d-437e-9b18-ac6954ed2e92 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:15.900274 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9387159-f36d-437e-9b18-ac6954ed2e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:15.900746 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9387159-f36d-437e-9b18-ac6954ed2e92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:15.939487 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:15.986245 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9387159-f36d-437e-9b18-ac6954ed2e92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:15.987740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9387159-f36d-437e-9b18-ac6954ed2e92 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:15.994489 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f2acb3-69f8-4b29-8757-f88c9a1b6b43 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:16.041730 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4af3d-e0c1-4787-b923-96cb1416b2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:16.042632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4af3d-e0c1-4787-b923-96cb1416b2bf None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:16.043083 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4af3d-e0c1-4787-b923-96cb1416b2bf None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:16.043512 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4af3d-e0c1-4787-b923-96cb1416b2bf None admin] PATH_INFO: `/v3/users/b318067cc95941c9b611879f7240b4ee` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:16.045320 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4af3d-e0c1-4787-b923-96cb1416b2bf None admin] RBAC: Authorizing `identity:get_user(user_id=b318067cc95941c9b611879f7240b4ee)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:16.047411 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4af3d-e0c1-4787-b923-96cb1416b2bf None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:16.049848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 83/176] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:02:15 2022] GET /identity/v3/users/b318067cc95941c9b611879f7240b4ee => generated 275 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:16.051858 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b12e8-3b76-4513-9418-0e2409b30ca0 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:16.052622 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b12e8-3b76-4513-9418-0e2409b30ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:16.053053 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b12e8-3b76-4513-9418-0e2409b30ca0 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:16.055068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 84/177] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:16.056883 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5db7b2-6b91-42f7-aba9-e8c76f229fbe None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:16.057461 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5db7b2-6b91-42f7-aba9-e8c76f229fbe None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:16.057935 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5db7b2-6b91-42f7-aba9-e8c76f229fbe None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:16.059640 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 85/178] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:16.060929 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5db7b2-6b91-42f7-aba9-e8c76f229fbe None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:16.101556 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:16.101755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 94/179] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:02:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 21:02:16.103164 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228623b3-f537-46bb-be68-5d226d8d41e4 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:16.103465 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228623b3-f537-46bb-be68-5d226d8d41e4 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:16.103745 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228623b3-f537-46bb-be68-5d226d8d41e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:16.122394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-228623b3-f537-46bb-be68-5d226d8d41e4 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:16.123599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-228623b3-f537-46bb-be68-5d226d8d41e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:16.183605 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5db7b2-6b91-42f7-aba9-e8c76f229fbe None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:16.188722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:16.197564 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 95/180] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:16.201917 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34b040-eb35-4cec-b940-ae9c06501d61 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:16.201917 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34b040-eb35-4cec-b940-ae9c06501d61 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:16.201917 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34b040-eb35-4cec-b940-ae9c06501d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:16.219929 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a80fef-dd69-40fe-9aac-ec7aa8604f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:16.220573 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a80fef-dd69-40fe-9aac-ec7aa8604f0f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:16.220846 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a80fef-dd69-40fe-9aac-ec7aa8604f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:16.221141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a80fef-dd69-40fe-9aac-ec7aa8604f0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:16.229753 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-da34b040-eb35-4cec-b940-ae9c06501d61 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:16.230948 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-da34b040-eb35-4cec-b940-ae9c06501d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:16.306786 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a80fef-dd69-40fe-9aac-ec7aa8604f0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:16.308433 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a80fef-dd69-40fe-9aac-ec7aa8604f0f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:16.311623 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 96/181] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:16.313054 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d7bd4-8916-4b09-97ba-2ead7500b0f4 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:16.313343 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d7bd4-8916-4b09-97ba-2ead7500b0f4 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:16.313617 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d7bd4-8916-4b09-97ba-2ead7500b0f4 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:16.315023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 97/182] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:16.315675 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d7bd4-8916-4b09-97ba-2ead7500b0f4 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:16.354860 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:16.443686 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452d7bd4-8916-4b09-97ba-2ead7500b0f4 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:16.459397 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 86/183] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:02:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 21:02:16.460978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a80fef-dd69-40fe-9aac-ec7aa8604f0f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:16.483273 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:16.497866 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ef4faa-3fb7-4e6c-8114-426bb62b2ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:16.498620 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef4faa-3fb7-4e6c-8114-426bb62b2ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:16.499174 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef4faa-3fb7-4e6c-8114-426bb62b2ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:16.499327 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ef4faa-3fb7-4e6c-8114-426bb62b2ea6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:16.511058 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ef4faa-3fb7-4e6c-8114-426bb62b2ea6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:16.515980 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-d5ef4faa-3fb7-4e6c-8114-426bb62b2ea6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:02:16.515980 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:16.515980 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:16.515980 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:16.515980 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:16.515980 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:16.515980 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:16.515980 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:16.515980 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:16.515980 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:16.515980 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:16.515980 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:16.515980 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:16.515980 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:16.515980 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:16.515980 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:16.516928 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:16.516928 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:16.516928 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:16.516928 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:16.516928 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:16.516928 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:16.516928 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:16.516928 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:16.516928 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:16.516928 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:16.516928 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:16.516928 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:16.516928 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:16.516928 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:16.516928 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:16.516928 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:16.517826 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:16.517826 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:16.517826 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:16.517826 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:16.517826 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:16.517826 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:16.517826 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:16.517826 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:16.517826 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:16.517826 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:16.517826 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:02:16.517826 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:02:16.517826 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 98/184] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:02:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:16.519045 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f43677-05b0-4ac2-84f3-ec09ba2173de None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:16.519331 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f43677-05b0-4ac2-84f3-ec09ba2173de None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:16.519753 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f43677-05b0-4ac2-84f3-ec09ba2173de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:16.545427 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-a6f43677-05b0-4ac2-84f3-ec09ba2173de None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:16.546737 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a6f43677-05b0-4ac2-84f3-ec09ba2173de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:16.580639 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a80fef-dd69-40fe-9aac-ec7aa8604f0f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:16.607311 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:16.615504 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa9bde-2b17-4275-ada5-64a067c41e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:16.616174 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa9bde-2b17-4275-ada5-64a067c41e5e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:16.623839 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa9bde-2b17-4275-ada5-64a067c41e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:16.623839 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daa9bde-2b17-4275-ada5-64a067c41e5e None admin] PATH_INFO: `/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:16.623839 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa9bde-2b17-4275-ada5-64a067c41e5e None admin] RBAC: Authorizing `identity:get_project(project_id=d3beaaf3de6a4ec9857978f70d555f6a)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:16.623839 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daa9bde-2b17-4275-ada5-64a067c41e5e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:16.623839 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 87/185] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:16 2022] GET /identity/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:16.623839 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa9bde-2b17-4275-ada5-64a067c41e5e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:16.630105 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 99/186] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:16.630105 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f43677-05b0-4ac2-84f3-ec09ba2173de None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:16.739297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daa9bde-2b17-4275-ada5-64a067c41e5e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:16.742817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f43677-05b0-4ac2-84f3-ec09ba2173de None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:16.758227 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:16.775678 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a3757-b263-4541-8d5c-0a06fbfbfa29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:16.778754 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a3757-b263-4541-8d5c-0a06fbfbfa29 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:16.778754 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a3757-b263-4541-8d5c-0a06fbfbfa29 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:16.778754 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a3757-b263-4541-8d5c-0a06fbfbfa29 None admin] PATH_INFO: `/v3/projects/ed10cd8a9aeb4529b95b4f22bd6dbd3b` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:16.778754 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a3757-b263-4541-8d5c-0a06fbfbfa29 None admin] RBAC: Authorizing `identity:get_project(project_id=ed10cd8a9aeb4529b95b4f22bd6dbd3b)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:16.780222 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a3757-b263-4541-8d5c-0a06fbfbfa29 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:16.787068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 88/187] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:16 2022] GET /identity/v3/projects/ed10cd8a9aeb4529b95b4f22bd6dbd3b => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:16.787248 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e76141-2c16-4bae-8db4-78d0e6991c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:16.787356 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a3757-b263-4541-8d5c-0a06fbfbfa29 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:16.787444 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e76141-2c16-4bae-8db4-78d0e6991c75 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:16.787444 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e76141-2c16-4bae-8db4-78d0e6991c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:16.787444 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e76141-2c16-4bae-8db4-78d0e6991c75 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:16.788741 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e76141-2c16-4bae-8db4-78d0e6991c75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:16.790320 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e76141-2c16-4bae-8db4-78d0e6991c75 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:16.792157 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 100/188] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:02:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:16.792859 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e76141-2c16-4bae-8db4-78d0e6991c75 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:16.856905 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:16.900498 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a3757-b263-4541-8d5c-0a06fbfbfa29 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:16.912203 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e76141-2c16-4bae-8db4-78d0e6991c75 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:16.936705 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd4d26-52f7-4c14-b287-008f42d5a057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:16.937321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd4d26-52f7-4c14-b287-008f42d5a057 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:16.937603 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd4d26-52f7-4c14-b287-008f42d5a057 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:16.937879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd4d26-52f7-4c14-b287-008f42d5a057 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:16.938617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd4d26-52f7-4c14-b287-008f42d5a057 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:16.938932 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd4d26-52f7-4c14-b287-008f42d5a057 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:16.940334 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd4d26-52f7-4c14-b287-008f42d5a057 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:16.948723 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 89/189] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:16.949534 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd4d26-52f7-4c14-b287-008f42d5a057 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:16.949856 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb31ad-d8cc-4bc9-8d75-03eb7fb8161c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:16.950490 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb31ad-d8cc-4bc9-8d75-03eb7fb8161c None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:16.950769 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb31ad-d8cc-4bc9-8d75-03eb7fb8161c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:16.951043 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb31ad-d8cc-4bc9-8d75-03eb7fb8161c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:16.963246 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb31ad-d8cc-4bc9-8d75-03eb7fb8161c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:16.968606 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-61eb31ad-d8cc-4bc9-8d75-03eb7fb8161c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 21:02:16.968606 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:16.968606 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:16.968606 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:16.968606 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:16.968606 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:16.968606 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:16.968606 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:16.968606 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:16.968606 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:16.968606 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:16.968606 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:16.968606 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:16.968606 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:16.968606 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:16.968606 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:16.969645 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:16.969645 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:16.969645 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:16.969645 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:16.969645 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:16.969645 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:16.969645 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:16.969645 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:16.969645 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:16.969645 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:16.969645 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:16.969645 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:16.969645 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:16.969645 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:16.969645 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:16.969645 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:16.970452 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:16.970452 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:16.970452 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:16.970452 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:16.970452 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:16.970452 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:16.970452 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:16.970452 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:16.970452 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:16.970452 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:16.970452 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 21:02:16.970452 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:02:16.970452 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 101/190] 10.222.0.81 () {56 vars in 1114 bytes} [Tue Sep 6 21:02:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:16.971095 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb31ad-d8cc-4bc9-8d75-03eb7fb8161c None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:17.016314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:17.052176 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd4d26-52f7-4c14-b287-008f42d5a057 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:17.075808 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb31ad-d8cc-4bc9-8d75-03eb7fb8161c None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:17.076025 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:17.086455 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca3f78-3664-4fda-a03e-e36ffa758374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:17.087068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca3f78-3664-4fda-a03e-e36ffa758374 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:17.087728 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca3f78-3664-4fda-a03e-e36ffa758374 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:17.087728 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ca3f78-3664-4fda-a03e-e36ffa758374 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:17.088368 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca3f78-3664-4fda-a03e-e36ffa758374 None admin] RBAC: Adding query filter params (role.id=c1dd3aa5113d434ab8306e2453a5ba6a, scope.project.id=d3beaaf3de6a4ec9857978f70d555f6a, user.id=b318067cc95941c9b611879f7240b4ee) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:17.088675 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca3f78-3664-4fda-a03e-e36ffa758374 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:17.090115 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ca3f78-3664-4fda-a03e-e36ffa758374 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:17.108127 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 90/191] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:02:16 2022] GET /identity/v3/role_assignments?user.id=b318067cc95941c9b611879f7240b4ee&scope.project.id=d3beaaf3de6a4ec9857978f70d555f6a&role.id=c1dd3aa5113d434ab8306e2453a5ba6a => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:17.108127 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca3f78-3664-4fda-a03e-e36ffa758374 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:17.112934 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05961879-3dbf-4d73-a8cb-5c1920d0e521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:17.112934 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05961879-3dbf-4d73-a8cb-5c1920d0e521 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:17.112934 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05961879-3dbf-4d73-a8cb-5c1920d0e521 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:17.112934 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05961879-3dbf-4d73-a8cb-5c1920d0e521 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:17.121216 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05961879-3dbf-4d73-a8cb-5c1920d0e521 None admin] RBAC: Adding query filter params (role.id=be70fb8abf3148dda8e8e51be3a212e6, scope.project.id=ed10cd8a9aeb4529b95b4f22bd6dbd3b, user.id=b318067cc95941c9b611879f7240b4ee) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:17.121216 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05961879-3dbf-4d73-a8cb-5c1920d0e521 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:17.121216 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05961879-3dbf-4d73-a8cb-5c1920d0e521 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:17.126882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 102/192] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:02:16 2022] GET /identity/v3/role_assignments?user.id=b318067cc95941c9b611879f7240b4ee&scope.project.id=ed10cd8a9aeb4529b95b4f22bd6dbd3b&role.id=be70fb8abf3148dda8e8e51be3a212e6 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:17.127260 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05961879-3dbf-4d73-a8cb-5c1920d0e521 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:17.265451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ca3f78-3664-4fda-a03e-e36ffa758374 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:17.285257 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05961879-3dbf-4d73-a8cb-5c1920d0e521 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:17.300134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:17.318594 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b80a2-2357-4d1b-b60d-87b9556c3f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:17.319225 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b80a2-2357-4d1b-b60d-87b9556c3f19 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:17.319503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b80a2-2357-4d1b-b60d-87b9556c3f19 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:17.319776 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b80a2-2357-4d1b-b60d-87b9556c3f19 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:17.320507 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b80a2-2357-4d1b-b60d-87b9556c3f19 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:17.322060 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b80a2-2357-4d1b-b60d-87b9556c3f19 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:17.339045 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040996c-9909-4552-a4c6-bf121c82c76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:17.339735 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040996c-9909-4552-a4c6-bf121c82c76f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:17.340016 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040996c-9909-4552-a4c6-bf121c82c76f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:17.340395 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4040996c-9909-4552-a4c6-bf121c82c76f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:17.352086 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4040996c-9909-4552-a4c6-bf121c82c76f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:17.358301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-4040996c-9909-4552-a4c6-bf121c82c76f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 21:02:17.358301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:17.358301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:17.358301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:17.358301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:17.358301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:17.358301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:17.358301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:17.358301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:17.358301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:17.358301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:17.358301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:17.358301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:17.358301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:17.358301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:17.358301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:17.359238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:17.359238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:17.359238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:17.359238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:17.359238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:17.359238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:17.359238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:17.359238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:17.359238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:17.359238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:17.359238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:17.359238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:17.359238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:17.359238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:17.359238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:17.359238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:17.360740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:17.360740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:17.360740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:17.360740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:17.360740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:17.360740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:17.360740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:17.360740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:17.360740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:17.360740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:17.360740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 21:02:17.360740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:02:17.360740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 103/193] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:17.360740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040996c-9909-4552-a4c6-bf121c82c76f None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:17.447141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 91/194] 10.222.0.81 () {60 vars in 1132 bytes} [Tue Sep 6 21:02:17 2022] POST /identity/v3/users => generated 297 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:02:17.447992 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b80a2-2357-4d1b-b60d-87b9556c3f19 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:17.477160 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4040996c-9909-4552-a4c6-bf121c82c76f None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:17.510376 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:17.521367 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d239e1-efe5-4a93-a1b9-b9bb44046950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:17.522140 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d239e1-efe5-4a93-a1b9-b9bb44046950 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:17.522330 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d239e1-efe5-4a93-a1b9-b9bb44046950 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:17.522594 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d239e1-efe5-4a93-a1b9-b9bb44046950 None admin] PATH_INFO: `/v3/users/ec3c43c1a7f74067b81d329325fe4e2d` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:17.539250 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d239e1-efe5-4a93-a1b9-b9bb44046950 None admin] RBAC: Authorizing `identity:get_user(user_id=ec3c43c1a7f74067b81d329325fe4e2d)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:17.541271 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d239e1-efe5-4a93-a1b9-b9bb44046950 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:17.543162 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 104/195] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:02:17 2022] GET /identity/v3/users/ec3c43c1a7f74067b81d329325fe4e2d => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:17.543817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d239e1-efe5-4a93-a1b9-b9bb44046950 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:17.574973 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:17.585433 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b80a2-2357-4d1b-b60d-87b9556c3f19 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:17.629003 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b924181-cb83-4aba-bb2e-10dfca9c9545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:17.629631 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b924181-cb83-4aba-bb2e-10dfca9c9545 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:17.629914 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b924181-cb83-4aba-bb2e-10dfca9c9545 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:17.630219 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b924181-cb83-4aba-bb2e-10dfca9c9545 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:17.630898 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b924181-cb83-4aba-bb2e-10dfca9c9545 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:17.631208 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b924181-cb83-4aba-bb2e-10dfca9c9545 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:17.633080 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b924181-cb83-4aba-bb2e-10dfca9c9545 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:17.642841 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 92/196] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:02:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:17.643208 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b924181-cb83-4aba-bb2e-10dfca9c9545 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:17.671284 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d239e1-efe5-4a93-a1b9-b9bb44046950 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:17.713034 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9816dc-ba92-4ae8-a735-f5cef3d7a80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:17.713818 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9816dc-ba92-4ae8-a735-f5cef3d7a80f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:17.714232 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9816dc-ba92-4ae8-a735-f5cef3d7a80f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:17.714639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9816dc-ba92-4ae8-a735-f5cef3d7a80f None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:17.717953 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9816dc-ba92-4ae8-a735-f5cef3d7a80f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:17.717953 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9816dc-ba92-4ae8-a735-f5cef3d7a80f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:17.717953 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9816dc-ba92-4ae8-a735-f5cef3d7a80f None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:17.732401 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 105/197] 10.222.0.81 () {56 vars in 1101 bytes} [Tue Sep 6 21:02:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:17.734179 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9816dc-ba92-4ae8-a735-f5cef3d7a80f None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:17.785134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b924181-cb83-4aba-bb2e-10dfca9c9545 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:17.801522 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:17.833885 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb3c3c-197e-4095-aa98-c684674e6060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:17.837003 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb3c3c-197e-4095-aa98-c684674e6060 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:17.837003 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb3c3c-197e-4095-aa98-c684674e6060 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:17.837003 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edb3c3c-197e-4095-aa98-c684674e6060 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:17.855161 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:17.879427 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9816dc-ba92-4ae8-a735-f5cef3d7a80f None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:17.922655 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb3c3c-197e-4095-aa98-c684674e6060 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:17.924596 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edb3c3c-197e-4095-aa98-c684674e6060 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:17.932123 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4606cc9-7d99-46f1-871c-7d4ef5733418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:17.932123 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4606cc9-7d99-46f1-871c-7d4ef5733418 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:17.932123 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4606cc9-7d99-46f1-871c-7d4ef5733418 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:17.932123 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4606cc9-7d99-46f1-871c-7d4ef5733418 None admin] PATH_INFO: `/v3/users/ec3c43c1a7f74067b81d329325fe4e2d` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:17.935573 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4606cc9-7d99-46f1-871c-7d4ef5733418 None admin] RBAC: Authorizing `identity:get_user(user_id=ec3c43c1a7f74067b81d329325fe4e2d)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:17.935573 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4606cc9-7d99-46f1-871c-7d4ef5733418 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:17.937392 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 106/198] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:02:17 2022] GET /identity/v3/users/ec3c43c1a7f74067b81d329325fe4e2d => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:17.938015 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4606cc9-7d99-46f1-871c-7d4ef5733418 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:18.060811 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4606cc9-7d99-46f1-871c-7d4ef5733418 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:18.065447 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 93/199] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:02:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 21:02:18.071137 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb3c3c-197e-4095-aa98-c684674e6060 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:18.081087 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:18.113388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b23b18-db0e-4a9d-a886-32c5e6aadab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:18.114215 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b23b18-db0e-4a9d-a886-32c5e6aadab3 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:18.114396 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b23b18-db0e-4a9d-a886-32c5e6aadab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:18.114625 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b23b18-db0e-4a9d-a886-32c5e6aadab3 None admin] PATH_INFO: `/v3/users/c8345b59cd9043f3998e19d0ff7fccd8` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:18.116834 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b23b18-db0e-4a9d-a886-32c5e6aadab3 None admin] RBAC: Authorizing `identity:get_user(user_id=c8345b59cd9043f3998e19d0ff7fccd8)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:18.119134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b23b18-db0e-4a9d-a886-32c5e6aadab3 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:18.121650 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 107/200] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:02:17 2022] GET /identity/v3/users/c8345b59cd9043f3998e19d0ff7fccd8 => generated 289 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:18.122811 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b23b18-db0e-4a9d-a886-32c5e6aadab3 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:18.160852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:18.204919 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edb3c3c-197e-4095-aa98-c684674e6060 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:18.248562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c0dbb-2c9d-4eee-8365-18c70c3390a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:18.249931 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c0dbb-2c9d-4eee-8365-18c70c3390a7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:18.250313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c0dbb-2c9d-4eee-8365-18c70c3390a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:18.250736 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c0dbb-2c9d-4eee-8365-18c70c3390a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:18.264432 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b23b18-db0e-4a9d-a886-32c5e6aadab3 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:18.308857 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ae75e-bcde-4a85-a424-ac7fe7d93819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:18.309905 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ae75e-bcde-4a85-a424-ac7fe7d93819 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:18.310386 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ae75e-bcde-4a85-a424-ac7fe7d93819 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:18.310913 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ae75e-bcde-4a85-a424-ac7fe7d93819 None admin] PATH_INFO: `/v3/projects/b6011351cf9b462d964aff9e303a826d` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:18.312417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ae75e-bcde-4a85-a424-ac7fe7d93819 None admin] RBAC: Authorizing `identity:get_project(project_id=b6011351cf9b462d964aff9e303a826d)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:18.314170 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ae75e-bcde-4a85-a424-ac7fe7d93819 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:18.316472 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 108/201] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:18 2022] GET /identity/v3/projects/b6011351cf9b462d964aff9e303a826d => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:18.317594 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ae75e-bcde-4a85-a424-ac7fe7d93819 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:18.339079 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c0dbb-2c9d-4eee-8365-18c70c3390a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:18.340572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c0dbb-2c9d-4eee-8365-18c70c3390a7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:18.350131 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:18.415283 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:18.426534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ae75e-bcde-4a85-a424-ac7fe7d93819 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:18.456391 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 94/202] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:02:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 21:02:18.460364 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c0dbb-2c9d-4eee-8365-18c70c3390a7 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:18.468318 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b84da0-60ab-42ad-b65f-bab1f0ba12fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:18.470677 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b84da0-60ab-42ad-b65f-bab1f0ba12fb None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:18.471214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b84da0-60ab-42ad-b65f-bab1f0ba12fb None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:18.471999 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b84da0-60ab-42ad-b65f-bab1f0ba12fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:18.567311 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b84da0-60ab-42ad-b65f-bab1f0ba12fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:18.569281 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b84da0-60ab-42ad-b65f-bab1f0ba12fb None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:18.569771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c0dbb-2c9d-4eee-8365-18c70c3390a7 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:18.580496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:18.612201 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80e028-16c9-4eee-b3cc-d3051c4dd8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:18.612970 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80e028-16c9-4eee-b3cc-d3051c4dd8ac None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:18.613348 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80e028-16c9-4eee-b3cc-d3051c4dd8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:18.613743 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de80e028-16c9-4eee-b3cc-d3051c4dd8ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:18.614575 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80e028-16c9-4eee-b3cc-d3051c4dd8ac None admin] RBAC: Adding query filter params (role.id=fe9661f095094dd0931e0b96a1d6ef74, scope.project.id=b6011351cf9b462d964aff9e303a826d, user.id=ec3c43c1a7f74067b81d329325fe4e2d) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:18.614982 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80e028-16c9-4eee-b3cc-d3051c4dd8ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:18.616548 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de80e028-16c9-4eee-b3cc-d3051c4dd8ac None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:18.623677 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 95/203] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:02:18 2022] GET /identity/v3/role_assignments?user.id=ec3c43c1a7f74067b81d329325fe4e2d&scope.project.id=b6011351cf9b462d964aff9e303a826d&role.id=fe9661f095094dd0931e0b96a1d6ef74 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:18.624622 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80e028-16c9-4eee-b3cc-d3051c4dd8ac None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:18.683130 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:18.694564 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 109/204] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:02:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 21:02:18.703208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b84da0-60ab-42ad-b65f-bab1f0ba12fb None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:18.814167 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de80e028-16c9-4eee-b3cc-d3051c4dd8ac None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:18.841143 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b84da0-60ab-42ad-b65f-bab1f0ba12fb None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:18.874407 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1974cf5-f1b1-4d4f-be02-91b9dcb3f3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:18.875200 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1974cf5-f1b1-4d4f-be02-91b9dcb3f3d3 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:18.875484 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1974cf5-f1b1-4d4f-be02-91b9dcb3f3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:18.876667 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1974cf5-f1b1-4d4f-be02-91b9dcb3f3d3 None admin] PATH_INFO: `/v3/projects/b6011351cf9b462d964aff9e303a826d` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:18.877921 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1974cf5-f1b1-4d4f-be02-91b9dcb3f3d3 None admin] RBAC: Authorizing `identity:get_project(project_id=b6011351cf9b462d964aff9e303a826d)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:18.889075 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1974cf5-f1b1-4d4f-be02-91b9dcb3f3d3 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:18.889075 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 96/205] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:18 2022] GET /identity/v3/projects/b6011351cf9b462d964aff9e303a826d => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:18.889264 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34914065-877f-44c8-8e1f-6f7f8bea77e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:18.889264 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34914065-877f-44c8-8e1f-6f7f8bea77e5 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:18.889264 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34914065-877f-44c8-8e1f-6f7f8bea77e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:18.889264 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34914065-877f-44c8-8e1f-6f7f8bea77e5 None admin] PATH_INFO: `/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:18.889532 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1974cf5-f1b1-4d4f-be02-91b9dcb3f3d3 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:18.889599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34914065-877f-44c8-8e1f-6f7f8bea77e5 None admin] RBAC: Authorizing `identity:get_project(project_id=d3beaaf3de6a4ec9857978f70d555f6a)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:18.889599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34914065-877f-44c8-8e1f-6f7f8bea77e5 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:18.891092 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 110/206] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:18 2022] GET /identity/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:18.898529 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34914065-877f-44c8-8e1f-6f7f8bea77e5 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:18.955548 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:18.966792 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:19.011155 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34914065-877f-44c8-8e1f-6f7f8bea77e5 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:19.021535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1974cf5-f1b1-4d4f-be02-91b9dcb3f3d3 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:19.061258 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ae19a1-15ef-47bb-9fed-cb7a5fc08072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:19.061883 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae19a1-15ef-47bb-9fed-cb7a5fc08072 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:19.062166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae19a1-15ef-47bb-9fed-cb7a5fc08072 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:19.062446 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ae19a1-15ef-47bb-9fed-cb7a5fc08072 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:19.063182 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae19a1-15ef-47bb-9fed-cb7a5fc08072 None admin] RBAC: Adding query filter params (role.id=c45e700ef009486aa6e596465c62a5f1, scope.project.id=d3beaaf3de6a4ec9857978f70d555f6a, user.id=c8345b59cd9043f3998e19d0ff7fccd8) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:19.063493 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae19a1-15ef-47bb-9fed-cb7a5fc08072 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:19.065023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ae19a1-15ef-47bb-9fed-cb7a5fc08072 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:19.071525 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 111/207] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:02:18 2022] GET /identity/v3/role_assignments?user.id=c8345b59cd9043f3998e19d0ff7fccd8&scope.project.id=d3beaaf3de6a4ec9857978f70d555f6a&role.id=c45e700ef009486aa6e596465c62a5f1 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:19.080566 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaeeb8c-2237-4443-b70a-7c4b11599907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:19.081207 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaeeb8c-2237-4443-b70a-7c4b11599907 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:19.081502 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaeeb8c-2237-4443-b70a-7c4b11599907 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:19.081780 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaeeb8c-2237-4443-b70a-7c4b11599907 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:19.082543 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaeeb8c-2237-4443-b70a-7c4b11599907 None admin] RBAC: Adding query filter params (role.id=c1dd3aa5113d434ab8306e2453a5ba6a, scope.project.id=b6011351cf9b462d964aff9e303a826d, user.id=ec3c43c1a7f74067b81d329325fe4e2d) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:19.082857 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaeeb8c-2237-4443-b70a-7c4b11599907 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:19.084467 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaeeb8c-2237-4443-b70a-7c4b11599907 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:19.091913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 97/208] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:02:18 2022] GET /identity/v3/role_assignments?user.id=ec3c43c1a7f74067b81d329325fe4e2d&scope.project.id=b6011351cf9b462d964aff9e303a826d&role.id=c1dd3aa5113d434ab8306e2453a5ba6a => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:19.988658 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89195d25-17a6-47f6-92fc-c5bfa40db284 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:19.989184 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89195d25-17a6-47f6-92fc-c5bfa40db284 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:19.989184 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89195d25-17a6-47f6-92fc-c5bfa40db284 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:19.990579 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 112/209] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:19.996072 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c78884-cc3c-4d03-853f-52f570ad8f74 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:19.996530 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c78884-cc3c-4d03-853f-52f570ad8f74 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:19.996702 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c78884-cc3c-4d03-853f-52f570ad8f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:20.016146 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-44c78884-cc3c-4d03-853f-52f570ad8f74 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:20.017497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-44c78884-cc3c-4d03-853f-52f570ad8f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:20.018070 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d31d0-1e67-49ef-966c-1b4139bf0e42 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:20.018429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d31d0-1e67-49ef-966c-1b4139bf0e42 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:20.018777 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6d31d0-1e67-49ef-966c-1b4139bf0e42 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:20.021607 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 113/210] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:02:20.028030 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718614a6-1ba8-4eb4-af2f-9b1be2a8b3da None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:20.028866 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718614a6-1ba8-4eb4-af2f-9b1be2a8b3da None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:20.029229 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718614a6-1ba8-4eb4-af2f-9b1be2a8b3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:20.053589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-718614a6-1ba8-4eb4-af2f-9b1be2a8b3da None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:20.054995 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-718614a6-1ba8-4eb4-af2f-9b1be2a8b3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:20.097395 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 98/211] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 21:02:20.137038 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 114/212] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 21:02:20.374350 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c78884-cc3c-4d03-853f-52f570ad8f74 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:20.406277 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:20.424840 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718614a6-1ba8-4eb4-af2f-9b1be2a8b3da None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:20.481857 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c78884-cc3c-4d03-853f-52f570ad8f74 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:20.493185 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:20.520334 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc1e2c-791d-4e22-8f87-93e2d6c8b72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:20.521401 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc1e2c-791d-4e22-8f87-93e2d6c8b72f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:20.521686 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc1e2c-791d-4e22-8f87-93e2d6c8b72f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:20.521962 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc1e2c-791d-4e22-8f87-93e2d6c8b72f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:20.523493 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc1e2c-791d-4e22-8f87-93e2d6c8b72f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:20.525615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cc1e2c-791d-4e22-8f87-93e2d6c8b72f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:20.527976 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 99/213] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:02:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:20.533800 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc1e2c-791d-4e22-8f87-93e2d6c8b72f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:20.556991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718614a6-1ba8-4eb4-af2f-9b1be2a8b3da None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:20.600323 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d82eca-b2d4-4f6b-a465-e49db15a23af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:20.601504 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d82eca-b2d4-4f6b-a465-e49db15a23af None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:20.602133 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d82eca-b2d4-4f6b-a465-e49db15a23af None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:20.602680 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d82eca-b2d4-4f6b-a465-e49db15a23af None admin] PATH_INFO: `/v3/roles/member` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:20.616143 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d82eca-b2d4-4f6b-a465-e49db15a23af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:20.623439 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-39d82eca-b2d4-4f6b-a465-e49db15a23af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:20.623439 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:20.623439 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:20.623439 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:20.623439 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:20.623439 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:20.623439 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:20.623439 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:20.623439 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:20.623439 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:20.623439 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:20.623439 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:20.623439 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:20.623439 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:20.623439 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:20.623439 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:20.624479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:20.624479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:20.624479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:20.624479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:20.624479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:20.624479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:20.624479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:20.624479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:20.624479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:20.624479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:20.624479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:20.624479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:20.624479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:20.624479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:20.624479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:20.624479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:20.625300 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:20.625300 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:20.625300 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:20.625300 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:20.625300 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:20.625300 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:20.625300 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:20.625300 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:20.625300 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:20.625300 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:20.625300 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:20.625300 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:02:20.627476 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 115/214] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:20.633481 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d82eca-b2d4-4f6b-a465-e49db15a23af None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:20.660841 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:20.663830 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc1e2c-791d-4e22-8f87-93e2d6c8b72f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:20.702058 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5854f-cc1a-4338-8013-ffe40d2829f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:20.703266 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5854f-cc1a-4338-8013-ffe40d2829f3 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:20.703414 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5854f-cc1a-4338-8013-ffe40d2829f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:20.703983 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5854f-cc1a-4338-8013-ffe40d2829f3 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:20.704882 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba5854f-cc1a-4338-8013-ffe40d2829f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:20.706861 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba5854f-cc1a-4338-8013-ffe40d2829f3 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:20.748508 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d82eca-b2d4-4f6b-a465-e49db15a23af None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:20.763786 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:20.785985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cfc72-8bf5-4711-b089-6e1fbbe1c0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:20.786595 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cfc72-8bf5-4711-b089-6e1fbbe1c0e0 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:20.786923 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cfc72-8bf5-4711-b089-6e1fbbe1c0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:20.787194 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cfc72-8bf5-4711-b089-6e1fbbe1c0e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:20.787876 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585cfc72-8bf5-4711-b089-6e1fbbe1c0e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:20.788456 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585cfc72-8bf5-4711-b089-6e1fbbe1c0e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:20.789837 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585cfc72-8bf5-4711-b089-6e1fbbe1c0e0 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:20.798605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 116/215] 10.222.0.81 () {56 vars in 1101 bytes} [Tue Sep 6 21:02:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:20.805127 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cfc72-8bf5-4711-b089-6e1fbbe1c0e0 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:20.836201 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 100/216] 10.222.0.81 () {60 vars in 1132 bytes} [Tue Sep 6 21:02:20 2022] POST /identity/v3/users => generated 297 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:02:20.936565 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cfc72-8bf5-4711-b089-6e1fbbe1c0e0 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:20.976925 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf946f8-7133-4188-b12d-223a9d4d63d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:20.978500 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf946f8-7133-4188-b12d-223a9d4d63d0 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:20.978935 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf946f8-7133-4188-b12d-223a9d4d63d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:20.979357 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf946f8-7133-4188-b12d-223a9d4d63d0 None admin] PATH_INFO: `/v3/users/2cff5293cf8d4ba2bc42321ddad32f46` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:20.996632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf946f8-7133-4188-b12d-223a9d4d63d0 None admin] RBAC: Authorizing `identity:get_user(user_id=2cff5293cf8d4ba2bc42321ddad32f46)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:20.998976 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf946f8-7133-4188-b12d-223a9d4d63d0 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:21.001424 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 117/217] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:02:20 2022] GET /identity/v3/users/2cff5293cf8d4ba2bc42321ddad32f46 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:21.007298 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5854f-cc1a-4338-8013-ffe40d2829f3 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:21.121139 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5854f-cc1a-4338-8013-ffe40d2829f3 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:21.126623 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b110a-44fb-49bd-9775-c1f0e6ef71b7 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:21.126902 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b110a-44fb-49bd-9775-c1f0e6ef71b7 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:21.127183 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b110a-44fb-49bd-9775-c1f0e6ef71b7 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:21.128584 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 118/218] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:02:21.137803 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572e4b1-6dda-4097-9bb4-1484f16b76e5 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:21.137803 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572e4b1-6dda-4097-9bb4-1484f16b76e5 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:21.138031 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572e4b1-6dda-4097-9bb4-1484f16b76e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:21.165948 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-e572e4b1-6dda-4097-9bb4-1484f16b76e5 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:21.167162 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e572e4b1-6dda-4097-9bb4-1484f16b76e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:21.170054 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63741e7-2a5a-4e00-b054-3aadc953499b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:21.170888 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63741e7-2a5a-4e00-b054-3aadc953499b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:21.171367 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63741e7-2a5a-4e00-b054-3aadc953499b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:21.172780 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63741e7-2a5a-4e00-b054-3aadc953499b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:21.203345 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:21.211999 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:21.256989 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 119/219] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 21:02:21.260725 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63741e7-2a5a-4e00-b054-3aadc953499b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:21.262193 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63741e7-2a5a-4e00-b054-3aadc953499b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:21.373295 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 101/220] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:02:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 21:02:21.378564 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572e4b1-6dda-4097-9bb4-1484f16b76e5 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:21.488171 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17999ee-dbc8-4731-93c5-c4fa41c2bae7 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:21.488493 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17999ee-dbc8-4731-93c5-c4fa41c2bae7 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:21.488962 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17999ee-dbc8-4731-93c5-c4fa41c2bae7 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:21.490618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 102/221] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:21.496979 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cccec5-f188-4e6a-920c-b1ccb1188061 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:21.497332 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cccec5-f188-4e6a-920c-b1ccb1188061 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:21.497587 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cccec5-f188-4e6a-920c-b1ccb1188061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:21.517452 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572e4b1-6dda-4097-9bb4-1484f16b76e5 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:21.520853 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-b9cccec5-f188-4e6a-920c-b1ccb1188061 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:21.522074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b9cccec5-f188-4e6a-920c-b1ccb1188061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:21.574821 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e694420-4b75-461b-9b29-a37bb04ddd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:21.575469 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e694420-4b75-461b-9b29-a37bb04ddd93 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:21.575754 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e694420-4b75-461b-9b29-a37bb04ddd93 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:21.576028 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e694420-4b75-461b-9b29-a37bb04ddd93 None admin] PATH_INFO: `/v3/projects/b6011351cf9b462d964aff9e303a826d` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:21.577839 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e694420-4b75-461b-9b29-a37bb04ddd93 None admin] RBAC: Authorizing `identity:get_project(project_id=b6011351cf9b462d964aff9e303a826d)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:21.579533 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e694420-4b75-461b-9b29-a37bb04ddd93 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:21.583978 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 120/222] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:21 2022] GET /identity/v3/projects/b6011351cf9b462d964aff9e303a826d => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:21.586928 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e694420-4b75-461b-9b29-a37bb04ddd93 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:21.620918 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:21.637258 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:21.640602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 103/223] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 21:02:21.641288 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cccec5-f188-4e6a-920c-b1ccb1188061 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:21.730907 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e694420-4b75-461b-9b29-a37bb04ddd93 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:21.787654 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ade50-6229-4d4c-b65e-311546d136cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:21.789039 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ade50-6229-4d4c-b65e-311546d136cc None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:21.790401 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ade50-6229-4d4c-b65e-311546d136cc None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:21.790980 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ade50-6229-4d4c-b65e-311546d136cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:21.792043 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ade50-6229-4d4c-b65e-311546d136cc None admin] RBAC: Adding query filter params (role.id=be70fb8abf3148dda8e8e51be3a212e6, scope.project.id=b6011351cf9b462d964aff9e303a826d, user.id=2cff5293cf8d4ba2bc42321ddad32f46) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:21.793787 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ade50-6229-4d4c-b65e-311546d136cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:21.796949 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76ade50-6229-4d4c-b65e-311546d136cc None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:21.805854 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 121/224] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:02:21 2022] GET /identity/v3/role_assignments?user.id=2cff5293cf8d4ba2bc42321ddad32f46&scope.project.id=b6011351cf9b462d964aff9e303a826d&role.id=be70fb8abf3148dda8e8e51be3a212e6 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:21.821176 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cccec5-f188-4e6a-920c-b1ccb1188061 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:21.860817 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83558067-0dbd-401f-9c24-0ec83a2116d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:21.861845 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83558067-0dbd-401f-9c24-0ec83a2116d5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:21.862348 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83558067-0dbd-401f-9c24-0ec83a2116d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:21.862822 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83558067-0dbd-401f-9c24-0ec83a2116d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:21.875326 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83558067-0dbd-401f-9c24-0ec83a2116d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:21.880868 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-83558067-0dbd-401f-9c24-0ec83a2116d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:02:21.880868 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:21.880868 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:21.880868 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:21.880868 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:21.880868 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:21.880868 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:21.880868 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:21.880868 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:21.880868 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:21.880868 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:21.880868 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:21.880868 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:21.880868 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:21.880868 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:21.880868 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:21.881834 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:21.881834 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:21.881834 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:21.881834 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:21.881834 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:21.881834 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:21.881834 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:21.881834 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:21.881834 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:21.881834 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:21.881834 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:21.881834 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:21.881834 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:21.881834 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:21.881834 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:21.881834 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:21.882648 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:21.882648 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:21.882648 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:21.882648 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:21.882648 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:21.882648 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:21.882648 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:21.882648 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:21.882648 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:21.882648 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:21.882648 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:02:21.882648 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:21.885794 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 104/225] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:02:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:21.900382 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ade50-6229-4d4c-b65e-311546d136cc None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:21.928688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83558067-0dbd-401f-9c24-0ec83a2116d5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:22.020552 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:22.077488 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:22.085617 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76ade50-6229-4d4c-b65e-311546d136cc None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:22.128717 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83558067-0dbd-401f-9c24-0ec83a2116d5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:22.154325 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0fe5c-c28c-4acf-b1f3-fe86ac29f1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:22.154873 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0fe5c-c28c-4acf-b1f3-fe86ac29f1d8 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:22.155153 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0fe5c-c28c-4acf-b1f3-fe86ac29f1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:22.155455 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0fe5c-c28c-4acf-b1f3-fe86ac29f1d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:22.156144 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a0fe5c-c28c-4acf-b1f3-fe86ac29f1d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:22.156459 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a0fe5c-c28c-4acf-b1f3-fe86ac29f1d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:22.157854 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a0fe5c-c28c-4acf-b1f3-fe86ac29f1d8 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:22.178450 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 122/226] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:22.184329 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0fe5c-c28c-4acf-b1f3-fe86ac29f1d8 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:22.201671 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7e152-9881-486d-9e1d-8a40879d9df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:22.203791 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7e152-9881-486d-9e1d-8a40879d9df1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:22.204078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7e152-9881-486d-9e1d-8a40879d9df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:22.204375 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc7e152-9881-486d-9e1d-8a40879d9df1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:22.225843 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc7e152-9881-486d-9e1d-8a40879d9df1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:22.231397 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-ffc7e152-9881-486d-9e1d-8a40879d9df1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 21:02:22.231397 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:22.231397 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:22.231397 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:22.231397 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:22.231397 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:22.231397 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:22.231397 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:22.231397 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:22.231397 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:22.231397 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:22.231397 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:22.231397 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:22.231397 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:22.231397 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:22.231397 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:22.232319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:22.232319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:22.232319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:22.232319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:22.232319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:22.232319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:22.232319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:22.232319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:22.232319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:22.232319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:22.232319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:22.232319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:22.232319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:22.232319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:22.232319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:22.232319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:22.233152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:22.233152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:22.233152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:22.233152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:22.233152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:22.233152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:22.233152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:22.233152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:22.233152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:22.233152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:22.233152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 21:02:22.233152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:22.233152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 105/227] 10.222.0.81 () {56 vars in 1114 bytes} [Tue Sep 6 21:02:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:02:22.244664 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7e152-9881-486d-9e1d-8a40879d9df1 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:22.334758 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0fe5c-c28c-4acf-b1f3-fe86ac29f1d8 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:22.370309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004bb18-2ed1-4799-a26f-912c9184faec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:22.371474 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004bb18-2ed1-4799-a26f-912c9184faec None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:22.371955 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004bb18-2ed1-4799-a26f-912c9184faec None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:22.372493 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004bb18-2ed1-4799-a26f-912c9184faec None admin] PATH_INFO: `/v3/users/ec3c43c1a7f74067b81d329325fe4e2d` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:22.374078 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004bb18-2ed1-4799-a26f-912c9184faec None admin] RBAC: Authorizing `identity:get_user(user_id=ec3c43c1a7f74067b81d329325fe4e2d)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:22.375831 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004bb18-2ed1-4799-a26f-912c9184faec None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:22.382184 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 123/228] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:02:22 2022] GET /identity/v3/users/ec3c43c1a7f74067b81d329325fe4e2d => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:22.383576 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004bb18-2ed1-4799-a26f-912c9184faec None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:22.436586 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:22.477528 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc7e152-9881-486d-9e1d-8a40879d9df1 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:22.490390 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:22.504300 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004bb18-2ed1-4799-a26f-912c9184faec None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:22.533574 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ea51b-d93a-4c51-a771-5d3b6a140eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:22.534539 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ea51b-d93a-4c51-a771-5d3b6a140eeb None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:22.535544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ea51b-d93a-4c51-a771-5d3b6a140eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:22.536083 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ea51b-d93a-4c51-a771-5d3b6a140eeb None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:22.537166 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ea51b-d93a-4c51-a771-5d3b6a140eeb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:22.537694 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ea51b-d93a-4c51-a771-5d3b6a140eeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:22.539527 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ea51b-d93a-4c51-a771-5d3b6a140eeb None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:22.549738 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 106/229] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:02:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:22.561171 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ea51b-d93a-4c51-a771-5d3b6a140eeb None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:22.583760 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536b5e7-e7d7-4298-a4e1-a0cc674b58c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:22.585515 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536b5e7-e7d7-4298-a4e1-a0cc674b58c1 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:22.585794 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536b5e7-e7d7-4298-a4e1-a0cc674b58c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:22.586069 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536b5e7-e7d7-4298-a4e1-a0cc674b58c1 None admin] PATH_INFO: `/v3/projects/b6011351cf9b462d964aff9e303a826d` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:22.589265 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7536b5e7-e7d7-4298-a4e1-a0cc674b58c1 None admin] RBAC: Authorizing `identity:get_project(project_id=b6011351cf9b462d964aff9e303a826d)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:22.593571 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7536b5e7-e7d7-4298-a4e1-a0cc674b58c1 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:22.600145 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 124/230] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:22 2022] GET /identity/v3/projects/b6011351cf9b462d964aff9e303a826d => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:22.606454 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536b5e7-e7d7-4298-a4e1-a0cc674b58c1 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:22.745863 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ea51b-d93a-4c51-a771-5d3b6a140eeb None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:22.766802 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:22.785033 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536b5e7-e7d7-4298-a4e1-a0cc674b58c1 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:22.821355 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53762143-c1c0-4ed6-8beb-ad646eb61d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:22.822029 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53762143-c1c0-4ed6-8beb-ad646eb61d2f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:22.822309 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53762143-c1c0-4ed6-8beb-ad646eb61d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:22.822582 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53762143-c1c0-4ed6-8beb-ad646eb61d2f None admin] PATH_INFO: `/v3/users/ec3c43c1a7f74067b81d329325fe4e2d` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:22.824356 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53762143-c1c0-4ed6-8beb-ad646eb61d2f None admin] RBAC: Authorizing `identity:get_user(user_id=ec3c43c1a7f74067b81d329325fe4e2d)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:22.825804 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53762143-c1c0-4ed6-8beb-ad646eb61d2f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:22.833576 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 107/231] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:02:22 2022] GET /identity/v3/users/ec3c43c1a7f74067b81d329325fe4e2d => generated 283 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:22.834788 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53762143-c1c0-4ed6-8beb-ad646eb61d2f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:22.844621 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0400587-f0da-4ca2-a68f-b810cf83d9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:22.845531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0400587-f0da-4ca2-a68f-b810cf83d9ef None admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:22.845964 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0400587-f0da-4ca2-a68f-b810cf83d9ef None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:22.846387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0400587-f0da-4ca2-a68f-b810cf83d9ef None admin] PATH_INFO: `/v3/projects/b6011351cf9b462d964aff9e303a826d/users/ec3c43c1a7f74067b81d329325fe4e2d/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:22.852364 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0400587-f0da-4ca2-a68f-b810cf83d9ef None admin] RBAC: Authorizing `identity:create_grant(project_id=b6011351cf9b462d964aff9e303a826d, user_id=ec3c43c1a7f74067b81d329325fe4e2d, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:22.854651 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0400587-f0da-4ca2-a68f-b810cf83d9ef None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:22.873310 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:22.938445 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 125/232] 10.222.0.81 () {58 vars in 1439 bytes} [Tue Sep 6 21:02:22 2022] PUT /identity/v3/projects/b6011351cf9b462d964aff9e303a826d/users/ec3c43c1a7f74067b81d329325fe4e2d/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:02:22.949058 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53762143-c1c0-4ed6-8beb-ad646eb61d2f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:23.017066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e236de-afe5-4286-b3b6-c861a9548a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:23.017656 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e236de-afe5-4286-b3b6-c861a9548a88 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:23.017940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e236de-afe5-4286-b3b6-c861a9548a88 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:23.018215 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e236de-afe5-4286-b3b6-c861a9548a88 None admin] PATH_INFO: `/v3/projects/b6011351cf9b462d964aff9e303a826d` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:23.019506 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e236de-afe5-4286-b3b6-c861a9548a88 None admin] RBAC: Authorizing `identity:get_project(project_id=b6011351cf9b462d964aff9e303a826d)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:23.020983 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e236de-afe5-4286-b3b6-c861a9548a88 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:23.022958 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 108/233] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:22 2022] GET /identity/v3/projects/b6011351cf9b462d964aff9e303a826d => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:23.029497 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0400587-f0da-4ca2-a68f-b810cf83d9ef None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:23.215834 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0400587-f0da-4ca2-a68f-b810cf83d9ef None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:23.251373 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ba1b5-8f66-4886-b03f-0bc12c153932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:23.252051 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ba1b5-8f66-4886-b03f-0bc12c153932 None admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:23.252359 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ba1b5-8f66-4886-b03f-0bc12c153932 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:23.252633 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ba1b5-8f66-4886-b03f-0bc12c153932 None admin] PATH_INFO: `/v3/projects/b6011351cf9b462d964aff9e303a826d/users/ec3c43c1a7f74067b81d329325fe4e2d/roles/c1dd3aa5113d434ab8306e2453a5ba6a` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:23.254829 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ba1b5-8f66-4886-b03f-0bc12c153932 None admin] RBAC: Authorizing `identity:create_grant(project_id=b6011351cf9b462d964aff9e303a826d, user_id=ec3c43c1a7f74067b81d329325fe4e2d, role_id=c1dd3aa5113d434ab8306e2453a5ba6a)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:23.256320 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ba1b5-8f66-4886-b03f-0bc12c153932 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:23.373959 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 126/234] 10.222.0.81 () {58 vars in 1439 bytes} [Tue Sep 6 21:02:23 2022] PUT /identity/v3/projects/b6011351cf9b462d964aff9e303a826d/users/ec3c43c1a7f74067b81d329325fe4e2d/roles/c1dd3aa5113d434ab8306e2453a5ba6a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:02:23.555022 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52b238-f6c5-430a-9013-2f0d914ff80a None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:23.555301 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52b238-f6c5-430a-9013-2f0d914ff80a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:23.555580 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52b238-f6c5-430a-9013-2f0d914ff80a None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:23.557237 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 109/235] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:23.562806 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85eabe5-5f42-4265-85de-9e7217b099b5 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:23.563091 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85eabe5-5f42-4265-85de-9e7217b099b5 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:23.563363 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85eabe5-5f42-4265-85de-9e7217b099b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:23.593291 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-d85eabe5-5f42-4265-85de-9e7217b099b5 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:23.594520 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d85eabe5-5f42-4265-85de-9e7217b099b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:23.605707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:23.682780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 127/236] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:23.963857 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427165ac-1579-4616-aded-000a443e33db None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:23.964029 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427165ac-1579-4616-aded-000a443e33db None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:23.964333 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427165ac-1579-4616-aded-000a443e33db None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:23.965925 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 110/237] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:23.971439 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22797d56-4317-4b15-b467-817e4df8dabd None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:23.971730 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22797d56-4317-4b15-b467-817e4df8dabd None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:23.972000 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22797d56-4317-4b15-b467-817e4df8dabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:23.997123 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-22797d56-4317-4b15-b467-817e4df8dabd None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:23.998323 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-22797d56-4317-4b15-b467-817e4df8dabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:24.017729 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427165ac-1579-4616-aded-000a443e33db None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:24.084942 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 128/238] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 21:02:24.171559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427165ac-1579-4616-aded-000a443e33db None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:24.173986 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:24.207195 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0eeb9-3d81-4aa7-998e-698cc55a3c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:24.207832 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0eeb9-3d81-4aa7-998e-698cc55a3c9a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:24.208122 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0eeb9-3d81-4aa7-998e-698cc55a3c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:24.208447 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0eeb9-3d81-4aa7-998e-698cc55a3c9a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:24.210184 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0eeb9-3d81-4aa7-998e-698cc55a3c9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:24.211652 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0eeb9-3d81-4aa7-998e-698cc55a3c9a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:24.213596 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 111/239] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:02:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:24.219089 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22797d56-4317-4b15-b467-817e4df8dabd None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:24.313040 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:24.344694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22797d56-4317-4b15-b467-817e4df8dabd None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:24.390096 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40b267-85a6-4a05-8d21-b61236d92687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:24.390713 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40b267-85a6-4a05-8d21-b61236d92687 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:24.390990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40b267-85a6-4a05-8d21-b61236d92687 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:24.391260 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40b267-85a6-4a05-8d21-b61236d92687 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:24.391926 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40b267-85a6-4a05-8d21-b61236d92687 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:24.393391 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40b267-85a6-4a05-8d21-b61236d92687 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:24.476144 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0eeb9-3d81-4aa7-998e-698cc55a3c9a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:24.498799 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 129/240] 10.222.0.81 () {60 vars in 1132 bytes} [Tue Sep 6 21:02:24 2022] POST /identity/v3/users => generated 293 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:02:24.534467 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201d73b-8d42-432f-acd6-d06f67daf23f None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:24.534776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201d73b-8d42-432f-acd6-d06f67daf23f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:24.535020 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201d73b-8d42-432f-acd6-d06f67daf23f None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:24.536783 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 130/241] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:02:24.543664 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f6e71-b5b1-4e0c-aa54-be77edbe9164 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:24.544071 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f6e71-b5b1-4e0c-aa54-be77edbe9164 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:24.544464 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f6e71-b5b1-4e0c-aa54-be77edbe9164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:24.568669 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f97f6e71-b5b1-4e0c-aa54-be77edbe9164 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:24.570699 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f97f6e71-b5b1-4e0c-aa54-be77edbe9164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:24.673392 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0eeb9-3d81-4aa7-998e-698cc55a3c9a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:24.713307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607c0e9-ef36-4bf4-a3b7-f3389e4d0b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:24.714028 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607c0e9-ef36-4bf4-a3b7-f3389e4d0b14 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:24.714302 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607c0e9-ef36-4bf4-a3b7-f3389e4d0b14 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:24.714558 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607c0e9-ef36-4bf4-a3b7-f3389e4d0b14 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:24.726801 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607c0e9-ef36-4bf4-a3b7-f3389e4d0b14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:24.732229 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-a607c0e9-ef36-4bf4-a3b7-f3389e4d0b14 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 21:02:24.732229 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:24.732229 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:24.732229 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:24.732229 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:24.732229 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:24.732229 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:24.732229 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:24.732229 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:24.732229 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:24.732229 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:24.732229 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:24.732229 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:24.732229 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:24.732229 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:24.732229 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:24.733126 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:24.733126 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:24.733126 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:24.733126 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:24.733126 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:24.733126 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:24.733126 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:24.733126 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:24.733126 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:24.733126 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:24.733126 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:24.733126 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:24.733126 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:24.733126 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:24.733126 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:24.733126 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:24.733949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:24.733949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:24.733949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:24.733949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:24.733949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:24.733949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:24.733949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:24.733949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:24.733949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:24.733949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:24.733949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 21:02:24.733949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:24.733949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 112/242] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:02:24.738432 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 131/243] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:24.739354 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607c0e9-ef36-4bf4-a3b7-f3389e4d0b14 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:24.774154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:24.846202 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607c0e9-ef36-4bf4-a3b7-f3389e4d0b14 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:24.883144 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780883e-f436-4554-8b0f-e34795f23b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:24.883813 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780883e-f436-4554-8b0f-e34795f23b19 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:24.884186 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780883e-f436-4554-8b0f-e34795f23b19 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:24.884463 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1780883e-f436-4554-8b0f-e34795f23b19 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:24.885128 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780883e-f436-4554-8b0f-e34795f23b19 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:24.885431 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780883e-f436-4554-8b0f-e34795f23b19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:24.886801 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1780883e-f436-4554-8b0f-e34795f23b19 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:24.896618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 113/244] 10.222.0.81 () {56 vars in 1101 bytes} [Tue Sep 6 21:02:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:24.903456 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f6e71-b5b1-4e0c-aa54-be77edbe9164 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:25.017128 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:25.048018 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780883e-f436-4554-8b0f-e34795f23b19 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:25.069581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f6e71-b5b1-4e0c-aa54-be77edbe9164 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:25.120960 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481b6c7-e5c9-4659-8c67-4954d17c7470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:25.121725 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481b6c7-e5c9-4659-8c67-4954d17c7470 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:25.122002 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481b6c7-e5c9-4659-8c67-4954d17c7470 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:25.122547 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9481b6c7-e5c9-4659-8c67-4954d17c7470 None admin] PATH_INFO: `/v3/users/6568e625cab043aeace1e764e554afb9` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:25.145868 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481b6c7-e5c9-4659-8c67-4954d17c7470 None admin] RBAC: Authorizing `identity:get_user(user_id=6568e625cab043aeace1e764e554afb9)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:25.147584 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9481b6c7-e5c9-4659-8c67-4954d17c7470 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:25.149452 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 132/245] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:02:24 2022] GET /identity/v3/users/6568e625cab043aeace1e764e554afb9 => generated 297 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:25.155190 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481b6c7-e5c9-4659-8c67-4954d17c7470 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:25.180261 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:25.188461 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1780883e-f436-4554-8b0f-e34795f23b19 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:25.228632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1353174-819f-42fc-b95d-5b88b737d91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:25.229606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1353174-819f-42fc-b95d-5b88b737d91f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:25.230026 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1353174-819f-42fc-b95d-5b88b737d91f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:25.230554 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1353174-819f-42fc-b95d-5b88b737d91f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:25.245734 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1353174-819f-42fc-b95d-5b88b737d91f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:25.252078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-d1353174-819f-42fc-b95d-5b88b737d91f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:25.252078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:25.252078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:25.252078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:25.252078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:25.252078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:25.252078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:25.252078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:25.252078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:25.252078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:25.252078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:25.252078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:25.252078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:25.252078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:25.252078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:25.252078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:25.252988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:25.252988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:25.252988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:25.252988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:25.252988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:25.252988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:25.252988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:25.252988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:25.252988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:25.252988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:25.252988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:25.252988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:25.252988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:25.252988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:25.252988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:25.252988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:25.253784 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:25.253784 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:25.253784 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:25.253784 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:25.253784 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:25.253784 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:25.253784 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:25.253784 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:25.253784 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:25.253784 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:25.253784 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:25.253784 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:25.256037 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 114/246] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:02:25.262730 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1353174-819f-42fc-b95d-5b88b737d91f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:25.300016 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9481b6c7-e5c9-4659-8c67-4954d17c7470 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:25.336468 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:25.348654 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0996fa1-dbd4-4fcd-9f3f-0a162a07c86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:25.349421 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0996fa1-dbd4-4fcd-9f3f-0a162a07c86c None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:25.349881 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0996fa1-dbd4-4fcd-9f3f-0a162a07c86c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:25.350274 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0996fa1-dbd4-4fcd-9f3f-0a162a07c86c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:25.375458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1353174-819f-42fc-b95d-5b88b737d91f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:25.413268 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bab795-4667-4713-b7c5-4a9a7fdd58b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:25.414126 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bab795-4667-4713-b7c5-4a9a7fdd58b7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:25.414579 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bab795-4667-4713-b7c5-4a9a7fdd58b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:25.415049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bab795-4667-4713-b7c5-4a9a7fdd58b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:25.416448 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bab795-4667-4713-b7c5-4a9a7fdd58b7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:25.416896 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bab795-4667-4713-b7c5-4a9a7fdd58b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:25.418442 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bab795-4667-4713-b7c5-4a9a7fdd58b7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:25.427626 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 115/247] 10.222.0.81 () {56 vars in 1101 bytes} [Tue Sep 6 21:02:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:25.434181 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bab795-4667-4713-b7c5-4a9a7fdd58b7 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:25.460507 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:25.469175 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0996fa1-dbd4-4fcd-9f3f-0a162a07c86c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:25.470679 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0996fa1-dbd4-4fcd-9f3f-0a162a07c86c None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:25.549210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bab795-4667-4713-b7c5-4a9a7fdd58b7 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:25.589698 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8542d-b85b-4347-b409-9f1c338ed396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:25.590591 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8542d-b85b-4347-b409-9f1c338ed396 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:25.591018 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8542d-b85b-4347-b409-9f1c338ed396 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:25.591439 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a8542d-b85b-4347-b409-9f1c338ed396 None admin] PATH_INFO: `/v3/users/2cff5293cf8d4ba2bc42321ddad32f46` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:25.593996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8542d-b85b-4347-b409-9f1c338ed396 None admin] RBAC: Authorizing `identity:get_user(user_id=2cff5293cf8d4ba2bc42321ddad32f46)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:25.595630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a8542d-b85b-4347-b409-9f1c338ed396 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:25.599963 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 116/248] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:02:25 2022] GET /identity/v3/users/2cff5293cf8d4ba2bc42321ddad32f46 => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:25.623051 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8542d-b85b-4347-b409-9f1c338ed396 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:25.705042 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 133/249] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:02:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 21:02:25.725881 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0996fa1-dbd4-4fcd-9f3f-0a162a07c86c None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:25.735269 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:25.753575 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a8542d-b85b-4347-b409-9f1c338ed396 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:25.764800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:25.794246 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d015a0e-5e56-4426-af1a-6577a8234b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:25.795274 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d015a0e-5e56-4426-af1a-6577a8234b23 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:25.796010 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d015a0e-5e56-4426-af1a-6577a8234b23 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:25.796562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d015a0e-5e56-4426-af1a-6577a8234b23 None admin] PATH_INFO: `/v3/projects/b6011351cf9b462d964aff9e303a826d` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:25.798242 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d015a0e-5e56-4426-af1a-6577a8234b23 None admin] RBAC: Authorizing `identity:get_project(project_id=b6011351cf9b462d964aff9e303a826d)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:25.800041 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d015a0e-5e56-4426-af1a-6577a8234b23 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:25.807054 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 117/250] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:25 2022] GET /identity/v3/projects/b6011351cf9b462d964aff9e303a826d => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:25.809380 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d015a0e-5e56-4426-af1a-6577a8234b23 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:25.918864 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d015a0e-5e56-4426-af1a-6577a8234b23 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:25.954911 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ebb5e-d4ef-4007-bd59-10868b8221f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:25.955888 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ebb5e-d4ef-4007-bd59-10868b8221f3 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:25.956431 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ebb5e-d4ef-4007-bd59-10868b8221f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:25.956920 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ebb5e-d4ef-4007-bd59-10868b8221f3 None admin] PATH_INFO: `/v3/projects/b6011351cf9b462d964aff9e303a826d/users/2cff5293cf8d4ba2bc42321ddad32f46/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:25.959096 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ebb5e-d4ef-4007-bd59-10868b8221f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=b6011351cf9b462d964aff9e303a826d, user_id=2cff5293cf8d4ba2bc42321ddad32f46, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:25.960790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ebb5e-d4ef-4007-bd59-10868b8221f3 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:25.981876 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0996fa1-dbd4-4fcd-9f3f-0a162a07c86c None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:26.019405 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd4c10-f9c4-44fd-8d6b-4ca84a978c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:26.020476 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd4c10-f9c4-44fd-8d6b-4ca84a978c13 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:26.020940 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd4c10-f9c4-44fd-8d6b-4ca84a978c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:26.021396 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd4c10-f9c4-44fd-8d6b-4ca84a978c13 None admin] PATH_INFO: `/v3/projects/b6011351cf9b462d964aff9e303a826d` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:26.022784 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd4c10-f9c4-44fd-8d6b-4ca84a978c13 None admin] RBAC: Authorizing `identity:get_project(project_id=b6011351cf9b462d964aff9e303a826d)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:26.024554 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd4c10-f9c4-44fd-8d6b-4ca84a978c13 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:26.031735 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 134/251] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:25 2022] GET /identity/v3/projects/b6011351cf9b462d964aff9e303a826d => generated 302 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:26.033353 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d236ac-7150-4286-826c-88aa48c8ce6c None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:26.033907 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d236ac-7150-4286-826c-88aa48c8ce6c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:26.034403 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d236ac-7150-4286-826c-88aa48c8ce6c None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:26.035903 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 135/252] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:26.037369 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d236ac-7150-4286-826c-88aa48c8ce6c None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:26.078490 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 118/253] 10.222.0.81 () {58 vars in 1439 bytes} [Tue Sep 6 21:02:25 2022] PUT /identity/v3/projects/b6011351cf9b462d964aff9e303a826d/users/2cff5293cf8d4ba2bc42321ddad32f46/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:02:26.085949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4687e3-0ce2-453f-a3e9-17abf75e7ee0 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:26.086502 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4687e3-0ce2-453f-a3e9-17abf75e7ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:26.086959 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4687e3-0ce2-453f-a3e9-17abf75e7ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:26.136382 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-7f4687e3-0ce2-453f-a3e9-17abf75e7ee0 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:26.138515 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7f4687e3-0ce2-453f-a3e9-17abf75e7ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:26.160626 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:26.202700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:26.224271 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d236ac-7150-4286-826c-88aa48c8ce6c None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:26.273325 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 119/254] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:26.274674 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2be0d6-8fd1-405e-946e-0eeefd45d791 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:26.274963 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2be0d6-8fd1-405e-946e-0eeefd45d791 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:26.275238 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2be0d6-8fd1-405e-946e-0eeefd45d791 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:26.276314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0c094-0dcf-4431-a609-e9b763914156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:26.276925 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0c094-0dcf-4431-a609-e9b763914156 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:26.277195 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0c094-0dcf-4431-a609-e9b763914156 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:26.277461 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a0c094-0dcf-4431-a609-e9b763914156 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:26.278186 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0c094-0dcf-4431-a609-e9b763914156 None admin] RBAC: Adding query filter params (role.id=c45e700ef009486aa6e596465c62a5f1, scope.project.id=b6011351cf9b462d964aff9e303a826d, user.id=6568e625cab043aeace1e764e554afb9) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:26.278487 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0c094-0dcf-4431-a609-e9b763914156 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:26.280008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a0c094-0dcf-4431-a609-e9b763914156 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:26.283226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 120/255] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:26.290873 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670dae6-c482-4847-b534-8b559e035a9d None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:26.291171 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670dae6-c482-4847-b534-8b559e035a9d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:26.291428 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0670dae6-c482-4847-b534-8b559e035a9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:26.297987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 136/256] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:02:26 2022] GET /identity/v3/role_assignments?user.id=6568e625cab043aeace1e764e554afb9&scope.project.id=b6011351cf9b462d964aff9e303a826d&role.id=c45e700ef009486aa6e596465c62a5f1 => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:26.316321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-0670dae6-c482-4847-b534-8b559e035a9d None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:26.317570 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0670dae6-c482-4847-b534-8b559e035a9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:26.394356 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 121/257] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 21:02:26.826153 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0c094-0dcf-4431-a609-e9b763914156 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:26.937374 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670dae6-c482-4847-b534-8b559e035a9d None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:26.950764 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a0c094-0dcf-4431-a609-e9b763914156 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:27.020956 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c22bf-4c5f-4a08-bdee-1f484df85a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:27.022110 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c22bf-4c5f-4a08-bdee-1f484df85a6f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:27.022393 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c22bf-4c5f-4a08-bdee-1f484df85a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:27.022817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c22bf-4c5f-4a08-bdee-1f484df85a6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:27.040655 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c22bf-4c5f-4a08-bdee-1f484df85a6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:27.046309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-b14c22bf-4c5f-4a08-bdee-1f484df85a6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:02:27.046309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:27.046309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:27.046309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:27.046309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:27.046309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:27.046309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:27.046309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:27.046309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:27.046309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:27.046309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:27.046309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:27.046309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:27.046309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:27.046309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:27.046309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:27.047240 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:27.047240 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:27.047240 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:27.047240 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:27.047240 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:27.047240 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:27.047240 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:27.047240 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:27.047240 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:27.047240 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:27.047240 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:27.047240 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:27.047240 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:27.047240 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:27.047240 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:27.047240 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:27.048215 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:27.048215 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:27.048215 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:27.048215 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:27.048215 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:27.048215 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:27.048215 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:27.048215 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:27.048215 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:27.048215 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:27.048215 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:02:27.048215 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:02:27.048215 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 137/258] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:02:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:27.054901 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c22bf-4c5f-4a08-bdee-1f484df85a6f None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:27.084558 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:27.105992 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:27.190328 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0670dae6-c482-4847-b534-8b559e035a9d None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:27.214937 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c22bf-4c5f-4a08-bdee-1f484df85a6f None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:27.253891 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d008f4-e641-4ef3-a3f6-960bcf043318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:27.254553 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d008f4-e641-4ef3-a3f6-960bcf043318 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:27.254839 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d008f4-e641-4ef3-a3f6-960bcf043318 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:27.255118 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d008f4-e641-4ef3-a3f6-960bcf043318 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:27.272828 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d008f4-e641-4ef3-a3f6-960bcf043318 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:27.284625 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-77d008f4-e641-4ef3-a3f6-960bcf043318 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 21:02:27.284625 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:27.284625 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:27.284625 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:27.284625 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:27.284625 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:27.284625 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:27.284625 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:27.284625 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:27.284625 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:27.284625 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:27.284625 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:27.284625 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:27.284625 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:27.284625 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:27.284625 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:27.286141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:27.286141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:27.286141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:27.286141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:27.286141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:27.286141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:27.286141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:27.286141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:27.286141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:27.286141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:27.286141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:27.286141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:27.286141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:27.286141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:27.286141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:27.286141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:27.287124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:27.287124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:27.287124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:27.287124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:27.287124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:27.287124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:27.287124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:27.287124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:27.287124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:27.287124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:27.287124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 21:02:27.287124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:27.287124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 122/259] 10.222.0.81 () {56 vars in 1114 bytes} [Tue Sep 6 21:02:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:27.294887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d008f4-e641-4ef3-a3f6-960bcf043318 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:27.312541 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42e5ad-72e7-46cc-a713-b6046f97f179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:27.313436 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42e5ad-72e7-46cc-a713-b6046f97f179 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:27.313855 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42e5ad-72e7-46cc-a713-b6046f97f179 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:27.314262 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db42e5ad-72e7-46cc-a713-b6046f97f179 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:27.315127 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42e5ad-72e7-46cc-a713-b6046f97f179 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:27.315566 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42e5ad-72e7-46cc-a713-b6046f97f179 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:27.317181 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db42e5ad-72e7-46cc-a713-b6046f97f179 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:27.334068 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 138/260] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:27.340014 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42e5ad-72e7-46cc-a713-b6046f97f179 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:27.471324 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:27.483664 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d008f4-e641-4ef3-a3f6-960bcf043318 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:27.530836 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db42e5ad-72e7-46cc-a713-b6046f97f179 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:27.542666 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:27.549352 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800553ff-e0cb-4938-a7cd-457ad38e5e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:27.550163 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800553ff-e0cb-4938-a7cd-457ad38e5e3f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:27.555895 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800553ff-e0cb-4938-a7cd-457ad38e5e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:27.555895 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800553ff-e0cb-4938-a7cd-457ad38e5e3f None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:27.555895 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800553ff-e0cb-4938-a7cd-457ad38e5e3f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:27.555895 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800553ff-e0cb-4938-a7cd-457ad38e5e3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:27.555895 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800553ff-e0cb-4938-a7cd-457ad38e5e3f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:27.566979 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 123/261] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:02:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:27.584358 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800553ff-e0cb-4938-a7cd-457ad38e5e3f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:27.607375 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34980755-f0f6-414c-8e3b-9a1d87d47d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:27.608344 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34980755-f0f6-414c-8e3b-9a1d87d47d04 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:27.608763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34980755-f0f6-414c-8e3b-9a1d87d47d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:27.609175 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34980755-f0f6-414c-8e3b-9a1d87d47d04 None admin] PATH_INFO: `/v3/users/ec3c43c1a7f74067b81d329325fe4e2d` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:27.611664 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34980755-f0f6-414c-8e3b-9a1d87d47d04 None admin] RBAC: Authorizing `identity:get_user(user_id=ec3c43c1a7f74067b81d329325fe4e2d)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:27.613394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34980755-f0f6-414c-8e3b-9a1d87d47d04 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:27.618195 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 139/262] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:02:27 2022] GET /identity/v3/users/ec3c43c1a7f74067b81d329325fe4e2d => generated 283 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:27.621581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34980755-f0f6-414c-8e3b-9a1d87d47d04 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:27.770593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800553ff-e0cb-4938-a7cd-457ad38e5e3f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:27.820636 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b389e27-d20d-4300-be4f-a7883047025a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:27.822780 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b389e27-d20d-4300-be4f-a7883047025a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:27.823338 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b389e27-d20d-4300-be4f-a7883047025a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:27.823768 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b389e27-d20d-4300-be4f-a7883047025a None admin] PATH_INFO: `/v3/users/ec3c43c1a7f74067b81d329325fe4e2d` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:27.825137 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b389e27-d20d-4300-be4f-a7883047025a None admin] RBAC: Authorizing `identity:get_user(user_id=ec3c43c1a7f74067b81d329325fe4e2d)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:27.825625 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34980755-f0f6-414c-8e3b-9a1d87d47d04 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:27.826936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b389e27-d20d-4300-be4f-a7883047025a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:27.829462 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 124/263] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:02:27 2022] GET /identity/v3/users/ec3c43c1a7f74067b81d329325fe4e2d => generated 283 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:27.836602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b389e27-d20d-4300-be4f-a7883047025a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:27.909991 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:27.913595 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff7e4d3-d318-4b27-86ef-eb3d7bfe36d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:27.917289 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7e4d3-d318-4b27-86ef-eb3d7bfe36d7 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:27.922522 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7e4d3-d318-4b27-86ef-eb3d7bfe36d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:27.922522 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff7e4d3-d318-4b27-86ef-eb3d7bfe36d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:27.931683 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:27.993755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7e4d3-d318-4b27-86ef-eb3d7bfe36d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:27.995571 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff7e4d3-d318-4b27-86ef-eb3d7bfe36d7 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:27.996838 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b389e27-d20d-4300-be4f-a7883047025a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:28.106243 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 140/264] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:02:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 21:02:28.107878 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cac251-3ed8-44a6-bff0-7292549b9cfa None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:28.108327 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cac251-3ed8-44a6-bff0-7292549b9cfa None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:28.108741 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cac251-3ed8-44a6-bff0-7292549b9cfa None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:28.110382 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 141/265] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:28.110517 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af6e099-af6e-4bf6-944c-00f0cd41f9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:28.111428 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6e099-af6e-4bf6-944c-00f0cd41f9df None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:28.111816 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6e099-af6e-4bf6-944c-00f0cd41f9df None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:28.112228 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af6e099-af6e-4bf6-944c-00f0cd41f9df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:28.112466 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cac251-3ed8-44a6-bff0-7292549b9cfa None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:28.202228 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:28.241123 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6e099-af6e-4bf6-944c-00f0cd41f9df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:28.246195 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af6e099-af6e-4bf6-944c-00f0cd41f9df None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:28.282656 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cac251-3ed8-44a6-bff0-7292549b9cfa None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:28.320143 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:28.333619 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecabfece-611f-43b3-9d41-a04739860efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:28.334705 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabfece-611f-43b3-9d41-a04739860efc None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:28.335317 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabfece-611f-43b3-9d41-a04739860efc None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:28.338921 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecabfece-611f-43b3-9d41-a04739860efc None admin] PATH_INFO: `/v3/projects/b6011351cf9b462d964aff9e303a826d` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:28.338921 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecabfece-611f-43b3-9d41-a04739860efc None admin] RBAC: Authorizing `identity:get_project(project_id=b6011351cf9b462d964aff9e303a826d)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:28.339898 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecabfece-611f-43b3-9d41-a04739860efc None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:28.342198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 142/266] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:28 2022] GET /identity/v3/projects/b6011351cf9b462d964aff9e303a826d => generated 302 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:28.343603 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69197cc5-a101-4c3c-a77b-767134120266 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:28.343965 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69197cc5-a101-4c3c-a77b-767134120266 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:28.344412 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69197cc5-a101-4c3c-a77b-767134120266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:28.361802 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 125/267] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:02:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 21:02:28.363367 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4d09c-1887-4041-b964-983838c7f3bd None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:28.363714 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4d09c-1887-4041-b964-983838c7f3bd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:28.364061 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4d09c-1887-4041-b964-983838c7f3bd None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:28.369821 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 126/268] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:28.370628 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4d09c-1887-4041-b964-983838c7f3bd None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:28.373953 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-69197cc5-a101-4c3c-a77b-767134120266 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:28.375315 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-69197cc5-a101-4c3c-a77b-767134120266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:28.465737 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 143/269] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:28.466438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69197cc5-a101-4c3c-a77b-767134120266 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:28.500830 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4d09c-1887-4041-b964-983838c7f3bd None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:28.512675 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:28.582720 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e794ce-b9f3-45b7-85c7-f31045c880aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:28.583344 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e794ce-b9f3-45b7-85c7-f31045c880aa None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:28.583624 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e794ce-b9f3-45b7-85c7-f31045c880aa None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:28.583897 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e794ce-b9f3-45b7-85c7-f31045c880aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:28.584657 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e794ce-b9f3-45b7-85c7-f31045c880aa None admin] RBAC: Adding query filter params (role.id=fe9661f095094dd0931e0b96a1d6ef74, scope.project.id=b6011351cf9b462d964aff9e303a826d, user.id=ec3c43c1a7f74067b81d329325fe4e2d) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:28.584963 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e794ce-b9f3-45b7-85c7-f31045c880aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:28.586400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e794ce-b9f3-45b7-85c7-f31045c880aa None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:28.594171 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69197cc5-a101-4c3c-a77b-767134120266 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:28.600675 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 127/270] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:02:28 2022] GET /identity/v3/role_assignments?user.id=ec3c43c1a7f74067b81d329325fe4e2d&scope.project.id=b6011351cf9b462d964aff9e303a826d&role.id=fe9661f095094dd0931e0b96a1d6ef74 => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:28.602042 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba22daf-6c3a-4ab3-90a9-400593c8bd56 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:28.602334 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba22daf-6c3a-4ab3-90a9-400593c8bd56 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:28.602631 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba22daf-6c3a-4ab3-90a9-400593c8bd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:28.638414 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-bba22daf-6c3a-4ab3-90a9-400593c8bd56 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:28.639647 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-bba22daf-6c3a-4ab3-90a9-400593c8bd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:28.643088 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa5def-43b5-4f96-8beb-510aa439ad52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:28.643747 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa5def-43b5-4f96-8beb-510aa439ad52 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:28.644026 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa5def-43b5-4f96-8beb-510aa439ad52 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:28.644332 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa5def-43b5-4f96-8beb-510aa439ad52 None admin] PATH_INFO: `/v3/projects/b6011351cf9b462d964aff9e303a826d` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:28.645499 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa5def-43b5-4f96-8beb-510aa439ad52 None admin] RBAC: Authorizing `identity:get_project(project_id=b6011351cf9b462d964aff9e303a826d)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:28.646982 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fa5def-43b5-4f96-8beb-510aa439ad52 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:28.648671 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 144/271] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:28 2022] GET /identity/v3/projects/b6011351cf9b462d964aff9e303a826d => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:28.656721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa5def-43b5-4f96-8beb-510aa439ad52 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:28.681290 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:28.766200 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 128/272] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:28.767013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba22daf-6c3a-4ab3-90a9-400593c8bd56 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:28.779809 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa5def-43b5-4f96-8beb-510aa439ad52 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:28.782487 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:28.846314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf6f96-7ce4-4bad-abb5-b53f0fce5e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:28.846960 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf6f96-7ce4-4bad-abb5-b53f0fce5e8a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:28.847245 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf6f96-7ce4-4bad-abb5-b53f0fce5e8a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:28.847517 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf6f96-7ce4-4bad-abb5-b53f0fce5e8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:28.848455 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf6f96-7ce4-4bad-abb5-b53f0fce5e8a None admin] RBAC: Adding query filter params (role.id=c1dd3aa5113d434ab8306e2453a5ba6a, scope.project.id=b6011351cf9b462d964aff9e303a826d, user.id=ec3c43c1a7f74067b81d329325fe4e2d) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:28.848771 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf6f96-7ce4-4bad-abb5-b53f0fce5e8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:28.850258 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf6f96-7ce4-4bad-abb5-b53f0fce5e8a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:28.865623 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 145/273] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:02:28 2022] GET /identity/v3/role_assignments?user.id=ec3c43c1a7f74067b81d329325fe4e2d&scope.project.id=b6011351cf9b462d964aff9e303a826d&role.id=c1dd3aa5113d434ab8306e2453a5ba6a => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:28.927175 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba22daf-6c3a-4ab3-90a9-400593c8bd56 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:28.973758 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea69f5a-cad2-4ce7-845c-d5b1925a8827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:28.974399 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea69f5a-cad2-4ce7-845c-d5b1925a8827 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:28.974680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea69f5a-cad2-4ce7-845c-d5b1925a8827 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:28.974951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea69f5a-cad2-4ce7-845c-d5b1925a8827 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:28.990034 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea69f5a-cad2-4ce7-845c-d5b1925a8827 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:28.994936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-2ea69f5a-cad2-4ce7-845c-d5b1925a8827 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:28.994936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:28.994936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:28.994936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:28.994936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:28.994936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:28.994936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:28.994936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:28.994936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:28.994936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:28.994936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:28.994936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:28.994936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:28.994936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:28.994936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:28.994936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:28.997096 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:28.997096 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:28.997096 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:28.997096 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:28.997096 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:28.997096 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:28.997096 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:28.997096 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:28.997096 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:28.997096 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:28.997096 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:28.997096 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:28.997096 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:28.997096 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:28.997096 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:28.997096 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:28.999101 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:28.999101 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:28.999101 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:28.999101 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:28.999101 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:28.999101 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:28.999101 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:28.999101 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:28.999101 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:28.999101 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:28.999101 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:28.999101 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:28.999101 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 129/274] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:29.008243 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf6f96-7ce4-4bad-abb5-b53f0fce5e8a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:29.156146 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf6f96-7ce4-4bad-abb5-b53f0fce5e8a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:29.198366 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fee5c-4ef0-40f3-be6b-0603573eb30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:29.198990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fee5c-4ef0-40f3-be6b-0603573eb30d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:29.199264 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fee5c-4ef0-40f3-be6b-0603573eb30d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:29.199599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48fee5c-4ef0-40f3-be6b-0603573eb30d None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:29.200327 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48fee5c-4ef0-40f3-be6b-0603573eb30d None admin] RBAC: Adding query filter params (name=member) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:29.200631 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48fee5c-4ef0-40f3-be6b-0603573eb30d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:29.202163 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48fee5c-4ef0-40f3-be6b-0603573eb30d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:29.213492 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 146/275] 10.222.0.81 () {56 vars in 1101 bytes} [Tue Sep 6 21:02:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:29.219915 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea69f5a-cad2-4ce7-845c-d5b1925a8827 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:29.236166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fee5c-4ef0-40f3-be6b-0603573eb30d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:29.254502 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:29.300288 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:29.389384 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea69f5a-cad2-4ce7-845c-d5b1925a8827 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:29.402200 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48fee5c-4ef0-40f3-be6b-0603573eb30d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:29.429069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2a0b5-cb55-4995-924a-fe0977541037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:29.429671 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2a0b5-cb55-4995-924a-fe0977541037 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:29.429949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2a0b5-cb55-4995-924a-fe0977541037 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:29.430244 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2a0b5-cb55-4995-924a-fe0977541037 None admin] PATH_INFO: `/v3/users/1f85fbc50a0f4ae594dc9d210ff45ac4` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:29.441373 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c09b27-99ec-4dd8-9204-393e3097694a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:29.442012 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c09b27-99ec-4dd8-9204-393e3097694a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:29.442290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c09b27-99ec-4dd8-9204-393e3097694a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:29.442558 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c09b27-99ec-4dd8-9204-393e3097694a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:29.443662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c09b27-99ec-4dd8-9204-393e3097694a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:29.445209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2a0b5-cb55-4995-924a-fe0977541037 None admin] RBAC: Authorizing `identity:get_user(user_id=1f85fbc50a0f4ae594dc9d210ff45ac4)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:29.445320 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c09b27-99ec-4dd8-9204-393e3097694a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:29.447221 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2a0b5-cb55-4995-924a-fe0977541037 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:29.451049 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 147/276] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:02:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:29.451210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 130/277] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:02:29 2022] GET /identity/v3/users/1f85fbc50a0f4ae594dc9d210ff45ac4 => generated 293 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:29.451304 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372e5a4-d10a-44ab-9ba6-6ed8faaa1d10 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:29.451304 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372e5a4-d10a-44ab-9ba6-6ed8faaa1d10 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:29.451304 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372e5a4-d10a-44ab-9ba6-6ed8faaa1d10 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:29.451304 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 148/278] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:29.454351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2a0b5-cb55-4995-924a-fe0977541037 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:29.456081 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25715e-c577-4e98-8c89-346273487d00 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:29.456596 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25715e-c577-4e98-8c89-346273487d00 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:29.457069 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25715e-c577-4e98-8c89-346273487d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:29.475568 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-1b25715e-c577-4e98-8c89-346273487d00 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:29.477351 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1b25715e-c577-4e98-8c89-346273487d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:29.532689 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:29.556424 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 149/279] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 21:02:29.557652 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25715e-c577-4e98-8c89-346273487d00 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:29.566809 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2a0b5-cb55-4995-924a-fe0977541037 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:29.588879 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:29.601794 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a90561-6314-4d97-8fe9-c9e836751abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:29.602382 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a90561-6314-4d97-8fe9-c9e836751abd None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:29.602688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a90561-6314-4d97-8fe9-c9e836751abd None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:29.602965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a90561-6314-4d97-8fe9-c9e836751abd None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:29.603619 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a90561-6314-4d97-8fe9-c9e836751abd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:29.605117 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a90561-6314-4d97-8fe9-c9e836751abd None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:29.662979 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25715e-c577-4e98-8c89-346273487d00 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:29.696571 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2484e1e1-7662-453a-9e74-54329ffc6b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:29.697097 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484e1e1-7662-453a-9e74-54329ffc6b0a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:29.697372 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484e1e1-7662-453a-9e74-54329ffc6b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:29.697638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2484e1e1-7662-453a-9e74-54329ffc6b0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:29.698347 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484e1e1-7662-453a-9e74-54329ffc6b0a None admin] RBAC: Adding query filter params (role.id=be70fb8abf3148dda8e8e51be3a212e6, user.id=1f85fbc50a0f4ae594dc9d210ff45ac4, scope.system=all) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:29.698648 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484e1e1-7662-453a-9e74-54329ffc6b0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:29.700136 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2484e1e1-7662-453a-9e74-54329ffc6b0a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:29.705008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 150/280] 10.222.0.81 () {56 vars in 1308 bytes} [Tue Sep 6 21:02:29 2022] GET /identity/v3/role_assignments?user.id=1f85fbc50a0f4ae594dc9d210ff45ac4&scope.system=all&role.id=be70fb8abf3148dda8e8e51be3a212e6 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:29.706200 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e2246-791e-479b-891a-9bb3a789a351 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:29.706478 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e2246-791e-479b-891a-9bb3a789a351 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:29.706742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e2246-791e-479b-891a-9bb3a789a351 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:29.708127 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 151/281] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:29.714323 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f73a9-79b9-4d3c-a46a-150728d99fe1 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:29.714559 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f73a9-79b9-4d3c-a46a-150728d99fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:29.714774 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5f73a9-79b9-4d3c-a46a-150728d99fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:29.735796 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-ad5f73a9-79b9-4d3c-a46a-150728d99fe1 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:29.737552 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ad5f73a9-79b9-4d3c-a46a-150728d99fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:29.740509 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 131/282] 10.222.0.81 () {60 vars in 1132 bytes} [Tue Sep 6 21:02:29 2022] POST /identity/v3/users => generated 293 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:02:29.826037 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 152/283] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:29.834405 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a90561-6314-4d97-8fe9-c9e836751abd None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:29.963672 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a90561-6314-4d97-8fe9-c9e836751abd None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:29.995860 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:30.003159 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df3798-fc9f-40de-9d8d-8a6569f2ec11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:30.003810 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df3798-fc9f-40de-9d8d-8a6569f2ec11 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:30.011893 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df3798-fc9f-40de-9d8d-8a6569f2ec11 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:30.011893 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5df3798-fc9f-40de-9d8d-8a6569f2ec11 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:30.015843 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5df3798-fc9f-40de-9d8d-8a6569f2ec11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:30.020879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-c5df3798-fc9f-40de-9d8d-8a6569f2ec11 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 21:02:30.020879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:30.020879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:30.020879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:30.020879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:30.020879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:30.020879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:30.020879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:30.020879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:30.020879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:30.020879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:30.020879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:30.020879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:30.020879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:30.020879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:30.020879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:30.021765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:30.021765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:30.021765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:30.021765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:30.021765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:30.021765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:30.021765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:30.021765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:30.021765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:30.021765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:30.021765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:30.021765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:30.021765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:30.021765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:30.021765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:30.021765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:30.022553 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:30.022553 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:30.022553 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:30.022553 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:30.022553 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:30.022553 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:30.022553 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:30.022553 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:30.022553 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:30.022553 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:30.022553 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 21:02:30.022553 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:30.022553 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 132/284] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:30.029453 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f73a9-79b9-4d3c-a46a-150728d99fe1 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:30.060244 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:30.105429 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df3798-fc9f-40de-9d8d-8a6569f2ec11 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:30.147731 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5f73a9-79b9-4d3c-a46a-150728d99fe1 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:30.189452 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771aee3-00ac-4101-8674-2055f7bae5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:30.190086 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771aee3-00ac-4101-8674-2055f7bae5e1 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:30.190365 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771aee3-00ac-4101-8674-2055f7bae5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:30.190635 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f771aee3-00ac-4101-8674-2055f7bae5e1 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:30.191299 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f771aee3-00ac-4101-8674-2055f7bae5e1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:30.191636 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f771aee3-00ac-4101-8674-2055f7bae5e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:30.193136 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f771aee3-00ac-4101-8674-2055f7bae5e1 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:30.205565 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 153/285] 10.222.0.81 () {56 vars in 1101 bytes} [Tue Sep 6 21:02:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:30.211170 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771aee3-00ac-4101-8674-2055f7bae5e1 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:30.238504 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5df3798-fc9f-40de-9d8d-8a6569f2ec11 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:30.288354 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eecec3-72b7-4820-b02a-4190c28a3317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:30.289010 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eecec3-72b7-4820-b02a-4190c28a3317 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:30.289291 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eecec3-72b7-4820-b02a-4190c28a3317 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:30.289564 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eecec3-72b7-4820-b02a-4190c28a3317 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:30.305096 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eecec3-72b7-4820-b02a-4190c28a3317 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:30.312088 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-37eecec3-72b7-4820-b02a-4190c28a3317 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:30.312088 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:30.312088 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:30.312088 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:30.312088 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:30.312088 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:30.312088 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:30.312088 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:30.312088 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:30.312088 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:30.312088 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:30.312088 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:30.312088 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:30.312088 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:30.312088 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:30.312088 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:30.313160 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:30.313160 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:30.313160 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:30.313160 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:30.313160 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:30.313160 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:30.313160 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:30.313160 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:30.313160 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:30.313160 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:30.313160 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:30.313160 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:30.313160 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:30.313160 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:30.313160 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:30.313160 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:30.313969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:30.313969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:30.313969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:30.313969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:30.313969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:30.313969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:30.313969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:30.313969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:30.313969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:30.313969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:30.313969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:30.313969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:30.314594 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 133/286] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:02:30.320340 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eecec3-72b7-4820-b02a-4190c28a3317 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:30.330029 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:30.350566 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f771aee3-00ac-4101-8674-2055f7bae5e1 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:30.389536 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:30.401006 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17bfdf-a142-4b80-a9d8-d6b237a330da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:30.402219 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17bfdf-a142-4b80-a9d8-d6b237a330da None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:30.402672 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17bfdf-a142-4b80-a9d8-d6b237a330da None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:30.403303 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17bfdf-a142-4b80-a9d8-d6b237a330da None admin] PATH_INFO: `/v3/users/6568e625cab043aeace1e764e554afb9` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:30.405248 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b17bfdf-a142-4b80-a9d8-d6b237a330da None admin] RBAC: Authorizing `identity:get_user(user_id=6568e625cab043aeace1e764e554afb9)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:30.407117 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b17bfdf-a142-4b80-a9d8-d6b237a330da None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:30.409885 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 154/287] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:02:30 2022] GET /identity/v3/users/6568e625cab043aeace1e764e554afb9 => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:30.415770 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17bfdf-a142-4b80-a9d8-d6b237a330da None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:30.479196 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eecec3-72b7-4820-b02a-4190c28a3317 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:30.554203 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6719e0d-8d46-4589-bd75-1ec84a4a4fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:30.554829 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6719e0d-8d46-4589-bd75-1ec84a4a4fad None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:30.555106 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6719e0d-8d46-4589-bd75-1ec84a4a4fad None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:30.555375 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6719e0d-8d46-4589-bd75-1ec84a4a4fad None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:30.557025 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6719e0d-8d46-4589-bd75-1ec84a4a4fad None admin] RBAC: Adding query filter params (name=member) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:30.557025 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6719e0d-8d46-4589-bd75-1ec84a4a4fad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:30.558341 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6719e0d-8d46-4589-bd75-1ec84a4a4fad None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:30.573091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 134/288] 10.222.0.81 () {56 vars in 1101 bytes} [Tue Sep 6 21:02:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:30.574415 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6719e0d-8d46-4589-bd75-1ec84a4a4fad None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:30.610999 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17bfdf-a142-4b80-a9d8-d6b237a330da None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:30.688076 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b6e70-352b-4e6d-ab8b-e43789639827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:30.688319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6719e0d-8d46-4589-bd75-1ec84a4a4fad None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:30.688810 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b6e70-352b-4e6d-ab8b-e43789639827 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:30.689094 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b6e70-352b-4e6d-ab8b-e43789639827 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:30.689360 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b6e70-352b-4e6d-ab8b-e43789639827 None admin] PATH_INFO: `/v3/projects/b6011351cf9b462d964aff9e303a826d` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:30.690695 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b6e70-352b-4e6d-ab8b-e43789639827 None admin] RBAC: Authorizing `identity:get_project(project_id=b6011351cf9b462d964aff9e303a826d)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:30.693265 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b6e70-352b-4e6d-ab8b-e43789639827 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:30.695094 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 155/289] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:30 2022] GET /identity/v3/projects/b6011351cf9b462d964aff9e303a826d => generated 302 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:30.700888 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b6e70-352b-4e6d-ab8b-e43789639827 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:30.722625 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:30.736437 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:30.767940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc8b93-3a30-4719-81a8-07956503a303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:30.768611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc8b93-3a30-4719-81a8-07956503a303 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:30.768896 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc8b93-3a30-4719-81a8-07956503a303 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:30.769169 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc8b93-3a30-4719-81a8-07956503a303 None admin] PATH_INFO: `/v3/users/2cff5293cf8d4ba2bc42321ddad32f46` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:30.771980 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc8b93-3a30-4719-81a8-07956503a303 None admin] RBAC: Authorizing `identity:get_user(user_id=2cff5293cf8d4ba2bc42321ddad32f46)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:30.773449 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc8b93-3a30-4719-81a8-07956503a303 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:30.775126 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 135/290] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:02:30 2022] GET /identity/v3/users/2cff5293cf8d4ba2bc42321ddad32f46 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:30.781993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc8b93-3a30-4719-81a8-07956503a303 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:30.873703 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b6e70-352b-4e6d-ab8b-e43789639827 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:30.944219 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f65f89-484b-454e-956d-a54c40fbbef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:30.944904 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f65f89-484b-454e-956d-a54c40fbbef6 None admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:30.945180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f65f89-484b-454e-956d-a54c40fbbef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:30.945451 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f65f89-484b-454e-956d-a54c40fbbef6 None admin] PATH_INFO: `/v3/projects/b6011351cf9b462d964aff9e303a826d/users/6568e625cab043aeace1e764e554afb9/roles/c45e700ef009486aa6e596465c62a5f1` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:30.948812 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f65f89-484b-454e-956d-a54c40fbbef6 None admin] RBAC: Authorizing `identity:create_grant(project_id=b6011351cf9b462d964aff9e303a826d, user_id=6568e625cab043aeace1e764e554afb9, role_id=c45e700ef009486aa6e596465c62a5f1)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:30.950264 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f65f89-484b-454e-956d-a54c40fbbef6 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:30.972936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc8b93-3a30-4719-81a8-07956503a303 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:31.007635 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54eae5-0ac6-429b-aa10-84b6857d9856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:31.008272 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54eae5-0ac6-429b-aa10-84b6857d9856 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:31.008549 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54eae5-0ac6-429b-aa10-84b6857d9856 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:31.008850 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54eae5-0ac6-429b-aa10-84b6857d9856 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:31.046325 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 156/291] 10.222.0.81 () {58 vars in 1439 bytes} [Tue Sep 6 21:02:30 2022] PUT /identity/v3/projects/b6011351cf9b462d964aff9e303a826d/users/6568e625cab043aeace1e764e554afb9/roles/c45e700ef009486aa6e596465c62a5f1 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:02:31.072408 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:31.094588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54eae5-0ac6-429b-aa10-84b6857d9856 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:31.096083 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54eae5-0ac6-429b-aa10-84b6857d9856 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:31.206685 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 136/292] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:02:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 21:02:31.213139 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f65f89-484b-454e-956d-a54c40fbbef6 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:31.312169 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:31.342693 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f65f89-484b-454e-956d-a54c40fbbef6 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:31.393925 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a4b87-4332-47d7-bbf7-032d93300490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:31.394569 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a4b87-4332-47d7-bbf7-032d93300490 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:31.394846 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a4b87-4332-47d7-bbf7-032d93300490 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:31.395118 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a4b87-4332-47d7-bbf7-032d93300490 None admin] PATH_INFO: `/v3/projects/b6011351cf9b462d964aff9e303a826d` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:31.396281 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a4b87-4332-47d7-bbf7-032d93300490 None admin] RBAC: Authorizing `identity:get_project(project_id=b6011351cf9b462d964aff9e303a826d)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:31.397730 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a4b87-4332-47d7-bbf7-032d93300490 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:31.400217 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 157/293] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:31 2022] GET /identity/v3/projects/b6011351cf9b462d964aff9e303a826d => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:31.406055 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54eae5-0ac6-429b-aa10-84b6857d9856 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:31.499923 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:31.523939 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54eae5-0ac6-429b-aa10-84b6857d9856 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:31.572127 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeaaac8-2534-4f3f-88a4-8cc63a9a4c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:31.572760 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaaac8-2534-4f3f-88a4-8cc63a9a4c1c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:31.573041 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaaac8-2534-4f3f-88a4-8cc63a9a4c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:31.573315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaaac8-2534-4f3f-88a4-8cc63a9a4c1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:31.574045 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeaaac8-2534-4f3f-88a4-8cc63a9a4c1c None admin] RBAC: Adding query filter params (role.id=be70fb8abf3148dda8e8e51be3a212e6, scope.project.id=b6011351cf9b462d964aff9e303a826d, user.id=2cff5293cf8d4ba2bc42321ddad32f46) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:31.574351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeaaac8-2534-4f3f-88a4-8cc63a9a4c1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:31.575782 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeaaac8-2534-4f3f-88a4-8cc63a9a4c1c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:31.584883 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 137/294] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:02:31 2022] GET /identity/v3/role_assignments?user.id=2cff5293cf8d4ba2bc42321ddad32f46&scope.project.id=b6011351cf9b462d964aff9e303a826d&role.id=be70fb8abf3148dda8e8e51be3a212e6 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:32.286369 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1794d13-8f2c-43a6-8953-1f0538883f93 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:32.286873 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1794d13-8f2c-43a6-8953-1f0538883f93 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:32.286978 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1794d13-8f2c-43a6-8953-1f0538883f93 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:32.288524 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 158/295] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:32.294303 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b274c-e482-41e1-9f1c-172719a2d294 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:32.294603 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b274c-e482-41e1-9f1c-172719a2d294 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:32.294876 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b274c-e482-41e1-9f1c-172719a2d294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:32.313940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ec4b274c-e482-41e1-9f1c-172719a2d294 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:32.315179 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ec4b274c-e482-41e1-9f1c-172719a2d294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:32.391175 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 138/296] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:32.554974 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d8227-d249-4853-9a36-c51c1464b6d4 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:32.555325 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d8227-d249-4853-9a36-c51c1464b6d4 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:32.555532 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d8227-d249-4853-9a36-c51c1464b6d4 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:32.557801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 159/297] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:32.563634 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320cf84-2902-418d-86dd-0cbccfaca615 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:32.564576 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320cf84-2902-418d-86dd-0cbccfaca615 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:32.565065 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3320cf84-2902-418d-86dd-0cbccfaca615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:32.584725 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-3320cf84-2902-418d-86dd-0cbccfaca615 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:32.586227 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3320cf84-2902-418d-86dd-0cbccfaca615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:32.656022 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 139/298] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:32.672598 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d8227-d249-4853-9a36-c51c1464b6d4 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:32.673278 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f4598-48f3-4807-b827-5a744ced4cfd None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:32.673584 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f4598-48f3-4807-b827-5a744ced4cfd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:32.673854 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f4598-48f3-4807-b827-5a744ced4cfd None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:32.675333 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 140/299] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:02:32.682378 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef0822-98b1-4152-ac4a-be43dd0bbcc2 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:32.682670 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef0822-98b1-4152-ac4a-be43dd0bbcc2 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:32.682953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef0822-98b1-4152-ac4a-be43dd0bbcc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:32.692529 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:32.706639 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-dfef0822-98b1-4152-ac4a-be43dd0bbcc2 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:32.708057 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-dfef0822-98b1-4152-ac4a-be43dd0bbcc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:32.786310 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d8227-d249-4853-9a36-c51c1464b6d4 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:32.787312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 141/300] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 21:02:32.827278 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fccfbd-e6ca-4986-801a-ef79a83d4d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:32.828176 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fccfbd-e6ca-4986-801a-ef79a83d4d37 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:32.828663 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fccfbd-e6ca-4986-801a-ef79a83d4d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:32.829080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fccfbd-e6ca-4986-801a-ef79a83d4d37 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:32.840687 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fccfbd-e6ca-4986-801a-ef79a83d4d37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:32.845926 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-71fccfbd-e6ca-4986-801a-ef79a83d4d37 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:32.845926 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:32.845926 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:32.845926 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:32.845926 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:32.845926 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:32.845926 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:32.845926 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:32.845926 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:32.845926 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:32.845926 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:32.845926 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:32.845926 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:32.845926 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:32.845926 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:32.845926 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:32.852662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:32.852662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:32.852662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:32.852662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:32.852662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:32.852662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:32.852662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:32.852662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:32.852662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:32.852662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:32.852662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:32.852662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:32.852662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:32.852662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:32.852662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:32.852662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:32.853700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:32.853700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:32.853700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:32.853700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:32.853700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:32.853700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:32.853700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:32.853700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:32.853700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:32.853700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:32.853700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:32.853700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:02:32.853700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 160/301] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:32.857267 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef0822-98b1-4152-ac4a-be43dd0bbcc2 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:32.943748 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fccfbd-e6ca-4986-801a-ef79a83d4d37 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:32.956030 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:33.030673 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef0822-98b1-4152-ac4a-be43dd0bbcc2 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:33.053669 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fccfbd-e6ca-4986-801a-ef79a83d4d37 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:33.070124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd98f42-19a0-43a1-b4f3-8b6f64ca39d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:33.070737 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd98f42-19a0-43a1-b4f3-8b6f64ca39d5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:33.071014 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd98f42-19a0-43a1-b4f3-8b6f64ca39d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:33.071844 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd98f42-19a0-43a1-b4f3-8b6f64ca39d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:33.072542 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd98f42-19a0-43a1-b4f3-8b6f64ca39d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:33.072844 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd98f42-19a0-43a1-b4f3-8b6f64ca39d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:33.074231 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd98f42-19a0-43a1-b4f3-8b6f64ca39d5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:33.075782 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:33.090566 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 142/302] 10.222.0.81 () {56 vars in 1101 bytes} [Tue Sep 6 21:02:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:33.090566 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd98f42-19a0-43a1-b4f3-8b6f64ca39d5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:33.095731 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e854f-e7d7-464b-aac9-a7656194db19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:33.096413 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e854f-e7d7-464b-aac9-a7656194db19 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:33.096693 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e854f-e7d7-464b-aac9-a7656194db19 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:33.096966 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e854f-e7d7-464b-aac9-a7656194db19 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:33.107717 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e854f-e7d7-464b-aac9-a7656194db19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:33.112829 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-346e854f-e7d7-464b-aac9-a7656194db19 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 21:02:33.112829 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:33.112829 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:33.112829 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:33.112829 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:33.112829 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:33.112829 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:33.112829 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:33.112829 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:33.112829 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:33.112829 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:33.112829 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:33.112829 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:33.112829 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:33.112829 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:33.112829 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:33.113740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:33.113740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:33.113740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:33.113740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:33.113740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:33.113740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:33.113740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:33.113740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:33.113740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:33.113740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:33.113740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:33.113740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:33.113740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:33.113740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:33.113740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:33.113740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:33.114614 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:33.114614 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:33.114614 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:33.114614 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:33.114614 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:33.114614 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:33.114614 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:33.114614 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:33.114614 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:33.114614 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:33.114614 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 21:02:33.114614 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:02:33.115339 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 161/303] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:02:33.116137 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e854f-e7d7-464b-aac9-a7656194db19 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:33.191379 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:33.201353 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd98f42-19a0-43a1-b4f3-8b6f64ca39d5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:33.228087 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e854f-e7d7-464b-aac9-a7656194db19 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:33.238612 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdf66a-46f9-4c77-b3c8-4376885df5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:33.239270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdf66a-46f9-4c77-b3c8-4376885df5d8 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:33.239870 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdf66a-46f9-4c77-b3c8-4376885df5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:33.240248 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdf66a-46f9-4c77-b3c8-4376885df5d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:33.241459 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdf66a-46f9-4c77-b3c8-4376885df5d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:33.242935 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdf66a-46f9-4c77-b3c8-4376885df5d8 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:33.247019 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 143/304] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:02:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:33.247019 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdf66a-46f9-4c77-b3c8-4376885df5d8 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:33.276041 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44d6b5-1ca3-461b-b95b-4accb5995f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:33.276719 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44d6b5-1ca3-461b-b95b-4accb5995f47 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:33.277002 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44d6b5-1ca3-461b-b95b-4accb5995f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:33.277279 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44d6b5-1ca3-461b-b95b-4accb5995f47 None admin] PATH_INFO: `/v3/users/1f85fbc50a0f4ae594dc9d210ff45ac4` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:33.278425 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44d6b5-1ca3-461b-b95b-4accb5995f47 None admin] RBAC: Authorizing `identity:get_user(user_id=1f85fbc50a0f4ae594dc9d210ff45ac4)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:33.279879 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44d6b5-1ca3-461b-b95b-4accb5995f47 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:33.281794 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 162/305] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:02:33 2022] GET /identity/v3/users/1f85fbc50a0f4ae594dc9d210ff45ac4 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:33.282665 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44d6b5-1ca3-461b-b95b-4accb5995f47 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:33.318448 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:33.356068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdf66a-46f9-4c77-b3c8-4376885df5d8 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:33.391146 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44d6b5-1ca3-461b-b95b-4accb5995f47 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:33.393773 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4d0f8-fbe0-46bd-aabe-cb7470143019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:33.394390 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4d0f8-fbe0-46bd-aabe-cb7470143019 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:33.394668 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4d0f8-fbe0-46bd-aabe-cb7470143019 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:33.394939 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec4d0f8-fbe0-46bd-aabe-cb7470143019 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:33.395699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4d0f8-fbe0-46bd-aabe-cb7470143019 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:33.396006 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4d0f8-fbe0-46bd-aabe-cb7470143019 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:33.397397 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec4d0f8-fbe0-46bd-aabe-cb7470143019 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:33.405851 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 144/306] 10.222.0.81 () {56 vars in 1101 bytes} [Tue Sep 6 21:02:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:33.406453 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4d0f8-fbe0-46bd-aabe-cb7470143019 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:33.435818 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c9d9c-e03b-48fc-ae67-6bc7d0524466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:33.436877 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c9d9c-e03b-48fc-ae67-6bc7d0524466 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:33.437448 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c9d9c-e03b-48fc-ae67-6bc7d0524466 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:33.437946 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c9d9c-e03b-48fc-ae67-6bc7d0524466 None admin] PATH_INFO: `/v3/groups` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:33.438880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c9d9c-e03b-48fc-ae67-6bc7d0524466 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:33.440650 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c9d9c-e03b-48fc-ae67-6bc7d0524466 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:33.447450 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:33.511224 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec4d0f8-fbe0-46bd-aabe-cb7470143019 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:33.524402 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 163/307] 10.222.0.81 () {60 vars in 1134 bytes} [Tue Sep 6 21:02:33 2022] POST /identity/v3/groups => generated 229 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:02:33.525776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c9d9c-e03b-48fc-ae67-6bc7d0524466 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:33.553621 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:33.565124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918fc1da-5ab0-4724-a2ed-c775b8f328e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:33.566491 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fc1da-5ab0-4724-a2ed-c775b8f328e4 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:33.566946 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fc1da-5ab0-4724-a2ed-c775b8f328e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:33.567365 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918fc1da-5ab0-4724-a2ed-c775b8f328e4 None admin] PATH_INFO: `/v3/system/users/1f85fbc50a0f4ae594dc9d210ff45ac4/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:33.569348 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918fc1da-5ab0-4724-a2ed-c775b8f328e4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1f85fbc50a0f4ae594dc9d210ff45ac4, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:33.570930 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918fc1da-5ab0-4724-a2ed-c775b8f328e4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:33.659096 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c9d9c-e03b-48fc-ae67-6bc7d0524466 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:33.685184 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 145/308] 10.222.0.81 () {58 vars in 1334 bytes} [Tue Sep 6 21:02:33 2022] PUT /identity/v3/system/users/1f85fbc50a0f4ae594dc9d210ff45ac4/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:02:33.692175 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ecba9-617a-4316-ba18-dea00deccee0 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:33.692175 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ecba9-617a-4316-ba18-dea00deccee0 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:33.692175 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5ecba9-617a-4316-ba18-dea00deccee0 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:33.692175 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 146/309] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:33.696132 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19756d-c7c2-49a5-adf5-f9e966d795c2 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:33.698380 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19756d-c7c2-49a5-adf5-f9e966d795c2 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:33.698380 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a19756d-c7c2-49a5-adf5-f9e966d795c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:33.703046 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1be909-3ae5-4127-8c3f-02343a2d13f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:33.703762 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1be909-3ae5-4127-8c3f-02343a2d13f3 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:33.704047 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1be909-3ae5-4127-8c3f-02343a2d13f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:33.704355 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1be909-3ae5-4127-8c3f-02343a2d13f3 None admin] PATH_INFO: `/v3/users/5c20af6b17c14c3ca57dbee5ca4f94dc` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:33.718483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-0a19756d-c7c2-49a5-adf5-f9e966d795c2 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:33.719727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0a19756d-c7c2-49a5-adf5-f9e966d795c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:33.721479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1be909-3ae5-4127-8c3f-02343a2d13f3 None admin] RBAC: Authorizing `identity:get_user(user_id=5c20af6b17c14c3ca57dbee5ca4f94dc)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:33.723207 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1be909-3ae5-4127-8c3f-02343a2d13f3 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:33.725008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 164/310] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:02:33 2022] GET /identity/v3/users/5c20af6b17c14c3ca57dbee5ca4f94dc => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:33.731704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1be909-3ae5-4127-8c3f-02343a2d13f3 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:33.812155 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 147/311] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 21:02:33.816440 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:33.871570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1be909-3ae5-4127-8c3f-02343a2d13f3 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:33.911779 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1406c-cc94-4f89-b6e5-f0e21832c84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:33.911779 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1406c-cc94-4f89-b6e5-f0e21832c84e None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:33.911779 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1406c-cc94-4f89-b6e5-f0e21832c84e None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:33.911779 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d1406c-cc94-4f89-b6e5-f0e21832c84e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:33.912175 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1406c-cc94-4f89-b6e5-f0e21832c84e None admin] RBAC: Adding query filter params (role.id=c45e700ef009486aa6e596465c62a5f1, user.id=5c20af6b17c14c3ca57dbee5ca4f94dc, scope.system=all) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:33.912175 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1406c-cc94-4f89-b6e5-f0e21832c84e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:33.912741 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d1406c-cc94-4f89-b6e5-f0e21832c84e None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:33.919506 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 165/312] 10.222.0.81 () {56 vars in 1308 bytes} [Tue Sep 6 21:02:33 2022] GET /identity/v3/role_assignments?user.id=5c20af6b17c14c3ca57dbee5ca4f94dc&scope.system=all&role.id=c45e700ef009486aa6e596465c62a5f1 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:34.092378 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19756d-c7c2-49a5-adf5-f9e966d795c2 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:34.199419 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a19756d-c7c2-49a5-adf5-f9e966d795c2 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:34.224962 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:34.236345 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149740ad-f51a-49b5-8a01-8b9c64712561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:34.236990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149740ad-f51a-49b5-8a01-8b9c64712561 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:34.237272 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149740ad-f51a-49b5-8a01-8b9c64712561 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:34.237546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149740ad-f51a-49b5-8a01-8b9c64712561 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:34.252129 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149740ad-f51a-49b5-8a01-8b9c64712561 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:34.254226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-149740ad-f51a-49b5-8a01-8b9c64712561 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 21:02:34.254226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:34.254226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:34.254226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:34.254226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:34.254226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:34.254226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:34.254226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:34.254226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:34.254226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:34.254226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:34.254226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:34.254226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:34.254226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:34.254226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:34.254226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:34.255091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:34.255091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:34.255091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:34.255091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:34.255091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:34.255091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:34.255091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:34.255091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:34.255091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:34.255091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:34.255091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:34.255091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:34.255091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:34.255091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:34.255091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:34.255091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:34.255896 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:34.255896 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:34.255896 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:34.255896 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:34.255896 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:34.255896 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:34.255896 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:34.255896 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:34.255896 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:34.255896 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:34.255896 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 21:02:34.255896 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:34.255896 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 148/313] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:34.265716 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1406c-cc94-4f89-b6e5-f0e21832c84e None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:34.375165 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d1406c-cc94-4f89-b6e5-f0e21832c84e None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:34.398837 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:34.416764 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad6699-9478-4936-9bbf-22c48118163d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:34.417390 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad6699-9478-4936-9bbf-22c48118163d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:34.417672 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad6699-9478-4936-9bbf-22c48118163d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:34.417948 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ad6699-9478-4936-9bbf-22c48118163d None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:34.418612 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad6699-9478-4936-9bbf-22c48118163d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:34.418916 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad6699-9478-4936-9bbf-22c48118163d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:34.420331 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ad6699-9478-4936-9bbf-22c48118163d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:34.429449 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 166/314] 10.222.0.81 () {56 vars in 1101 bytes} [Tue Sep 6 21:02:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:34.434903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149740ad-f51a-49b5-8a01-8b9c64712561 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:34.549159 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149740ad-f51a-49b5-8a01-8b9c64712561 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:34.584695 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89efb3f4-8781-41b1-a01b-d249282c774c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:34.585347 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efb3f4-8781-41b1-a01b-d249282c774c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:34.585589 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efb3f4-8781-41b1-a01b-d249282c774c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:34.585861 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efb3f4-8781-41b1-a01b-d249282c774c None admin] PATH_INFO: `/v3/users/6568e625cab043aeace1e764e554afb9` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:34.587018 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89efb3f4-8781-41b1-a01b-d249282c774c None admin] RBAC: Authorizing `identity:get_user(user_id=6568e625cab043aeace1e764e554afb9)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:34.588464 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89efb3f4-8781-41b1-a01b-d249282c774c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:34.590374 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 149/315] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:02:34 2022] GET /identity/v3/users/6568e625cab043aeace1e764e554afb9 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:34.595752 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad6699-9478-4936-9bbf-22c48118163d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:34.706018 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ad6699-9478-4936-9bbf-22c48118163d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:34.740366 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868b07d-4e97-4bf0-a627-fcb1c2a72e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:34.740982 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868b07d-4e97-4bf0-a627-fcb1c2a72e62 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:34.741266 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868b07d-4e97-4bf0-a627-fcb1c2a72e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:34.741540 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d868b07d-4e97-4bf0-a627-fcb1c2a72e62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:34.791832 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:34.820847 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d868b07d-4e97-4bf0-a627-fcb1c2a72e62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:34.820847 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d868b07d-4e97-4bf0-a627-fcb1c2a72e62 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:34.929607 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 167/316] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:02:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 21:02:34.935469 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89efb3f4-8781-41b1-a01b-d249282c774c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:34.986854 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:35.042374 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89efb3f4-8781-41b1-a01b-d249282c774c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:35.077605 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619a71d-25d3-440e-a392-37f60d232463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:35.078156 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619a71d-25d3-440e-a392-37f60d232463 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:35.078430 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619a71d-25d3-440e-a392-37f60d232463 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:35.078699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619a71d-25d3-440e-a392-37f60d232463 None admin] PATH_INFO: `/v3/projects/b6011351cf9b462d964aff9e303a826d` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:35.079803 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b619a71d-25d3-440e-a392-37f60d232463 None admin] RBAC: Authorizing `identity:get_project(project_id=b6011351cf9b462d964aff9e303a826d)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:35.081265 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b619a71d-25d3-440e-a392-37f60d232463 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:35.083219 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 150/317] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:34 2022] GET /identity/v3/projects/b6011351cf9b462d964aff9e303a826d => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:35.088858 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868b07d-4e97-4bf0-a627-fcb1c2a72e62 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:35.174506 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:35.194198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d868b07d-4e97-4bf0-a627-fcb1c2a72e62 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:35.229325 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4993553-9be9-4714-b503-42379b446b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:35.229931 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4993553-9be9-4714-b503-42379b446b03 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:35.230222 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4993553-9be9-4714-b503-42379b446b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:35.230471 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4993553-9be9-4714-b503-42379b446b03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:35.231189 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4993553-9be9-4714-b503-42379b446b03 None admin] RBAC: Adding query filter params (role.id=c45e700ef009486aa6e596465c62a5f1, scope.project.id=b6011351cf9b462d964aff9e303a826d, user.id=6568e625cab043aeace1e764e554afb9) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:35.231495 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4993553-9be9-4714-b503-42379b446b03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:35.232977 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4993553-9be9-4714-b503-42379b446b03 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:35.239261 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 168/318] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:02:35 2022] GET /identity/v3/role_assignments?user.id=6568e625cab043aeace1e764e554afb9&scope.project.id=b6011351cf9b462d964aff9e303a826d&role.id=c45e700ef009486aa6e596465c62a5f1 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:35.876221 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f90df3-5854-4784-ae8f-5546b695bc4b None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:35.876743 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f90df3-5854-4784-ae8f-5546b695bc4b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:35.876820 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f90df3-5854-4784-ae8f-5546b695bc4b None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:35.878146 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 151/319] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:35.883596 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381a5c6-e961-480a-aebe-2d0bbafa26dc None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:35.884509 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381a5c6-e961-480a-aebe-2d0bbafa26dc None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:35.884665 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7381a5c6-e961-480a-aebe-2d0bbafa26dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:35.905341 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-7381a5c6-e961-480a-aebe-2d0bbafa26dc None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:35.906552 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7381a5c6-e961-480a-aebe-2d0bbafa26dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:35.935075 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2c913-58b7-4998-b1a4-4af64262007f None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:35.935357 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2c913-58b7-4998-b1a4-4af64262007f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:35.935632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2c913-58b7-4998-b1a4-4af64262007f None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:35.936969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 152/320] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:35.942695 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31851deb-6fe2-4fd6-bf10-025f53a589ec None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:35.942972 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31851deb-6fe2-4fd6-bf10-025f53a589ec None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:35.943264 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31851deb-6fe2-4fd6-bf10-025f53a589ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:35.962578 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-31851deb-6fe2-4fd6-bf10-025f53a589ec None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:35.963771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-31851deb-6fe2-4fd6-bf10-025f53a589ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:35.981639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 169/321] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:36.033902 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 153/322] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 21:02:36.205865 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d362e6-9bc2-4d07-8a75-9bcdb6858b24 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:36.206070 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d362e6-9bc2-4d07-8a75-9bcdb6858b24 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:36.206311 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d362e6-9bc2-4d07-8a75-9bcdb6858b24 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:36.208005 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 170/323] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:36.213791 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1f46d-ed46-4e68-8004-64a300cc0af3 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:36.214217 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1f46d-ed46-4e68-8004-64a300cc0af3 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:36.214622 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e1f46d-ed46-4e68-8004-64a300cc0af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:36.234208 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-03e1f46d-ed46-4e68-8004-64a300cc0af3 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:36.235404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-03e1f46d-ed46-4e68-8004-64a300cc0af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:36.260511 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d362e6-9bc2-4d07-8a75-9bcdb6858b24 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:36.291074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:36.319254 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 154/324] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:36.335363 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1f46d-ed46-4e68-8004-64a300cc0af3 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:36.346654 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:36.386434 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d362e6-9bc2-4d07-8a75-9bcdb6858b24 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:36.431201 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083ee34-aa1f-46e8-b49c-28be6750074c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:36.432339 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083ee34-aa1f-46e8-b49c-28be6750074c None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:36.432721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083ee34-aa1f-46e8-b49c-28be6750074c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:36.433086 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083ee34-aa1f-46e8-b49c-28be6750074c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:36.434308 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083ee34-aa1f-46e8-b49c-28be6750074c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:36.435871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5083ee34-aa1f-46e8-b49c-28be6750074c None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:36.444148 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 171/325] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:02:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:36.445603 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083ee34-aa1f-46e8-b49c-28be6750074c None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:36.459459 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e1f46d-ed46-4e68-8004-64a300cc0af3 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:36.511289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b1c87-461e-4656-b51a-5fa64380c36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:36.511957 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b1c87-461e-4656-b51a-5fa64380c36c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:36.512270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b1c87-461e-4656-b51a-5fa64380c36c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:36.512611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b1c87-461e-4656-b51a-5fa64380c36c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:36.523497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b1c87-461e-4656-b51a-5fa64380c36c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:36.528674 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-8c6b1c87-461e-4656-b51a-5fa64380c36c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:36.528674 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:36.528674 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:36.528674 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:36.528674 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:36.528674 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:36.528674 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:36.528674 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:36.528674 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:36.528674 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:36.528674 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:36.528674 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:36.528674 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:36.528674 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:36.528674 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:36.528674 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:36.529593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:36.529593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:36.529593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:36.529593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:36.529593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:36.529593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:36.529593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:36.529593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:36.529593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:36.529593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:36.529593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:36.529593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:36.529593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:36.529593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:36.529593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:36.529593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:36.532546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:36.532546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:36.532546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:36.532546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:36.532546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:36.532546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:36.532546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:36.532546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:36.532546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:36.532546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:36.532546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:36.532546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:36.532546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 155/326] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:02:36.539188 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b1c87-461e-4656-b51a-5fa64380c36c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:36.578984 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:36.592709 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083ee34-aa1f-46e8-b49c-28be6750074c None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:36.632997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470dba4-7d65-449b-885c-f8525c0b0243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:36.633636 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470dba4-7d65-449b-885c-f8525c0b0243 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:36.633914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470dba4-7d65-449b-885c-f8525c0b0243 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:36.634188 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470dba4-7d65-449b-885c-f8525c0b0243 None admin] PATH_INFO: `/v3/groups` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:36.634819 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470dba4-7d65-449b-885c-f8525c0b0243 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:36.636290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470dba4-7d65-449b-885c-f8525c0b0243 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:36.645139 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b1c87-461e-4656-b51a-5fa64380c36c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:36.679421 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9af2e7-407c-42db-a1fb-ea0c93810b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:36.680023 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9af2e7-407c-42db-a1fb-ea0c93810b46 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:36.680345 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9af2e7-407c-42db-a1fb-ea0c93810b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:36.681186 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9af2e7-407c-42db-a1fb-ea0c93810b46 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:36.681917 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9af2e7-407c-42db-a1fb-ea0c93810b46 None admin] RBAC: Adding query filter params (name=member) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:36.682228 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9af2e7-407c-42db-a1fb-ea0c93810b46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:36.683580 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9af2e7-407c-42db-a1fb-ea0c93810b46 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:36.691431 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 156/327] 10.222.0.81 () {56 vars in 1101 bytes} [Tue Sep 6 21:02:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:36.692251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9af2e7-407c-42db-a1fb-ea0c93810b46 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:36.733174 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 172/328] 10.222.0.81 () {60 vars in 1134 bytes} [Tue Sep 6 21:02:36 2022] POST /identity/v3/groups => generated 226 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:02:36.734615 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470dba4-7d65-449b-885c-f8525c0b0243 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:36.738503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:36.796580 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:36.800494 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9af2e7-407c-42db-a1fb-ea0c93810b46 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:36.838558 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b670ded-bd60-4b3b-814e-9b85e3114edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:36.839568 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b670ded-bd60-4b3b-814e-9b85e3114edd None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:36.840253 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b670ded-bd60-4b3b-814e-9b85e3114edd None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:36.840540 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b670ded-bd60-4b3b-814e-9b85e3114edd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:36.855670 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b670ded-bd60-4b3b-814e-9b85e3114edd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:36.860619 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-4b670ded-bd60-4b3b-814e-9b85e3114edd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 21:02:36.860619 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:36.860619 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:36.860619 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:36.860619 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:36.860619 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:36.860619 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:36.860619 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:36.860619 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:36.860619 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:36.860619 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:36.860619 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:36.860619 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:36.860619 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:36.860619 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:36.860619 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:36.861632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:36.861632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:36.861632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:36.861632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:36.861632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:36.861632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:36.861632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:36.861632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:36.861632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:36.861632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:36.861632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:36.861632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:36.861632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:36.861632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:36.861632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:36.861632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:36.862973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:36.862973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:36.862973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:36.862973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:36.862973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:36.862973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:36.862973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:36.862973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:36.862973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:36.862973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:36.862973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 21:02:36.862973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:36.862973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 157/329] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:36.868371 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b670ded-bd60-4b3b-814e-9b85e3114edd None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:36.869786 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470dba4-7d65-449b-885c-f8525c0b0243 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:36.919321 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a76821-1b1a-48fc-b8c7-33dd1c0a7cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:36.919990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a76821-1b1a-48fc-b8c7-33dd1c0a7cc1 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:36.921050 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a76821-1b1a-48fc-b8c7-33dd1c0a7cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:36.921699 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a76821-1b1a-48fc-b8c7-33dd1c0a7cc1 None admin] PATH_INFO: `/v3/users/1f85fbc50a0f4ae594dc9d210ff45ac4` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:36.923175 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a76821-1b1a-48fc-b8c7-33dd1c0a7cc1 None admin] RBAC: Authorizing `identity:get_user(user_id=1f85fbc50a0f4ae594dc9d210ff45ac4)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:36.924759 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a76821-1b1a-48fc-b8c7-33dd1c0a7cc1 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:36.926403 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 173/330] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:02:36 2022] GET /identity/v3/users/1f85fbc50a0f4ae594dc9d210ff45ac4 => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:36.933201 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a76821-1b1a-48fc-b8c7-33dd1c0a7cc1 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:36.996409 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b670ded-bd60-4b3b-814e-9b85e3114edd None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:37.026774 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:37.046793 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5aa194-861a-4e41-960b-79ad18f62ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:37.046793 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5aa194-861a-4e41-960b-79ad18f62ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:37.047414 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5aa194-861a-4e41-960b-79ad18f62ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:37.047702 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5aa194-861a-4e41-960b-79ad18f62ad0 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:37.049277 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5aa194-861a-4e41-960b-79ad18f62ad0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:37.049277 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5aa194-861a-4e41-960b-79ad18f62ad0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:37.050594 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5aa194-861a-4e41-960b-79ad18f62ad0 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:37.060318 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 158/331] 10.222.0.81 () {56 vars in 1101 bytes} [Tue Sep 6 21:02:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:37.063580 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a76821-1b1a-48fc-b8c7-33dd1c0a7cc1 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:37.066081 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5aa194-861a-4e41-960b-79ad18f62ad0 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:37.095490 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:37.104008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f82418-9582-4da0-b639-3eed1b084c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:37.108939 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f82418-9582-4da0-b639-3eed1b084c94 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:37.108939 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f82418-9582-4da0-b639-3eed1b084c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:37.108939 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f82418-9582-4da0-b639-3eed1b084c94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:37.108939 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f82418-9582-4da0-b639-3eed1b084c94 None admin] RBAC: Adding query filter params (role.id=be70fb8abf3148dda8e8e51be3a212e6, user.id=1f85fbc50a0f4ae594dc9d210ff45ac4, scope.system=all) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:37.108939 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f82418-9582-4da0-b639-3eed1b084c94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:37.108939 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f82418-9582-4da0-b639-3eed1b084c94 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:37.121311 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 174/332] 10.222.0.81 () {56 vars in 1308 bytes} [Tue Sep 6 21:02:36 2022] GET /identity/v3/role_assignments?user.id=1f85fbc50a0f4ae594dc9d210ff45ac4&scope.system=all&role.id=be70fb8abf3148dda8e8e51be3a212e6 => generated 510 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:37.192289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5aa194-861a-4e41-960b-79ad18f62ad0 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:37.236421 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f99dbc-65bb-4734-ad03-6df9dce3aea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:37.237472 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f99dbc-65bb-4734-ad03-6df9dce3aea4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:37.237953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f99dbc-65bb-4734-ad03-6df9dce3aea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:37.238643 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f99dbc-65bb-4734-ad03-6df9dce3aea4 None admin] PATH_INFO: `/v3/users/5c20af6b17c14c3ca57dbee5ca4f94dc` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:37.240355 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f99dbc-65bb-4734-ad03-6df9dce3aea4 None admin] RBAC: Authorizing `identity:get_user(user_id=5c20af6b17c14c3ca57dbee5ca4f94dc)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:37.242089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f99dbc-65bb-4734-ad03-6df9dce3aea4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:37.245897 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 159/333] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:02:37 2022] GET /identity/v3/users/5c20af6b17c14c3ca57dbee5ca4f94dc => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:37.252302 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f82418-9582-4da0-b639-3eed1b084c94 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:37.377189 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f82418-9582-4da0-b639-3eed1b084c94 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:37.408595 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:37.417380 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ccdb84-5520-465d-bf52-79fc6d29650b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:37.418052 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccdb84-5520-465d-bf52-79fc6d29650b None admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:37.418343 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccdb84-5520-465d-bf52-79fc6d29650b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:37.418626 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ccdb84-5520-465d-bf52-79fc6d29650b None admin] PATH_INFO: `/v3/system/users/5c20af6b17c14c3ca57dbee5ca4f94dc/roles/c45e700ef009486aa6e596465c62a5f1` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:37.420087 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ccdb84-5520-465d-bf52-79fc6d29650b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5c20af6b17c14c3ca57dbee5ca4f94dc, role_id=c45e700ef009486aa6e596465c62a5f1)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:37.421586 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ccdb84-5520-465d-bf52-79fc6d29650b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:37.493652 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 175/334] 10.222.0.81 () {58 vars in 1334 bytes} [Tue Sep 6 21:02:37 2022] PUT /identity/v3/system/users/5c20af6b17c14c3ca57dbee5ca4f94dc/roles/c45e700ef009486aa6e596465c62a5f1 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:02:39.266977 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85d160-19ce-4169-a7fe-32fda1fbbc9c None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:39.267493 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85d160-19ce-4169-a7fe-32fda1fbbc9c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:39.267602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b85d160-19ce-4169-a7fe-32fda1fbbc9c None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:39.269215 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 160/335] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:39.274973 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430516d-0170-4f92-9222-effd1547564b None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:39.275393 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430516d-0170-4f92-9222-effd1547564b None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:39.275554 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430516d-0170-4f92-9222-effd1547564b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:39.301914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-8430516d-0170-4f92-9222-effd1547564b None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:39.303116 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8430516d-0170-4f92-9222-effd1547564b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:39.401344 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 176/336] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:39.644886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d3444-c916-4afe-84e6-01c0ee7db746 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:39.645236 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d3444-c916-4afe-84e6-01c0ee7db746 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:39.645441 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d3444-c916-4afe-84e6-01c0ee7db746 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:39.646783 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 161/337] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:39.652618 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5852932-4229-4dee-bccf-5f2192e1ca7c None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:39.652906 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5852932-4229-4dee-bccf-5f2192e1ca7c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:39.653183 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5852932-4229-4dee-bccf-5f2192e1ca7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:39.676231 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-d5852932-4229-4dee-bccf-5f2192e1ca7c None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:39.677411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d5852932-4229-4dee-bccf-5f2192e1ca7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:39.769730 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 177/338] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 21:02:40.009870 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d3444-c916-4afe-84e6-01c0ee7db746 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:40.034697 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c219dbc-ef7d-449c-8ed7-b9c499084661 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:40.035091 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c219dbc-ef7d-449c-8ed7-b9c499084661 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:40.035415 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c219dbc-ef7d-449c-8ed7-b9c499084661 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:40.036879 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 178/339] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:40.044207 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196e21f-61d7-4938-a43c-4905abee0d0a None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:40.044495 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196e21f-61d7-4938-a43c-4905abee0d0a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:40.048010 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196e21f-61d7-4938-a43c-4905abee0d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:40.074146 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-a196e21f-61d7-4938-a43c-4905abee0d0a None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:40.075426 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a196e21f-61d7-4938-a43c-4905abee0d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:40.144046 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:40.159708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:40.173192 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 179/340] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 21:02:40.182859 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d3444-c916-4afe-84e6-01c0ee7db746 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:40.226816 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fd4a6-3a61-4a90-81f9-615acd0d5da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:40.227852 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fd4a6-3a61-4a90-81f9-615acd0d5da0 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:40.228359 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fd4a6-3a61-4a90-81f9-615acd0d5da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:40.228850 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fd4a6-3a61-4a90-81f9-615acd0d5da0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:40.241159 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79fd4a6-3a61-4a90-81f9-615acd0d5da0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:40.246440 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-a79fd4a6-3a61-4a90-81f9-615acd0d5da0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:40.246440 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:40.246440 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:40.246440 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:40.246440 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:40.246440 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:40.246440 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:40.246440 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:40.246440 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:40.246440 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:40.246440 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:40.246440 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:40.246440 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:40.246440 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:40.246440 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:40.246440 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:40.247322 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:40.247322 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:40.247322 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:40.247322 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:40.247322 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:40.247322 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:40.247322 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:40.247322 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:40.247322 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:40.247322 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:40.247322 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:40.247322 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:40.247322 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:40.247322 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:40.247322 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:40.247322 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:40.248152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:40.248152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:40.248152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:40.248152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:40.248152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:40.248152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:40.248152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:40.248152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:40.248152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:40.248152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:40.248152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:40.248152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:40.250880 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 162/341] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:40.257014 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196e21f-61d7-4938-a43c-4905abee0d0a None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:40.273071 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fd4a6-3a61-4a90-81f9-615acd0d5da0 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:40.404018 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fd4a6-3a61-4a90-81f9-615acd0d5da0 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:40.449656 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01936c3b-0d91-4f1a-9a82-9aa6ad991e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:40.450644 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01936c3b-0d91-4f1a-9a82-9aa6ad991e01 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:40.451129 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01936c3b-0d91-4f1a-9a82-9aa6ad991e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:40.451611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01936c3b-0d91-4f1a-9a82-9aa6ad991e01 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:40.469134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01936c3b-0d91-4f1a-9a82-9aa6ad991e01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:40.474792 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-01936c3b-0d91-4f1a-9a82-9aa6ad991e01 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:40.474792 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:40.474792 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:40.474792 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:40.474792 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:40.474792 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:40.474792 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:40.474792 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:40.474792 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:40.474792 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:40.474792 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:40.474792 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:40.474792 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:40.474792 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:40.474792 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:40.474792 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:40.475680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:40.475680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:40.475680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:40.475680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:40.475680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:40.475680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:40.475680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:40.475680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:40.475680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:40.475680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:40.475680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:40.475680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:40.475680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:40.475680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:40.475680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:40.475680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:40.476509 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:40.476509 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:40.476509 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:40.476509 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:40.476509 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:40.476509 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:40.476509 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:40.476509 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:40.476509 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:40.476509 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:40.476509 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:40.476509 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:40.477123 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196e21f-61d7-4938-a43c-4905abee0d0a None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:40.478819 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 163/342] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:40.484804 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01936c3b-0d91-4f1a-9a82-9aa6ad991e01 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:40.501340 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:40.545952 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c0ae0-ea66-4991-9051-ba2281351140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:40.546582 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c0ae0-ea66-4991-9051-ba2281351140 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:40.546858 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c0ae0-ea66-4991-9051-ba2281351140 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:40.547126 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c0ae0-ea66-4991-9051-ba2281351140 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:40.547799 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c0ae0-ea66-4991-9051-ba2281351140 None admin] RBAC: Adding query filter params (name=member) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:40.548114 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c0ae0-ea66-4991-9051-ba2281351140 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:40.549506 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c0ae0-ea66-4991-9051-ba2281351140 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:40.576474 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 180/343] 10.222.0.81 () {56 vars in 1101 bytes} [Tue Sep 6 21:02:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:40.580545 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c0ae0-ea66-4991-9051-ba2281351140 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:40.676654 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:40.690102 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01936c3b-0d91-4f1a-9a82-9aa6ad991e01 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:40.740512 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98824a-c899-4373-982c-7c4afb7faaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:40.741500 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98824a-c899-4373-982c-7c4afb7faaa1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:40.741992 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98824a-c899-4373-982c-7c4afb7faaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:40.742457 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98824a-c899-4373-982c-7c4afb7faaa1 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:40.743834 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98824a-c899-4373-982c-7c4afb7faaa1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:40.744370 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98824a-c899-4373-982c-7c4afb7faaa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:40.745936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a98824a-c899-4373-982c-7c4afb7faaa1 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:40.760078 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c0ae0-ea66-4991-9051-ba2281351140 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:40.767088 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 164/344] 10.222.0.81 () {56 vars in 1101 bytes} [Tue Sep 6 21:02:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:40.768196 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98824a-c899-4373-982c-7c4afb7faaa1 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:40.816910 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8939f-c88b-4802-916f-f4759ac23614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:40.817462 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8939f-c88b-4802-916f-f4759ac23614 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:40.817744 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8939f-c88b-4802-916f-f4759ac23614 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:40.818016 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8939f-c88b-4802-916f-f4759ac23614 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:40.850837 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:40.886376 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a98824a-c899-4373-982c-7c4afb7faaa1 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:40.921934 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8939f-c88b-4802-916f-f4759ac23614 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:40.923418 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8939f-c88b-4802-916f-f4759ac23614 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:40.931473 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a66f7f-90e1-4989-8abd-096b4b57e8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:40.932168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a66f7f-90e1-4989-8abd-096b4b57e8aa None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:40.932436 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a66f7f-90e1-4989-8abd-096b4b57e8aa None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:40.932710 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a66f7f-90e1-4989-8abd-096b4b57e8aa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:40.944906 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a66f7f-90e1-4989-8abd-096b4b57e8aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:40.950577 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-c4a66f7f-90e1-4989-8abd-096b4b57e8aa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 21:02:40.950577 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:40.950577 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:40.950577 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:40.950577 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:40.950577 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:40.950577 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:40.950577 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:40.950577 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:40.950577 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:40.950577 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:40.950577 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:40.950577 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:40.950577 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:40.950577 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:40.950577 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:40.951503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:40.951503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:40.951503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:40.951503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:40.951503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:40.951503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:40.951503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:40.951503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:40.951503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:40.951503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:40.951503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:40.951503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:40.951503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:40.951503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:40.951503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:40.951503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:40.952963 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:40.952963 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:40.952963 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:40.952963 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:40.952963 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:40.952963 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:40.952963 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:40.952963 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:40.952963 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:40.952963 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:40.952963 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 21:02:40.952963 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:40.952963 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 165/345] 10.222.0.81 () {56 vars in 1114 bytes} [Tue Sep 6 21:02:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:40.952963 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a66f7f-90e1-4989-8abd-096b4b57e8aa None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:40.978966 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:41.044483 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 181/346] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:02:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 21:02:41.046182 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c05f5-9217-4ea8-97d4-b8479eff1b68 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:41.046699 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c05f5-9217-4ea8-97d4-b8479eff1b68 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:41.047166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c05f5-9217-4ea8-97d4-b8479eff1b68 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:41.050531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 182/347] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:41.051476 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c05f5-9217-4ea8-97d4-b8479eff1b68 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:41.071219 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a66f7f-90e1-4989-8abd-096b4b57e8aa None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:41.103572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:41.110527 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0b19b-a639-4f6b-abff-d96377cf7155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:41.111286 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0b19b-a639-4f6b-abff-d96377cf7155 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:41.111565 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0b19b-a639-4f6b-abff-d96377cf7155 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:41.111839 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0b19b-a639-4f6b-abff-d96377cf7155 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:41.164655 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c05f5-9217-4ea8-97d4-b8479eff1b68 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:41.190000 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0b19b-a639-4f6b-abff-d96377cf7155 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:41.191575 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0b19b-a639-4f6b-abff-d96377cf7155 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:41.201676 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bb944-1c6c-4520-b320-f6e98703381b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:41.202612 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bb944-1c6c-4520-b320-f6e98703381b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:41.203107 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bb944-1c6c-4520-b320-f6e98703381b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:41.203581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bb944-1c6c-4520-b320-f6e98703381b None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:41.204485 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288bb944-1c6c-4520-b320-f6e98703381b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:41.204982 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288bb944-1c6c-4520-b320-f6e98703381b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:41.206615 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288bb944-1c6c-4520-b320-f6e98703381b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:41.216996 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 183/348] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:02:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:41.218201 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bb944-1c6c-4520-b320-f6e98703381b None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:41.228316 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:41.308553 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 166/349] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:02:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 21:02:41.309239 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d295ebc-ef97-4d64-abb1-528f8aacbc75 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:41.309457 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d295ebc-ef97-4d64-abb1-528f8aacbc75 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:41.309737 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d295ebc-ef97-4d64-abb1-528f8aacbc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:41.326681 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bb944-1c6c-4520-b320-f6e98703381b None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:41.334144 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-7d295ebc-ef97-4d64-abb1-528f8aacbc75 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:41.335451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7d295ebc-ef97-4d64-abb1-528f8aacbc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:41.363561 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27d78f-c799-42fd-b9cc-70eab023d781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:41.363768 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:41.364680 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27d78f-c799-42fd-b9cc-70eab023d781 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:41.365159 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27d78f-c799-42fd-b9cc-70eab023d781 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:41.365624 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27d78f-c799-42fd-b9cc-70eab023d781 None admin] PATH_INFO: `/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:41.366987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d27d78f-c799-42fd-b9cc-70eab023d781 None admin] RBAC: Authorizing `identity:get_project(project_id=d3beaaf3de6a4ec9857978f70d555f6a)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:41.368698 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d27d78f-c799-42fd-b9cc-70eab023d781 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:41.370726 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 184/350] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:41 2022] GET /identity/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:41.376285 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27d78f-c799-42fd-b9cc-70eab023d781 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:41.416550 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 167/351] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:41.417823 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d295ebc-ef97-4d64-abb1-528f8aacbc75 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:41.466820 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:41.495255 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27d78f-c799-42fd-b9cc-70eab023d781 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:41.547888 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea18d771-7f3d-44b0-adfa-5aafbad07181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:41.549781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18d771-7f3d-44b0-adfa-5aafbad07181 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:41.549781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18d771-7f3d-44b0-adfa-5aafbad07181 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:41.549989 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea18d771-7f3d-44b0-adfa-5aafbad07181 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:41.564283 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d295ebc-ef97-4d64-abb1-528f8aacbc75 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:41.604430 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046798e-4854-4de5-bb40-27b674dc6fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:41.605393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046798e-4854-4de5-bb40-27b674dc6fab None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:41.605884 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046798e-4854-4de5-bb40-27b674dc6fab None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:41.606349 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046798e-4854-4de5-bb40-27b674dc6fab None admin] PATH_INFO: `/v3/projects/b6011351cf9b462d964aff9e303a826d` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:41.607672 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046798e-4854-4de5-bb40-27b674dc6fab None admin] RBAC: Authorizing `identity:get_project(project_id=b6011351cf9b462d964aff9e303a826d)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:41.609334 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046798e-4854-4de5-bb40-27b674dc6fab None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:41.611150 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 168/352] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:41 2022] GET /identity/v3/projects/b6011351cf9b462d964aff9e303a826d => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:41.612268 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046798e-4854-4de5-bb40-27b674dc6fab None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:41.633844 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18d771-7f3d-44b0-adfa-5aafbad07181 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:41.635610 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea18d771-7f3d-44b0-adfa-5aafbad07181 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:41.646413 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:41.723643 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:41.728672 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046798e-4854-4de5-bb40-27b674dc6fab None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:41.754624 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 185/353] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:02:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 21:02:41.754624 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70da60-ac58-425b-87a9-8cd88cfcbac1 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:41.754624 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70da60-ac58-425b-87a9-8cd88cfcbac1 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:41.754918 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70da60-ac58-425b-87a9-8cd88cfcbac1 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:41.757378 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 186/354] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:41.758320 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70da60-ac58-425b-87a9-8cd88cfcbac1 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:41.770735 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3565d-9e36-4330-a879-ff1d15addd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:41.771694 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3565d-9e36-4330-a879-ff1d15addd54 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:41.772258 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3565d-9e36-4330-a879-ff1d15addd54 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:41.772725 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3565d-9e36-4330-a879-ff1d15addd54 None admin] PATH_INFO: `/v3/groups/3327522bc253425ea1de40ffe1daaac8` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:41.779693 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c3565d-9e36-4330-a879-ff1d15addd54 None admin] RBAC: Authorizing `identity:get_group(group_id=3327522bc253425ea1de40ffe1daaac8)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:41.781578 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c3565d-9e36-4330-a879-ff1d15addd54 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:41.783523 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 169/355] 10.222.0.81 () {56 vars in 1180 bytes} [Tue Sep 6 21:02:41 2022] GET /identity/v3/groups/3327522bc253425ea1de40ffe1daaac8 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:41.787657 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3565d-9e36-4330-a879-ff1d15addd54 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:41.886977 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70da60-ac58-425b-87a9-8cd88cfcbac1 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:41.898789 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:41.908814 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3565d-9e36-4330-a879-ff1d15addd54 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:41.930071 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199ec950-f281-434e-b804-6748c6c05c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:41.930321 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ec950-f281-434e-b804-6748c6c05c5d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:41.930487 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ec950-f281-434e-b804-6748c6c05c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:41.930786 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199ec950-f281-434e-b804-6748c6c05c5d None admin] PATH_INFO: `/v3/groups/3327522bc253425ea1de40ffe1daaac8` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:41.931917 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ec950-f281-434e-b804-6748c6c05c5d None admin] RBAC: Authorizing `identity:get_group(group_id=3327522bc253425ea1de40ffe1daaac8)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:41.933474 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199ec950-f281-434e-b804-6748c6c05c5d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:41.935062 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 187/356] 10.222.0.81 () {56 vars in 1180 bytes} [Tue Sep 6 21:02:41 2022] GET /identity/v3/groups/3327522bc253425ea1de40ffe1daaac8 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:41.936240 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375dbbf-e5b0-4c2a-8455-82e0ce725458 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:41.936531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375dbbf-e5b0-4c2a-8455-82e0ce725458 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:41.936804 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f375dbbf-e5b0-4c2a-8455-82e0ce725458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:41.949695 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94b6e4-166f-4d73-ba29-03e41bab4156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:41.950349 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94b6e4-166f-4d73-ba29-03e41bab4156 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:41.950628 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94b6e4-166f-4d73-ba29-03e41bab4156 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:41.950897 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94b6e4-166f-4d73-ba29-03e41bab4156 None admin] PATH_INFO: `/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:41.952070 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94b6e4-166f-4d73-ba29-03e41bab4156 None admin] RBAC: Authorizing `identity:get_project(project_id=d3beaaf3de6a4ec9857978f70d555f6a)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:41.953855 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94b6e4-166f-4d73-ba29-03e41bab4156 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:41.955790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 170/357] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:41 2022] GET /identity/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:41.956771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd2a8a-de05-4892-868b-1c0f8098d063 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:41.957149 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd2a8a-de05-4892-868b-1c0f8098d063 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:41.957423 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd2a8a-de05-4892-868b-1c0f8098d063 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:41.958751 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 171/358] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:41.958854 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f375dbbf-e5b0-4c2a-8455-82e0ce725458 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:41.963751 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd2a8a-de05-4892-868b-1c0f8098d063 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:41.963899 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f375dbbf-e5b0-4c2a-8455-82e0ce725458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:42.003331 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:42.044143 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 188/359] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:42.044143 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375dbbf-e5b0-4c2a-8455-82e0ce725458 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:42.108372 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd2a8a-de05-4892-868b-1c0f8098d063 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:42.154298 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9bd8b-ca41-4add-9409-4788e41586b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:42.155223 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9bd8b-ca41-4add-9409-4788e41586b4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:42.155647 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9bd8b-ca41-4add-9409-4788e41586b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:42.155929 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9bd8b-ca41-4add-9409-4788e41586b4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:42.171578 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9bd8b-ca41-4add-9409-4788e41586b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:42.176497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-96b9bd8b-ca41-4add-9409-4788e41586b4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 21:02:42.176497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:42.176497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:42.176497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:42.176497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:42.176497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:42.176497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:42.176497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:42.176497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:42.176497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:42.176497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:42.176497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:42.176497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:42.176497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:42.176497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:42.176497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:42.177492 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:42.177492 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:42.177492 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:42.177492 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:42.177492 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:42.177492 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:42.177492 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:42.177492 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:42.177492 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:42.177492 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:42.177492 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:42.177492 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:42.177492 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:42.177492 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:42.177492 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:42.177492 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:42.178343 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:42.178343 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:42.178343 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:42.178343 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:42.178343 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:42.178343 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:42.178343 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:42.178343 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:42.178343 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:42.178343 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:42.178343 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 06 21:02:42.178343 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:42.178343 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 172/360] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:42.178343 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9bd8b-ca41-4add-9409-4788e41586b4 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:42.184258 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f375dbbf-e5b0-4c2a-8455-82e0ce725458 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:42.214410 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:42.228652 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396bc47-2843-4a79-bd5b-84967047a5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:42.232940 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396bc47-2843-4a79-bd5b-84967047a5b6 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:42.232940 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396bc47-2843-4a79-bd5b-84967047a5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:42.232940 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396bc47-2843-4a79-bd5b-84967047a5b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:42.232940 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396bc47-2843-4a79-bd5b-84967047a5b6 None admin] RBAC: Adding query filter params (group.id=3327522bc253425ea1de40ffe1daaac8, role.id=be70fb8abf3148dda8e8e51be3a212e6, scope.project.id=d3beaaf3de6a4ec9857978f70d555f6a) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:42.232940 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396bc47-2843-4a79-bd5b-84967047a5b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:42.232940 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a396bc47-2843-4a79-bd5b-84967047a5b6 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:42.239455 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 189/361] 10.222.0.81 () {56 vars in 1376 bytes} [Tue Sep 6 21:02:42 2022] GET /identity/v3/role_assignments?group.id=3327522bc253425ea1de40ffe1daaac8&scope.project.id=d3beaaf3de6a4ec9857978f70d555f6a&role.id=be70fb8abf3148dda8e8e51be3a212e6 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:42.239708 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396bc47-2843-4a79-bd5b-84967047a5b6 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:42.291564 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:42.322369 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9bd8b-ca41-4add-9409-4788e41586b4 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:42.367720 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fbbb7c-0970-4f3f-806b-f5fc649db822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:42.368418 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbbb7c-0970-4f3f-806b-f5fc649db822 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:42.368701 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbbb7c-0970-4f3f-806b-f5fc649db822 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:42.368976 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fbbb7c-0970-4f3f-806b-f5fc649db822 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:42.369717 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fbbb7c-0970-4f3f-806b-f5fc649db822 None admin] RBAC: Adding query filter params (group.id=3327522bc253425ea1de40ffe1daaac8, role.id=be70fb8abf3148dda8e8e51be3a212e6, scope.project.id=b6011351cf9b462d964aff9e303a826d) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:42.370024 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fbbb7c-0970-4f3f-806b-f5fc649db822 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:42.371615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fbbb7c-0970-4f3f-806b-f5fc649db822 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:42.380118 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 173/362] 10.222.0.81 () {56 vars in 1376 bytes} [Tue Sep 6 21:02:42 2022] GET /identity/v3/role_assignments?group.id=3327522bc253425ea1de40ffe1daaac8&scope.project.id=b6011351cf9b462d964aff9e303a826d&role.id=be70fb8abf3148dda8e8e51be3a212e6 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:42.385457 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d506b8c-9e2b-4dbe-80e8-46afb55d2c1c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:42.385820 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d506b8c-9e2b-4dbe-80e8-46afb55d2c1c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:42.386013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d506b8c-9e2b-4dbe-80e8-46afb55d2c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:42.396615 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396bc47-2843-4a79-bd5b-84967047a5b6 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:42.422081 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-0d506b8c-9e2b-4dbe-80e8-46afb55d2c1c None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:42.424455 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0d506b8c-9e2b-4dbe-80e8-46afb55d2c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:42.450070 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93391563-b5a4-451a-9fe5-d9f042ea919d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:42.451378 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93391563-b5a4-451a-9fe5-d9f042ea919d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:42.451378 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93391563-b5a4-451a-9fe5-d9f042ea919d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:42.451378 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93391563-b5a4-451a-9fe5-d9f042ea919d None admin] PATH_INFO: `/v3/groups/3327522bc253425ea1de40ffe1daaac8` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:42.452678 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93391563-b5a4-451a-9fe5-d9f042ea919d None admin] RBAC: Authorizing `identity:get_group(group_id=3327522bc253425ea1de40ffe1daaac8)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:42.454179 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93391563-b5a4-451a-9fe5-d9f042ea919d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:42.460318 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 190/363] 10.222.0.81 () {56 vars in 1180 bytes} [Tue Sep 6 21:02:42 2022] GET /identity/v3/groups/3327522bc253425ea1de40ffe1daaac8 => generated 226 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:42.460318 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93391563-b5a4-451a-9fe5-d9f042ea919d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:42.526380 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 174/364] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:42.527289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d506b8c-9e2b-4dbe-80e8-46afb55d2c1c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:42.547113 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:42.612863 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93391563-b5a4-451a-9fe5-d9f042ea919d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:42.616786 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:42.654170 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520eb4df-1152-497f-90df-f92e0f6656aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:42.655497 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520eb4df-1152-497f-90df-f92e0f6656aa None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:42.656043 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520eb4df-1152-497f-90df-f92e0f6656aa None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:42.656985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520eb4df-1152-497f-90df-f92e0f6656aa None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:42.657491 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520eb4df-1152-497f-90df-f92e0f6656aa None admin] RBAC: Adding query filter params (name=reader) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:42.658165 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520eb4df-1152-497f-90df-f92e0f6656aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:42.660031 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520eb4df-1152-497f-90df-f92e0f6656aa None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:42.661004 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d506b8c-9e2b-4dbe-80e8-46afb55d2c1c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:42.670590 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 191/365] 10.222.0.81 () {56 vars in 1101 bytes} [Tue Sep 6 21:02:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:42.671441 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520eb4df-1152-497f-90df-f92e0f6656aa None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:42.720063 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40377088-a9ef-41b1-81f3-0300967897f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:42.721110 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40377088-a9ef-41b1-81f3-0300967897f8 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:42.721619 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40377088-a9ef-41b1-81f3-0300967897f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:42.722091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40377088-a9ef-41b1-81f3-0300967897f8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:42.737153 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40377088-a9ef-41b1-81f3-0300967897f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:42.745091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-40377088-a9ef-41b1-81f3-0300967897f8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 21:02:42.745091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:42.745091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:42.745091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:42.745091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:42.745091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:42.745091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:42.745091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:42.745091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:42.745091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:42.745091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:42.745091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:42.745091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:42.745091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:42.745091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:42.745091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:42.746007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:42.746007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:42.746007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:42.746007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:42.746007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:42.746007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:42.746007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:42.746007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:42.746007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:42.746007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:42.746007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:42.746007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:42.746007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:42.746007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:42.746007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:42.746007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:42.746815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:42.746815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:42.746815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:42.746815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:42.746815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:42.746815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:42.746815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:42.746815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:42.746815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:42.746815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:42.746815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 21:02:42.746815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:42.749686 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 175/366] 10.222.0.81 () {56 vars in 1114 bytes} [Tue Sep 6 21:02:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:42.751383 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40377088-a9ef-41b1-81f3-0300967897f8 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:42.795274 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520eb4df-1152-497f-90df-f92e0f6656aa None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:42.837357 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239c267-a5d9-458c-8e9d-ee2b03d14e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:42.837837 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239c267-a5d9-458c-8e9d-ee2b03d14e4d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:42.838116 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239c267-a5d9-458c-8e9d-ee2b03d14e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:42.838383 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239c267-a5d9-458c-8e9d-ee2b03d14e4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:42.839161 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239c267-a5d9-458c-8e9d-ee2b03d14e4d None admin] RBAC: Adding query filter params (group.id=3327522bc253425ea1de40ffe1daaac8, role.id=c1dd3aa5113d434ab8306e2453a5ba6a, scope.project.id=d3beaaf3de6a4ec9857978f70d555f6a) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:42.839463 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239c267-a5d9-458c-8e9d-ee2b03d14e4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:42.840979 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239c267-a5d9-458c-8e9d-ee2b03d14e4d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:42.852151 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 192/367] 10.222.0.81 () {56 vars in 1376 bytes} [Tue Sep 6 21:02:42 2022] GET /identity/v3/role_assignments?group.id=3327522bc253425ea1de40ffe1daaac8&scope.project.id=d3beaaf3de6a4ec9857978f70d555f6a&role.id=c1dd3aa5113d434ab8306e2453a5ba6a => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:42.852151 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239c267-a5d9-458c-8e9d-ee2b03d14e4d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:42.873504 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:42.926902 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:42.929287 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40377088-a9ef-41b1-81f3-0300967897f8 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:43.008007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef51cb-c86c-41d0-84bb-eaa31b360be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:43.008842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef51cb-c86c-41d0-84bb-eaa31b360be3 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:43.009124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef51cb-c86c-41d0-84bb-eaa31b360be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:43.009397 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef51cb-c86c-41d0-84bb-eaa31b360be3 None admin] PATH_INFO: `/v3/users/5c20af6b17c14c3ca57dbee5ca4f94dc` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:43.011678 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef51cb-c86c-41d0-84bb-eaa31b360be3 None admin] RBAC: Authorizing `identity:get_user(user_id=5c20af6b17c14c3ca57dbee5ca4f94dc)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:43.013177 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef51cb-c86c-41d0-84bb-eaa31b360be3 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:43.014826 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 176/368] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:02:42 2022] GET /identity/v3/users/5c20af6b17c14c3ca57dbee5ca4f94dc => generated 293 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:43.015607 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef51cb-c86c-41d0-84bb-eaa31b360be3 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:43.087348 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239c267-a5d9-458c-8e9d-ee2b03d14e4d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:43.153646 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17041a-280b-4ad7-bc8a-d6f65a1df9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:43.154268 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17041a-280b-4ad7-bc8a-d6f65a1df9ec None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:43.154547 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17041a-280b-4ad7-bc8a-d6f65a1df9ec None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:43.155299 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17041a-280b-4ad7-bc8a-d6f65a1df9ec None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:43.155974 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17041a-280b-4ad7-bc8a-d6f65a1df9ec None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:43.156307 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17041a-280b-4ad7-bc8a-d6f65a1df9ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:43.157692 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17041a-280b-4ad7-bc8a-d6f65a1df9ec None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:43.170000 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 193/369] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:02:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:43.170876 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17041a-280b-4ad7-bc8a-d6f65a1df9ec None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:43.204933 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef51cb-c86c-41d0-84bb-eaa31b360be3 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:43.281864 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd5470-349b-4439-9f80-9e83ca7472da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:43.282519 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd5470-349b-4439-9f80-9e83ca7472da None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:43.282796 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd5470-349b-4439-9f80-9e83ca7472da None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:43.283068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd5470-349b-4439-9f80-9e83ca7472da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:43.292001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:43.305152 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17041a-280b-4ad7-bc8a-d6f65a1df9ec None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:43.313047 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd5470-349b-4439-9f80-9e83ca7472da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:43.317966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-6ddd5470-349b-4439-9f80-9e83ca7472da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:02:43.317966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:43.317966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:43.317966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:43.317966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:43.317966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:43.317966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:43.317966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:43.317966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:43.317966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:43.317966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:43.317966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:43.317966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:43.317966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:43.317966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:43.317966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:43.318890 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:43.318890 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:43.318890 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:43.318890 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:43.318890 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:43.318890 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:43.318890 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:43.318890 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:43.318890 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:43.318890 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:43.318890 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:43.318890 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:43.318890 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:43.318890 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:43.318890 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:43.318890 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:43.319697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:43.319697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:43.319697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:43.319697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:43.319697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:43.319697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:43.319697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:43.319697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:43.319697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:43.319697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:43.319697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:02:43.319697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:43.319697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 177/370] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:02:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:43.320405 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd5470-349b-4439-9f80-9e83ca7472da None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:43.323713 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:43.370908 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0dc9b3-9561-4f97-9508-83eb9863e9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:43.371531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0dc9b3-9561-4f97-9508-83eb9863e9dd None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:43.371809 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0dc9b3-9561-4f97-9508-83eb9863e9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:43.372080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0dc9b3-9561-4f97-9508-83eb9863e9dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:43.373619 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0dc9b3-9561-4f97-9508-83eb9863e9dd None admin] RBAC: Adding query filter params (role.id=c45e700ef009486aa6e596465c62a5f1, user.id=5c20af6b17c14c3ca57dbee5ca4f94dc, scope.system=all) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:43.373936 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0dc9b3-9561-4f97-9508-83eb9863e9dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:43.375500 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0dc9b3-9561-4f97-9508-83eb9863e9dd None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:43.406372 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 194/371] 10.222.0.81 () {56 vars in 1308 bytes} [Tue Sep 6 21:02:43 2022] GET /identity/v3/role_assignments?user.id=5c20af6b17c14c3ca57dbee5ca4f94dc&scope.system=all&role.id=c45e700ef009486aa6e596465c62a5f1 => generated 510 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:43.407075 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0dc9b3-9561-4f97-9508-83eb9863e9dd None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:43.548797 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd5470-349b-4439-9f80-9e83ca7472da None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:43.616330 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fa7e1-3037-456d-a1f3-dd4df6c628c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:43.617394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fa7e1-3037-456d-a1f3-dd4df6c628c2 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:43.618407 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fa7e1-3037-456d-a1f3-dd4df6c628c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:43.618887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2fa7e1-3037-456d-a1f3-dd4df6c628c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:43.648526 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0dc9b3-9561-4f97-9508-83eb9863e9dd None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:43.737011 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2fa7e1-3037-456d-a1f3-dd4df6c628c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:43.739171 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2fa7e1-3037-456d-a1f3-dd4df6c628c2 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:43.745968 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4d584-cad7-4ebc-a51c-63ed8913e385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:43.746615 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4d584-cad7-4ebc-a51c-63ed8913e385 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:43.746897 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4d584-cad7-4ebc-a51c-63ed8913e385 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:43.747172 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4d584-cad7-4ebc-a51c-63ed8913e385 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:43.747853 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e4d584-cad7-4ebc-a51c-63ed8913e385 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:43.748983 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e4d584-cad7-4ebc-a51c-63ed8913e385 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:43.749591 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e4d584-cad7-4ebc-a51c-63ed8913e385 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:43.764293 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 195/372] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:43.765884 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:43.772050 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4d584-cad7-4ebc-a51c-63ed8913e385 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:43.810885 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:43.890334 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 178/373] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:02:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 21:02:43.896041 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fa7e1-3037-456d-a1f3-dd4df6c628c2 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:43.909157 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4d584-cad7-4ebc-a51c-63ed8913e385 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:43.951401 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722b866-be9a-41b8-afff-2c291da53399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:43.952545 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722b866-be9a-41b8-afff-2c291da53399 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:43.953080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722b866-be9a-41b8-afff-2c291da53399 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:43.953573 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722b866-be9a-41b8-afff-2c291da53399 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:44.033948 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2fa7e1-3037-456d-a1f3-dd4df6c628c2 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:44.034762 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0722b866-be9a-41b8-afff-2c291da53399 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:44.035549 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:44.037612 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0722b866-be9a-41b8-afff-2c291da53399 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:44.053672 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:44.076251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334081e6-b025-4dda-95f0-010a52abd3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:44.076807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334081e6-b025-4dda-95f0-010a52abd3ff None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:44.077087 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334081e6-b025-4dda-95f0-010a52abd3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:44.077361 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334081e6-b025-4dda-95f0-010a52abd3ff None admin] PATH_INFO: `/v3/projects/b6011351cf9b462d964aff9e303a826d` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:44.078780 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334081e6-b025-4dda-95f0-010a52abd3ff None admin] RBAC: Authorizing `identity:get_project(project_id=b6011351cf9b462d964aff9e303a826d)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:44.079978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334081e6-b025-4dda-95f0-010a52abd3ff None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:44.081968 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 179/374] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:43 2022] GET /identity/v3/projects/b6011351cf9b462d964aff9e303a826d => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:44.087294 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334081e6-b025-4dda-95f0-010a52abd3ff None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:44.155807 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 196/375] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:02:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 21:02:44.161829 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722b866-be9a-41b8-afff-2c291da53399 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:44.199429 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334081e6-b025-4dda-95f0-010a52abd3ff None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:44.237793 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa47c09-de7d-44d0-a2ee-d0221f9c8fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:44.238575 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa47c09-de7d-44d0-a2ee-d0221f9c8fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:44.238953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa47c09-de7d-44d0-a2ee-d0221f9c8fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:44.239317 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa47c09-de7d-44d0-a2ee-d0221f9c8fa9 None admin] PATH_INFO: `/v3/groups/3327522bc253425ea1de40ffe1daaac8` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:44.240550 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa47c09-de7d-44d0-a2ee-d0221f9c8fa9 None admin] RBAC: Authorizing `identity:get_group(group_id=3327522bc253425ea1de40ffe1daaac8)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:44.242083 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa47c09-de7d-44d0-a2ee-d0221f9c8fa9 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:44.244803 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 180/376] 10.222.0.81 () {56 vars in 1180 bytes} [Tue Sep 6 21:02:44 2022] GET /identity/v3/groups/3327522bc253425ea1de40ffe1daaac8 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:44.250349 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa47c09-de7d-44d0-a2ee-d0221f9c8fa9 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:44.294135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:44.294618 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722b866-be9a-41b8-afff-2c291da53399 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:44.309474 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:44.338315 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c92f9-9e0a-4774-b312-4ecefda07425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:44.338891 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c92f9-9e0a-4774-b312-4ecefda07425 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:44.339170 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c92f9-9e0a-4774-b312-4ecefda07425 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:44.339443 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48c92f9-9e0a-4774-b312-4ecefda07425 None admin] PATH_INFO: `/v3/projects/1e0790087f9147d99a7f175c2c23386d` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:44.340605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c92f9-9e0a-4774-b312-4ecefda07425 None admin] RBAC: Authorizing `identity:get_project(project_id=1e0790087f9147d99a7f175c2c23386d)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:44.342063 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48c92f9-9e0a-4774-b312-4ecefda07425 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:44.344029 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 197/377] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:44 2022] GET /identity/v3/projects/1e0790087f9147d99a7f175c2c23386d => generated 344 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:44.349438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c92f9-9e0a-4774-b312-4ecefda07425 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:44.362476 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa47c09-de7d-44d0-a2ee-d0221f9c8fa9 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:44.399694 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac39d18-00e1-487e-999b-c3de5e0ee622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:44.400333 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac39d18-00e1-487e-999b-c3de5e0ee622 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:44.400649 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac39d18-00e1-487e-999b-c3de5e0ee622 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:44.401009 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac39d18-00e1-487e-999b-c3de5e0ee622 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:44.401822 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac39d18-00e1-487e-999b-c3de5e0ee622 None admin] RBAC: Adding query filter params (group.id=3327522bc253425ea1de40ffe1daaac8, role.id=c1dd3aa5113d434ab8306e2453a5ba6a, scope.project.id=b6011351cf9b462d964aff9e303a826d) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:44.402134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac39d18-00e1-487e-999b-c3de5e0ee622 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:44.403562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac39d18-00e1-487e-999b-c3de5e0ee622 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:44.409424 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 181/378] 10.222.0.81 () {56 vars in 1376 bytes} [Tue Sep 6 21:02:44 2022] GET /identity/v3/role_assignments?group.id=3327522bc253425ea1de40ffe1daaac8&scope.project.id=b6011351cf9b462d964aff9e303a826d&role.id=c1dd3aa5113d434ab8306e2453a5ba6a => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:44.518378 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48c92f9-9e0a-4774-b312-4ecefda07425 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:44.565189 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4132385-348c-4b03-9533-532eae83facb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:44.565856 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4132385-348c-4b03-9533-532eae83facb None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:44.566207 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4132385-348c-4b03-9533-532eae83facb None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:44.566488 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4132385-348c-4b03-9533-532eae83facb None admin] PATH_INFO: `/v3/groups/c5c59943377940ceaec89709daa89e27` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:44.577248 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4132385-348c-4b03-9533-532eae83facb None admin] RBAC: Authorizing `identity:get_group(group_id=c5c59943377940ceaec89709daa89e27)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:44.578741 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4132385-348c-4b03-9533-532eae83facb None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:44.580497 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 198/379] 10.222.0.81 () {56 vars in 1180 bytes} [Tue Sep 6 21:02:44 2022] GET /identity/v3/groups/c5c59943377940ceaec89709daa89e27 => generated 229 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:44.587303 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac39d18-00e1-487e-999b-c3de5e0ee622 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:44.722089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac39d18-00e1-487e-999b-c3de5e0ee622 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:44.723550 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:44.757527 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31600445-de75-4603-8e0a-22c64381027a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:44.758148 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31600445-de75-4603-8e0a-22c64381027a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:44.758954 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31600445-de75-4603-8e0a-22c64381027a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:44.759231 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31600445-de75-4603-8e0a-22c64381027a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:44.760144 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31600445-de75-4603-8e0a-22c64381027a None admin] RBAC: Adding query filter params (group.id=c5c59943377940ceaec89709daa89e27, role.id=fe9661f095094dd0931e0b96a1d6ef74, scope.project.id=1e0790087f9147d99a7f175c2c23386d) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:44.760461 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31600445-de75-4603-8e0a-22c64381027a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:44.761889 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31600445-de75-4603-8e0a-22c64381027a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:44.768390 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 182/380] 10.222.0.81 () {56 vars in 1376 bytes} [Tue Sep 6 21:02:44 2022] GET /identity/v3/role_assignments?group.id=c5c59943377940ceaec89709daa89e27&scope.project.id=1e0790087f9147d99a7f175c2c23386d&role.id=fe9661f095094dd0931e0b96a1d6ef74 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:45.163491 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b85730-f782-45ef-a06f-988fc51759e3 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:45.164009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b85730-f782-45ef-a06f-988fc51759e3 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:45.164009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b85730-f782-45ef-a06f-988fc51759e3 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:45.165568 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 199/381] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:45.171148 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdf420-be21-4d2d-86a2-da9f0148957f None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:45.171700 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdf420-be21-4d2d-86a2-da9f0148957f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:45.172227 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdf420-be21-4d2d-86a2-da9f0148957f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:45.196941 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-85fdf420-be21-4d2d-86a2-da9f0148957f None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:45.198485 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-85fdf420-be21-4d2d-86a2-da9f0148957f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:45.278653 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 183/382] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:45.560487 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b85730-f782-45ef-a06f-988fc51759e3 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:45.581237 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b62b5-54e0-4b81-9bf9-1beb63d554de None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:45.582197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b62b5-54e0-4b81-9bf9-1beb63d554de None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:45.582685 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b62b5-54e0-4b81-9bf9-1beb63d554de None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:45.584506 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 184/383] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:45.590744 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a46e5-e7d6-44ab-8999-76f6a16f7aff None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:45.591310 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a46e5-e7d6-44ab-8999-76f6a16f7aff None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:45.591778 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a46e5-e7d6-44ab-8999-76f6a16f7aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:45.612128 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-dc5a46e5-e7d6-44ab-8999-76f6a16f7aff None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:45.613657 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-dc5a46e5-e7d6-44ab-8999-76f6a16f7aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:45.618714 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:45.739069 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b85730-f782-45ef-a06f-988fc51759e3 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:45.745737 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 185/384] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:45.777949 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5133de-2192-4104-8b59-152de18c141c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:45.778597 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5133de-2192-4104-8b59-152de18c141c None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:45.778959 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5133de-2192-4104-8b59-152de18c141c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:45.779217 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5133de-2192-4104-8b59-152de18c141c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:45.793019 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5133de-2192-4104-8b59-152de18c141c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:45.798578 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-4a5133de-2192-4104-8b59-152de18c141c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:45.798578 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:45.798578 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:45.798578 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:45.798578 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:45.798578 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:45.798578 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:45.798578 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:45.798578 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:45.798578 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:45.798578 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:45.798578 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:45.798578 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:45.798578 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:45.798578 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:45.798578 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:45.799536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:45.799536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:45.799536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:45.799536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:45.799536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:45.799536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:45.799536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:45.799536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:45.799536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:45.799536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:45.799536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:45.799536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:45.799536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:45.799536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:45.799536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:45.799536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:45.800411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:45.800411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:45.800411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:45.800411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:45.800411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:45.800411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:45.800411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:45.800411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:45.800411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:45.800411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:45.800411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:45.800411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:02:45.800411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 200/385] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:45.806676 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a46e5-e7d6-44ab-8999-76f6a16f7aff None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:45.836834 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:45.843380 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8465b2-4f67-49f6-b358-937ec8f292b6 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:45.843681 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8465b2-4f67-49f6-b358-937ec8f292b6 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:45.843929 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8465b2-4f67-49f6-b358-937ec8f292b6 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:45.845780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 201/386] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:45.856660 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298ffab-75c9-4af6-bb19-9063022627b7 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:45.856660 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298ffab-75c9-4af6-bb19-9063022627b7 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:45.856660 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298ffab-75c9-4af6-bb19-9063022627b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:45.881297 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-0298ffab-75c9-4af6-bb19-9063022627b7 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:45.882530 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-0298ffab-75c9-4af6-bb19-9063022627b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:45.989232 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a46e5-e7d6-44ab-8999-76f6a16f7aff None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:46.023100 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 202/387] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:46.043327 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda848f8-2eba-4f8f-add3-461dbc10857f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:46.044314 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda848f8-2eba-4f8f-add3-461dbc10857f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:46.044804 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda848f8-2eba-4f8f-add3-461dbc10857f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:46.045285 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda848f8-2eba-4f8f-add3-461dbc10857f None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:46.046137 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda848f8-2eba-4f8f-add3-461dbc10857f None admin] RBAC: Adding query filter params (name=member) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:46.046653 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda848f8-2eba-4f8f-add3-461dbc10857f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:46.048238 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda848f8-2eba-4f8f-add3-461dbc10857f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:46.057970 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 186/388] 10.222.0.81 () {56 vars in 1101 bytes} [Tue Sep 6 21:02:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:46.064138 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298ffab-75c9-4af6-bb19-9063022627b7 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:46.113335 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda848f8-2eba-4f8f-add3-461dbc10857f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:46.128981 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:46.204668 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298ffab-75c9-4af6-bb19-9063022627b7 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:46.236934 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:46.250826 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda848f8-2eba-4f8f-add3-461dbc10857f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:46.254236 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cca41a-ec4b-4ebd-9f46-d784beac9209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:46.255125 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cca41a-ec4b-4ebd-9f46-d784beac9209 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:46.255600 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cca41a-ec4b-4ebd-9f46-d784beac9209 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:46.256047 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cca41a-ec4b-4ebd-9f46-d784beac9209 None admin] PATH_INFO: `/v3/groups/3327522bc253425ea1de40ffe1daaac8` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:46.260861 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cca41a-ec4b-4ebd-9f46-d784beac9209 None admin] RBAC: Authorizing `identity:get_group(group_id=3327522bc253425ea1de40ffe1daaac8)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:46.262669 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cca41a-ec4b-4ebd-9f46-d784beac9209 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:46.264551 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 203/389] 10.222.0.81 () {56 vars in 1180 bytes} [Tue Sep 6 21:02:46 2022] GET /identity/v3/groups/3327522bc253425ea1de40ffe1daaac8 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:46.270478 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cca41a-ec4b-4ebd-9f46-d784beac9209 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:46.291638 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59caaa9d-9da9-4395-99a1-8b405f53d159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:46.292404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59caaa9d-9da9-4395-99a1-8b405f53d159 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:46.292772 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59caaa9d-9da9-4395-99a1-8b405f53d159 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:46.293113 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59caaa9d-9da9-4395-99a1-8b405f53d159 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:46.304528 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59caaa9d-9da9-4395-99a1-8b405f53d159 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:46.310570 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-59caaa9d-9da9-4395-99a1-8b405f53d159 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:46.310570 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:46.310570 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:46.310570 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:46.310570 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:46.310570 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:46.310570 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:46.310570 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:46.310570 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:46.310570 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:46.310570 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:46.310570 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:46.310570 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:46.310570 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:46.310570 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:46.310570 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:46.311611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:46.311611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:46.311611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:46.311611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:46.311611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:46.311611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:46.311611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:46.311611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:46.311611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:46.311611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:46.311611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:46.311611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:46.311611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:46.311611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:46.311611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:46.311611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:46.316572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:46.316572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:46.316572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:46.316572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:46.316572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:46.316572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:46.316572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:46.316572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:46.316572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:46.316572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:46.316572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:46.316572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:46.316572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 187/390] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:46.333170 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59caaa9d-9da9-4395-99a1-8b405f53d159 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:46.425049 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cca41a-ec4b-4ebd-9f46-d784beac9209 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:46.428434 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:46.471722 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59caaa9d-9da9-4395-99a1-8b405f53d159 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:46.483969 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b200ff-b4a0-4f44-8c59-69625401f89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:46.484641 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b200ff-b4a0-4f44-8c59-69625401f89c None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:46.484919 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b200ff-b4a0-4f44-8c59-69625401f89c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:46.485186 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b200ff-b4a0-4f44-8c59-69625401f89c None admin] PATH_INFO: `/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:46.486346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b200ff-b4a0-4f44-8c59-69625401f89c None admin] RBAC: Authorizing `identity:get_project(project_id=d3beaaf3de6a4ec9857978f70d555f6a)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:46.487775 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b200ff-b4a0-4f44-8c59-69625401f89c None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:46.489426 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 204/391] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:46 2022] GET /identity/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:46.495765 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b200ff-b4a0-4f44-8c59-69625401f89c None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:46.526034 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019e2de-d6bd-4fe9-a0c5-ee217e6b0ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:46.526645 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019e2de-d6bd-4fe9-a0c5-ee217e6b0ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:46.526924 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019e2de-d6bd-4fe9-a0c5-ee217e6b0ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:46.527194 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f019e2de-d6bd-4fe9-a0c5-ee217e6b0ae1 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:46.527856 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019e2de-d6bd-4fe9-a0c5-ee217e6b0ae1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:46.528185 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019e2de-d6bd-4fe9-a0c5-ee217e6b0ae1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:46.529543 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f019e2de-d6bd-4fe9-a0c5-ee217e6b0ae1 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:46.538804 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 188/392] 10.222.0.81 () {56 vars in 1101 bytes} [Tue Sep 6 21:02:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:46.542636 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019e2de-d6bd-4fe9-a0c5-ee217e6b0ae1 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:46.556046 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:46.643270 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b200ff-b4a0-4f44-8c59-69625401f89c None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:46.661624 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f019e2de-d6bd-4fe9-a0c5-ee217e6b0ae1 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:46.692510 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55ca5b-7a45-46c8-a213-f9c2d4c068bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:46.694589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55ca5b-7a45-46c8-a213-f9c2d4c068bf None admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:46.695340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55ca5b-7a45-46c8-a213-f9c2d4c068bf None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:46.696194 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb55ca5b-7a45-46c8-a213-f9c2d4c068bf None admin] PATH_INFO: `/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a/groups/3327522bc253425ea1de40ffe1daaac8/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:46.698729 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55ca5b-7a45-46c8-a213-f9c2d4c068bf None admin] RBAC: Authorizing `identity:create_grant(project_id=d3beaaf3de6a4ec9857978f70d555f6a, group_id=3327522bc253425ea1de40ffe1daaac8, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:46.700486 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb55ca5b-7a45-46c8-a213-f9c2d4c068bf None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:46.701582 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a3aac-843e-407a-9f7f-a85c677c118b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:46.702223 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a3aac-843e-407a-9f7f-a85c677c118b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:46.702501 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a3aac-843e-407a-9f7f-a85c677c118b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:46.702772 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14a3aac-843e-407a-9f7f-a85c677c118b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:46.719374 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14a3aac-843e-407a-9f7f-a85c677c118b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:46.725479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-e14a3aac-843e-407a-9f7f-a85c677c118b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 21:02:46.725479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:46.725479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:46.725479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:46.725479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:46.725479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:46.725479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:46.725479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:46.725479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:46.725479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:46.725479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:46.725479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:46.725479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:46.725479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:46.725479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:46.725479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:46.731244 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:46.731244 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:46.731244 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:46.731244 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:46.731244 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:46.731244 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:46.731244 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:46.731244 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:46.731244 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:46.731244 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:46.731244 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:46.731244 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:46.731244 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:46.731244 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:46.731244 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:46.731244 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:46.732514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:46.732514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:46.732514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:46.732514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:46.732514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:46.732514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:46.732514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:46.732514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:46.732514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:46.732514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:46.732514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 21:02:46.732514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:46.732514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 189/393] 10.222.0.81 () {56 vars in 1114 bytes} [Tue Sep 6 21:02:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:46.732514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a3aac-843e-407a-9f7f-a85c677c118b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:46.800869 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 205/394] 10.222.0.81 () {58 vars in 1442 bytes} [Tue Sep 6 21:02:46 2022] PUT /identity/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a/groups/3327522bc253425ea1de40ffe1daaac8/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:02:46.802095 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55ca5b-7a45-46c8-a213-f9c2d4c068bf None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:46.808984 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:46.838389 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:46.846446 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14a3aac-843e-407a-9f7f-a85c677c118b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:46.894141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e40357-751e-4cdb-aa14-fabcc035df13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:46.894852 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e40357-751e-4cdb-aa14-fabcc035df13 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:46.895139 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e40357-751e-4cdb-aa14-fabcc035df13 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:46.895415 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e40357-751e-4cdb-aa14-fabcc035df13 None admin] PATH_INFO: `/v3/groups/3327522bc253425ea1de40ffe1daaac8` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:46.900936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e40357-751e-4cdb-aa14-fabcc035df13 None admin] RBAC: Authorizing `identity:get_group(group_id=3327522bc253425ea1de40ffe1daaac8)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:46.902583 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e40357-751e-4cdb-aa14-fabcc035df13 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:46.904685 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 190/395] 10.222.0.81 () {56 vars in 1180 bytes} [Tue Sep 6 21:02:46 2022] GET /identity/v3/groups/3327522bc253425ea1de40ffe1daaac8 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:46.910380 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e40357-751e-4cdb-aa14-fabcc035df13 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:46.924047 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb55ca5b-7a45-46c8-a213-f9c2d4c068bf None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:46.964216 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097106a-02e5-4159-be6c-337a1c16d36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:46.965181 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097106a-02e5-4159-be6c-337a1c16d36a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:46.965654 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097106a-02e5-4159-be6c-337a1c16d36a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:46.966150 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097106a-02e5-4159-be6c-337a1c16d36a None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:46.967050 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5097106a-02e5-4159-be6c-337a1c16d36a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:46.967582 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5097106a-02e5-4159-be6c-337a1c16d36a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:46.969948 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5097106a-02e5-4159-be6c-337a1c16d36a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:46.981545 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 206/396] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:02:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:46.990169 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097106a-02e5-4159-be6c-337a1c16d36a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:47.111681 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e40357-751e-4cdb-aa14-fabcc035df13 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:47.150165 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:47.151867 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b259a-288a-466f-9669-571c44059b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:47.152887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b259a-288a-466f-9669-571c44059b0d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:47.153379 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b259a-288a-466f-9669-571c44059b0d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:47.153861 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b259a-288a-466f-9669-571c44059b0d None admin] PATH_INFO: `/v3/projects/b6011351cf9b462d964aff9e303a826d` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:47.155233 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b259a-288a-466f-9669-571c44059b0d None admin] RBAC: Authorizing `identity:get_project(project_id=b6011351cf9b462d964aff9e303a826d)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:47.156877 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b259a-288a-466f-9669-571c44059b0d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:47.158990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 191/397] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:46 2022] GET /identity/v3/projects/b6011351cf9b462d964aff9e303a826d => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:47.160537 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097106a-02e5-4159-be6c-337a1c16d36a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:47.165298 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b259a-288a-466f-9669-571c44059b0d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:47.196509 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:47.202576 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc45b7a-c230-45e2-beb2-b74c9923b3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:47.203513 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc45b7a-c230-45e2-beb2-b74c9923b3af None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:47.203799 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc45b7a-c230-45e2-beb2-b74c9923b3af None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:47.204072 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc45b7a-c230-45e2-beb2-b74c9923b3af None admin] PATH_INFO: `/v3/groups/3327522bc253425ea1de40ffe1daaac8` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:47.205255 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc45b7a-c230-45e2-beb2-b74c9923b3af None admin] RBAC: Authorizing `identity:get_group(group_id=3327522bc253425ea1de40ffe1daaac8)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:47.206701 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc45b7a-c230-45e2-beb2-b74c9923b3af None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:47.212442 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 207/398] 10.222.0.81 () {56 vars in 1180 bytes} [Tue Sep 6 21:02:46 2022] GET /identity/v3/groups/3327522bc253425ea1de40ffe1daaac8 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:47.225246 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc45b7a-c230-45e2-beb2-b74c9923b3af None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:47.278099 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b259a-288a-466f-9669-571c44059b0d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:47.316509 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9ac8d-24fc-4a59-8fc2-a5d0b40064b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:47.317177 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9ac8d-24fc-4a59-8fc2-a5d0b40064b6 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:47.317458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9ac8d-24fc-4a59-8fc2-a5d0b40064b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:47.317819 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9ac8d-24fc-4a59-8fc2-a5d0b40064b6 None admin] PATH_INFO: `/v3/projects/b6011351cf9b462d964aff9e303a826d/groups/3327522bc253425ea1de40ffe1daaac8/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:47.320006 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9ac8d-24fc-4a59-8fc2-a5d0b40064b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=b6011351cf9b462d964aff9e303a826d, group_id=3327522bc253425ea1de40ffe1daaac8, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:47.321492 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc45b7a-c230-45e2-beb2-b74c9923b3af None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:47.321616 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e9ac8d-24fc-4a59-8fc2-a5d0b40064b6 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:47.368336 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86eb31d-9837-4a3a-a4d7-7ca6a0cd1006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:47.369039 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86eb31d-9837-4a3a-a4d7-7ca6a0cd1006 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:47.369521 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86eb31d-9837-4a3a-a4d7-7ca6a0cd1006 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:47.369808 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86eb31d-9837-4a3a-a4d7-7ca6a0cd1006 None admin] PATH_INFO: `/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:47.371142 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86eb31d-9837-4a3a-a4d7-7ca6a0cd1006 None admin] RBAC: Authorizing `identity:get_project(project_id=d3beaaf3de6a4ec9857978f70d555f6a)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:47.372734 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86eb31d-9837-4a3a-a4d7-7ca6a0cd1006 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:47.374962 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 208/399] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:47 2022] GET /identity/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:47.380273 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86eb31d-9837-4a3a-a4d7-7ca6a0cd1006 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:47.409787 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 192/400] 10.222.0.81 () {58 vars in 1442 bytes} [Tue Sep 6 21:02:47 2022] PUT /identity/v3/projects/b6011351cf9b462d964aff9e303a826d/groups/3327522bc253425ea1de40ffe1daaac8/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:02:47.428209 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:47.510345 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d11eb-5d3e-4709-9d1b-df00360a86a7 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:47.510535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d11eb-5d3e-4709-9d1b-df00360a86a7 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:47.510811 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d11eb-5d3e-4709-9d1b-df00360a86a7 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:47.512428 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 193/401] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:47.517633 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71973f30-94ac-467e-babe-bfe761846bfe None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:47.517941 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71973f30-94ac-467e-babe-bfe761846bfe None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:47.518191 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71973f30-94ac-467e-babe-bfe761846bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:47.530760 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86eb31d-9837-4a3a-a4d7-7ca6a0cd1006 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:47.556734 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-71973f30-94ac-467e-babe-bfe761846bfe None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:47.557947 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-71973f30-94ac-467e-babe-bfe761846bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:47.575942 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56317c34-a78e-4fd4-9060-b49eb6274049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:47.576655 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56317c34-a78e-4fd4-9060-b49eb6274049 None admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:47.576935 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56317c34-a78e-4fd4-9060-b49eb6274049 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:47.577266 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56317c34-a78e-4fd4-9060-b49eb6274049 None admin] PATH_INFO: `/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a/groups/3327522bc253425ea1de40ffe1daaac8/roles/c1dd3aa5113d434ab8306e2453a5ba6a` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:47.579751 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56317c34-a78e-4fd4-9060-b49eb6274049 None admin] RBAC: Authorizing `identity:create_grant(project_id=d3beaaf3de6a4ec9857978f70d555f6a, group_id=3327522bc253425ea1de40ffe1daaac8, role_id=c1dd3aa5113d434ab8306e2453a5ba6a)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:47.581328 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56317c34-a78e-4fd4-9060-b49eb6274049 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:47.645614 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:47.654873 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 194/402] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 21:02:47.695580 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 209/403] 10.222.0.81 () {58 vars in 1442 bytes} [Tue Sep 6 21:02:47 2022] PUT /identity/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a/groups/3327522bc253425ea1de40ffe1daaac8/roles/c1dd3aa5113d434ab8306e2453a5ba6a => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:02:47.867883 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563c47e-2b37-4666-a497-db0c4ea67fad None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:47.868468 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563c47e-2b37-4666-a497-db0c4ea67fad None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:47.868468 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563c47e-2b37-4666-a497-db0c4ea67fad None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:47.870261 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 195/404] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:47.875696 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23358be-a406-4c5d-aac2-9a288db478b3 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:47.875977 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23358be-a406-4c5d-aac2-9a288db478b3 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:47.876285 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23358be-a406-4c5d-aac2-9a288db478b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:47.900781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-a23358be-a406-4c5d-aac2-9a288db478b3 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:47.902072 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a23358be-a406-4c5d-aac2-9a288db478b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:47.960492 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9563c47e-2b37-4666-a497-db0c4ea67fad None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:47.977426 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 210/405] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:48.094655 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9563c47e-2b37-4666-a497-db0c4ea67fad None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:48.130978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf875f0a-b17c-40c9-860d-2cd715aae582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:48.131959 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf875f0a-b17c-40c9-860d-2cd715aae582 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:48.132469 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf875f0a-b17c-40c9-860d-2cd715aae582 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:48.132946 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf875f0a-b17c-40c9-860d-2cd715aae582 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:48.144744 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf875f0a-b17c-40c9-860d-2cd715aae582 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:48.150612 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-bf875f0a-b17c-40c9-860d-2cd715aae582 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 21:02:48.150612 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:48.150612 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:48.150612 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:48.150612 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:48.150612 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:48.150612 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:48.150612 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:48.150612 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:48.150612 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:48.150612 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:48.150612 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:48.150612 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:48.150612 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:48.150612 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:48.150612 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:48.151487 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:48.151487 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:48.151487 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:48.151487 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:48.151487 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:48.151487 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:48.151487 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:48.151487 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:48.151487 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:48.151487 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:48.151487 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:48.151487 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:48.151487 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:48.151487 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:48.151487 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:48.151487 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:48.152351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:48.152351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:48.152351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:48.152351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:48.152351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:48.152351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:48.152351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:48.152351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:48.152351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:48.152351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:48.152351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 21:02:48.152351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:48.155031 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 196/406] 10.222.0.81 () {56 vars in 1114 bytes} [Tue Sep 6 21:02:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:48.160703 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23358be-a406-4c5d-aac2-9a288db478b3 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:48.197369 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:48.329597 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23358be-a406-4c5d-aac2-9a288db478b3 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:48.379621 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b99443-474c-4706-8a80-ab6e008a393a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:48.380282 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b99443-474c-4706-8a80-ab6e008a393a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:48.380559 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b99443-474c-4706-8a80-ab6e008a393a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:48.380831 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b99443-474c-4706-8a80-ab6e008a393a None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:48.381557 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b99443-474c-4706-8a80-ab6e008a393a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:48.381802 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b99443-474c-4706-8a80-ab6e008a393a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:48.383213 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b99443-474c-4706-8a80-ab6e008a393a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:48.395890 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 211/407] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:02:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:48.399658 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf875f0a-b17c-40c9-860d-2cd715aae582 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:48.401018 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b99443-474c-4706-8a80-ab6e008a393a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:48.469643 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:48.516334 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf875f0a-b17c-40c9-860d-2cd715aae582 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:48.536454 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:48.553602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f8bea-efe3-4fb7-a951-e5e8f4fce5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:48.554582 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f8bea-efe3-4fb7-a951-e5e8f4fce5b1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:48.555106 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f8bea-efe3-4fb7-a951-e5e8f4fce5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:48.556147 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0f8bea-efe3-4fb7-a951-e5e8f4fce5b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:48.566994 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0f8bea-efe3-4fb7-a951-e5e8f4fce5b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:48.572337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-5a0f8bea-efe3-4fb7-a951-e5e8f4fce5b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:02:48.572337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:48.572337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:48.572337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:48.572337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:48.572337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:48.572337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:48.572337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:48.572337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:48.572337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:48.572337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:48.572337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:48.572337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:48.572337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:48.572337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:48.572337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:48.573313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:48.573313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:48.573313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:48.573313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:48.573313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:48.573313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:48.573313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:48.573313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:48.573313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:48.573313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:48.573313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:48.573313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:48.573313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:48.573313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:48.573313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:48.573313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:48.574124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:48.574124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:48.574124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:48.574124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:48.574124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:48.574124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:48.574124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:48.574124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:48.574124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:48.574124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:48.574124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:02:48.574124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:48.577124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 197/408] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:02:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:48.578632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b99443-474c-4706-8a80-ab6e008a393a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:48.585436 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f8bea-efe3-4fb7-a951-e5e8f4fce5b1 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:48.616738 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c931c7f-26e6-4237-b8de-eb1a9a5f19c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:48.618580 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c931c7f-26e6-4237-b8de-eb1a9a5f19c1 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:48.618860 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c931c7f-26e6-4237-b8de-eb1a9a5f19c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:48.619134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c931c7f-26e6-4237-b8de-eb1a9a5f19c1 None admin] PATH_INFO: `/v3/groups/3327522bc253425ea1de40ffe1daaac8` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:48.620459 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c931c7f-26e6-4237-b8de-eb1a9a5f19c1 None admin] RBAC: Authorizing `identity:get_group(group_id=3327522bc253425ea1de40ffe1daaac8)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:48.624081 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c931c7f-26e6-4237-b8de-eb1a9a5f19c1 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:48.624081 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 212/409] 10.222.0.81 () {56 vars in 1180 bytes} [Tue Sep 6 21:02:48 2022] GET /identity/v3/groups/3327522bc253425ea1de40ffe1daaac8 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:48.630065 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c931c7f-26e6-4237-b8de-eb1a9a5f19c1 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:48.756622 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0f8bea-efe3-4fb7-a951-e5e8f4fce5b1 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:48.774588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:48.799191 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248aca91-744e-497e-95ab-c1551bda9a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:48.799722 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248aca91-744e-497e-95ab-c1551bda9a96 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:48.799999 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248aca91-744e-497e-95ab-c1551bda9a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:48.801576 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248aca91-744e-497e-95ab-c1551bda9a96 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:48.802968 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248aca91-744e-497e-95ab-c1551bda9a96 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:48.803296 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248aca91-744e-497e-95ab-c1551bda9a96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:48.804672 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248aca91-744e-497e-95ab-c1551bda9a96 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:48.824133 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 198/410] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:48.831861 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248aca91-744e-497e-95ab-c1551bda9a96 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:48.854326 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c931c7f-26e6-4237-b8de-eb1a9a5f19c1 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:48.894382 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b2e77-78f6-43cb-8dc8-78b85621f045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:48.895167 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b2e77-78f6-43cb-8dc8-78b85621f045 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:48.895446 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b2e77-78f6-43cb-8dc8-78b85621f045 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:48.895720 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b2e77-78f6-43cb-8dc8-78b85621f045 None admin] PATH_INFO: `/v3/projects/b6011351cf9b462d964aff9e303a826d` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:48.897405 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b2e77-78f6-43cb-8dc8-78b85621f045 None admin] RBAC: Authorizing `identity:get_project(project_id=b6011351cf9b462d964aff9e303a826d)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:48.899551 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b2e77-78f6-43cb-8dc8-78b85621f045 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:48.901909 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 213/411] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:48 2022] GET /identity/v3/projects/b6011351cf9b462d964aff9e303a826d => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:48.907526 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b2e77-78f6-43cb-8dc8-78b85621f045 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:48.929170 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:49.025275 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b2e77-78f6-43cb-8dc8-78b85621f045 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:49.068792 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c14005-a994-4444-a790-142107f58b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:49.069495 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c14005-a994-4444-a790-142107f58b6c None admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:49.069773 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c14005-a994-4444-a790-142107f58b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:49.070118 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c14005-a994-4444-a790-142107f58b6c None admin] PATH_INFO: `/v3/projects/b6011351cf9b462d964aff9e303a826d/groups/3327522bc253425ea1de40ffe1daaac8/roles/c1dd3aa5113d434ab8306e2453a5ba6a` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:49.072313 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c14005-a994-4444-a790-142107f58b6c None admin] RBAC: Authorizing `identity:create_grant(project_id=b6011351cf9b462d964aff9e303a826d, group_id=3327522bc253425ea1de40ffe1daaac8, role_id=c1dd3aa5113d434ab8306e2453a5ba6a)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:49.074452 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c14005-a994-4444-a790-142107f58b6c None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:49.076078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248aca91-744e-497e-95ab-c1551bda9a96 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:49.120266 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4eafa-ef4e-44e7-b941-4ba804ff8dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:49.120903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4eafa-ef4e-44e7-b941-4ba804ff8dff None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:49.121231 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4eafa-ef4e-44e7-b941-4ba804ff8dff None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:49.121507 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4eafa-ef4e-44e7-b941-4ba804ff8dff None admin] PATH_INFO: `/v3/groups/c5c59943377940ceaec89709daa89e27` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:49.122650 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4eafa-ef4e-44e7-b941-4ba804ff8dff None admin] RBAC: Authorizing `identity:get_group(group_id=c5c59943377940ceaec89709daa89e27)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:49.124380 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4eafa-ef4e-44e7-b941-4ba804ff8dff None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:49.126287 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 199/412] 10.222.0.81 () {56 vars in 1180 bytes} [Tue Sep 6 21:02:48 2022] GET /identity/v3/groups/c5c59943377940ceaec89709daa89e27 => generated 229 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:49.131886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4eafa-ef4e-44e7-b941-4ba804ff8dff None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:49.167888 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 214/413] 10.222.0.81 () {58 vars in 1442 bytes} [Tue Sep 6 21:02:48 2022] PUT /identity/v3/projects/b6011351cf9b462d964aff9e303a826d/groups/3327522bc253425ea1de40ffe1daaac8/roles/c1dd3aa5113d434ab8306e2453a5ba6a => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:02:49.192381 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:49.251699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4eafa-ef4e-44e7-b941-4ba804ff8dff None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:49.290288 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a1f27f-9e46-4e78-88ca-22483f4b08c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:49.290946 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1f27f-9e46-4e78-88ca-22483f4b08c7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:49.291222 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1f27f-9e46-4e78-88ca-22483f4b08c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:49.291494 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a1f27f-9e46-4e78-88ca-22483f4b08c7 None admin] PATH_INFO: `/v3/projects/1e0790087f9147d99a7f175c2c23386d` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:49.292798 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1f27f-9e46-4e78-88ca-22483f4b08c7 None admin] RBAC: Authorizing `identity:get_project(project_id=1e0790087f9147d99a7f175c2c23386d)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:49.294283 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a1f27f-9e46-4e78-88ca-22483f4b08c7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:49.296432 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 200/414] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:49 2022] GET /identity/v3/projects/1e0790087f9147d99a7f175c2c23386d => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:49.304412 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c14005-a994-4444-a790-142107f58b6c None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:49.410086 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:49.435950 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c14005-a994-4444-a790-142107f58b6c None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:49.482688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0b7e8-ef90-45b5-986c-f6b0a531d2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:49.483387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0b7e8-ef90-45b5-986c-f6b0a531d2ea None admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:49.483666 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0b7e8-ef90-45b5-986c-f6b0a531d2ea None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:49.483936 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0b7e8-ef90-45b5-986c-f6b0a531d2ea None admin] PATH_INFO: `/v3/projects/1e0790087f9147d99a7f175c2c23386d/groups/c5c59943377940ceaec89709daa89e27/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:49.485996 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0b7e8-ef90-45b5-986c-f6b0a531d2ea None admin] RBAC: Authorizing `identity:create_grant(project_id=1e0790087f9147d99a7f175c2c23386d, group_id=c5c59943377940ceaec89709daa89e27, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:49.487482 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0b7e8-ef90-45b5-986c-f6b0a531d2ea None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:49.578091 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 215/415] 10.222.0.81 () {58 vars in 1442 bytes} [Tue Sep 6 21:02:49 2022] PUT /identity/v3/projects/1e0790087f9147d99a7f175c2c23386d/groups/c5c59943377940ceaec89709daa89e27/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:02:49.728672 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976ddc2-f8f8-4223-a4ef-235134959df3 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:49.729001 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976ddc2-f8f8-4223-a4ef-235134959df3 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:49.729218 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976ddc2-f8f8-4223-a4ef-235134959df3 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:49.730682 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 201/416] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:49.736659 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb21eb-4066-4787-9c1a-ab71a2139043 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:49.736951 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb21eb-4066-4787-9c1a-ab71a2139043 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:49.737213 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeb21eb-4066-4787-9c1a-ab71a2139043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:49.760999 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-afeb21eb-4066-4787-9c1a-ab71a2139043 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:49.762241 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-afeb21eb-4066-4787-9c1a-ab71a2139043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:49.861972 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 216/417] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:50.099354 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4529c5b-e4af-454c-8535-743f3726b56c None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:50.099860 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4529c5b-e4af-454c-8535-743f3726b56c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:50.099967 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4529c5b-e4af-454c-8535-743f3726b56c None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:50.101256 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 202/418] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:50.107196 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f7cff-ae8a-44e1-9a7e-933a54b86460 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:50.107482 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f7cff-ae8a-44e1-9a7e-933a54b86460 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:50.107758 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f7cff-ae8a-44e1-9a7e-933a54b86460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:50.126664 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-083f7cff-ae8a-44e1-9a7e-933a54b86460 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:50.127768 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-083f7cff-ae8a-44e1-9a7e-933a54b86460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:50.190972 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4529c5b-e4af-454c-8535-743f3726b56c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:50.210452 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:50.219546 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 217/419] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:50.343137 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4529c5b-e4af-454c-8535-743f3726b56c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:50.357781 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:50.375655 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62b5f0-08d6-498d-9af4-b1aae924ea23 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:50.375942 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62b5f0-08d6-498d-9af4-b1aae924ea23 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:50.381225 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62b5f0-08d6-498d-9af4-b1aae924ea23 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:50.381225 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 218/420] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:50.384733 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a7697-283f-4d3d-b437-2ad3e2e8a31f None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:50.385130 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a7697-283f-4d3d-b437-2ad3e2e8a31f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:50.385413 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a7697-283f-4d3d-b437-2ad3e2e8a31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:50.386228 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864774b-e964-4a84-a15f-6500addb5518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:50.386896 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864774b-e964-4a84-a15f-6500addb5518 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:50.387182 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864774b-e964-4a84-a15f-6500addb5518 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:50.387458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8864774b-e964-4a84-a15f-6500addb5518 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:50.414159 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8864774b-e964-4a84-a15f-6500addb5518 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:50.419666 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-e16a7697-283f-4d3d-b437-2ad3e2e8a31f None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:50.420904 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e16a7697-283f-4d3d-b437-2ad3e2e8a31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:50.423245 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-8864774b-e964-4a84-a15f-6500addb5518 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:50.423245 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:50.423245 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:50.423245 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:50.423245 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:50.423245 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:50.423245 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:50.423245 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:50.423245 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:50.423245 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:50.423245 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:50.423245 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:50.423245 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:50.423245 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:50.423245 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:50.423245 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:50.424135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:50.424135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:50.424135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:50.424135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:50.424135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:50.424135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:50.424135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:50.424135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:50.424135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:50.424135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:50.424135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:50.424135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:50.424135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:50.424135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:50.424135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:50.424135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:50.424942 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:50.424942 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:50.424942 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:50.424942 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:50.424942 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:50.424942 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:50.424942 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:50.424942 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:50.424942 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:50.424942 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:50.424942 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:50.424942 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:50.425581 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 203/421] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:50.436544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864774b-e964-4a84-a15f-6500addb5518 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:50.532419 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 219/422] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:50.572647 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8864774b-e964-4a84-a15f-6500addb5518 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:50.592685 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a7697-283f-4d3d-b437-2ad3e2e8a31f None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:50.607168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588617d-7cf3-4332-b36d-52c1b2ee67a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:50.607777 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588617d-7cf3-4332-b36d-52c1b2ee67a9 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:50.608064 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588617d-7cf3-4332-b36d-52c1b2ee67a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:50.608380 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588617d-7cf3-4332-b36d-52c1b2ee67a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:50.609045 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f588617d-7cf3-4332-b36d-52c1b2ee67a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:50.609351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f588617d-7cf3-4332-b36d-52c1b2ee67a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:50.616121 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f588617d-7cf3-4332-b36d-52c1b2ee67a9 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:50.620175 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 204/423] 10.222.0.81 () {56 vars in 1101 bytes} [Tue Sep 6 21:02:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:50.625783 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588617d-7cf3-4332-b36d-52c1b2ee67a9 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:50.665304 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:50.734662 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588617d-7cf3-4332-b36d-52c1b2ee67a9 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:50.771253 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5fdae-04f4-48f8-9d96-98b5db6ec807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:50.771866 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5fdae-04f4-48f8-9d96-98b5db6ec807 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:50.772369 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5fdae-04f4-48f8-9d96-98b5db6ec807 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:50.772813 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5fdae-04f4-48f8-9d96-98b5db6ec807 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:50.843955 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a7697-283f-4d3d-b437-2ad3e2e8a31f None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:50.846913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf5fdae-04f4-48f8-9d96-98b5db6ec807 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:50.849785 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf5fdae-04f4-48f8-9d96-98b5db6ec807 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:50.888250 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:50.888829 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:50.900939 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1bde21-5ff2-4518-bbff-f5381808b0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:50.901873 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bde21-5ff2-4518-bbff-f5381808b0c1 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:50.902359 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bde21-5ff2-4518-bbff-f5381808b0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:50.902784 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1bde21-5ff2-4518-bbff-f5381808b0c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:50.923076 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1bde21-5ff2-4518-bbff-f5381808b0c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:50.931605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-0d1bde21-5ff2-4518-bbff-f5381808b0c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:50.931605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:50.931605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:50.931605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:50.931605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:50.931605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:50.931605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:50.931605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:50.931605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:50.931605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:50.931605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:50.931605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:50.931605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:50.931605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:50.931605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:50.931605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:50.932715 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:50.932715 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:50.932715 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:50.932715 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:50.932715 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:50.932715 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:50.932715 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:50.932715 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:50.932715 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:50.932715 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:50.932715 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:50.932715 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:50.932715 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:50.932715 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:50.932715 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:50.932715 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:50.933707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:50.933707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:50.933707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:50.933707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:50.933707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:50.933707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:50.933707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:50.933707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:50.933707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:50.933707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:50.933707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 06 21:02:50.933707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:02:50.935493 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 220/424] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:02:50.936349 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1bde21-5ff2-4518-bbff-f5381808b0c1 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:50.978630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 205/425] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:02:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 21:02:50.980049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5fdae-04f4-48f8-9d96-98b5db6ec807 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:51.074298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1bde21-5ff2-4518-bbff-f5381808b0c1 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:51.105492 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5fdae-04f4-48f8-9d96-98b5db6ec807 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:51.123349 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f83df3-a83d-4229-9f6c-7ce2b0b591b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:51.124269 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f83df3-a83d-4229-9f6c-7ce2b0b591b1 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:51.124762 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f83df3-a83d-4229-9f6c-7ce2b0b591b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:51.125208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f83df3-a83d-4229-9f6c-7ce2b0b591b1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:51.139828 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f83df3-a83d-4229-9f6c-7ce2b0b591b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:51.140750 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b2bc5-5d9b-4f17-91b6-36cf6270c836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:51.141457 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b2bc5-5d9b-4f17-91b6-36cf6270c836 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:51.141900 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b2bc5-5d9b-4f17-91b6-36cf6270c836 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:51.142175 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b2bc5-5d9b-4f17-91b6-36cf6270c836 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:51.142888 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b2bc5-5d9b-4f17-91b6-36cf6270c836 None admin] RBAC: Adding query filter params (name=member) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:51.143240 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b2bc5-5d9b-4f17-91b6-36cf6270c836 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:51.144629 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b2bc5-5d9b-4f17-91b6-36cf6270c836 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:51.147195 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:51.148301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-f7f83df3-a83d-4229-9f6c-7ce2b0b591b1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 21:02:51.148301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:51.148301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:51.148301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:51.148301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:51.148301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:51.148301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:51.148301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:51.148301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:51.148301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:51.148301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:51.148301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:51.148301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:51.148301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:51.148301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:51.148301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:51.149686 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:51.149686 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:51.149686 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:51.149686 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:51.149686 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:51.149686 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:51.149686 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:51.149686 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:51.149686 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:51.149686 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:51.149686 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:51.149686 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:51.149686 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:51.149686 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:51.149686 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:51.149686 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:51.150492 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:51.150492 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:51.150492 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:51.150492 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:51.150492 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:51.150492 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:51.150492 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:51.150492 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:51.150492 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:51.150492 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:51.150492 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 21:02:51.150492 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:02:51.153124 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 221/426] 10.222.0.81 () {56 vars in 1114 bytes} [Tue Sep 6 21:02:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:51.154062 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f83df3-a83d-4229-9f6c-7ce2b0b591b1 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:51.161929 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 206/427] 10.222.0.81 () {56 vars in 1101 bytes} [Tue Sep 6 21:02:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:51.165072 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b2bc5-5d9b-4f17-91b6-36cf6270c836 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:51.219819 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:51.294549 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b2bc5-5d9b-4f17-91b6-36cf6270c836 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:51.297812 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f83df3-a83d-4229-9f6c-7ce2b0b591b1 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:51.333569 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d4cfc-8cc9-49b7-b838-0569ece9fb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:51.334258 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d4cfc-8cc9-49b7-b838-0569ece9fb86 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:51.334537 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d4cfc-8cc9-49b7-b838-0569ece9fb86 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:51.334853 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d4cfc-8cc9-49b7-b838-0569ece9fb86 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:51.335516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d4cfc-8cc9-49b7-b838-0569ece9fb86 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:51.335808 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d4cfc-8cc9-49b7-b838-0569ece9fb86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:51.337740 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d4cfc-8cc9-49b7-b838-0569ece9fb86 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:51.343871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b679e-a1cd-460b-b857-e1cb91e48af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:51.345068 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b679e-a1cd-460b-b857-e1cb91e48af6 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:51.345554 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b679e-a1cd-460b-b857-e1cb91e48af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:51.346045 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b679e-a1cd-460b-b857-e1cb91e48af6 None admin] PATH_INFO: `/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:51.351013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 207/428] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:02:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:51.351013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d4cfc-8cc9-49b7-b838-0569ece9fb86 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:51.354244 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b679e-a1cd-460b-b857-e1cb91e48af6 None admin] RBAC: Authorizing `identity:get_project(project_id=d3beaaf3de6a4ec9857978f70d555f6a)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:51.355935 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b679e-a1cd-460b-b857-e1cb91e48af6 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:51.358593 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 222/429] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:51 2022] GET /identity/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:51.359579 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b679e-a1cd-460b-b857-e1cb91e48af6 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:51.416204 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:51.458613 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d4cfc-8cc9-49b7-b838-0569ece9fb86 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:51.486907 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b679e-a1cd-460b-b857-e1cb91e48af6 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:51.493888 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eacbfe-9e49-460c-bc84-a7b082278a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:51.494631 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eacbfe-9e49-460c-bc84-a7b082278a9d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:51.495008 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eacbfe-9e49-460c-bc84-a7b082278a9d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:51.495343 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eacbfe-9e49-460c-bc84-a7b082278a9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:51.503223 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:51.526332 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3e80f-894f-48d8-94fb-86fb1a1dd914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:51.527222 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3e80f-894f-48d8-94fb-86fb1a1dd914 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:51.527682 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3e80f-894f-48d8-94fb-86fb1a1dd914 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:51.528132 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3e80f-894f-48d8-94fb-86fb1a1dd914 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:51.569152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eacbfe-9e49-460c-bc84-a7b082278a9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:51.570600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eacbfe-9e49-460c-bc84-a7b082278a9d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:51.607662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3e80f-894f-48d8-94fb-86fb1a1dd914 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:51.609448 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3e80f-894f-48d8-94fb-86fb1a1dd914 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:51.632711 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:51.677760 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 208/430] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:02:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 21:02:51.678757 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eacbfe-9e49-460c-bc84-a7b082278a9d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:51.725192 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 223/431] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:02:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 21:02:51.726452 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3e80f-894f-48d8-94fb-86fb1a1dd914 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:51.744591 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:51.792184 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eacbfe-9e49-460c-bc84-a7b082278a9d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:51.828581 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d259b-5c2f-4a2e-85fe-d452da45a2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:51.829519 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d259b-5c2f-4a2e-85fe-d452da45a2c8 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:51.830043 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d259b-5c2f-4a2e-85fe-d452da45a2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:51.830531 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d259b-5c2f-4a2e-85fe-d452da45a2c8 None admin] PATH_INFO: `/v3/groups/3327522bc253425ea1de40ffe1daaac8` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:51.831951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d259b-5c2f-4a2e-85fe-d452da45a2c8 None admin] RBAC: Authorizing `identity:get_group(group_id=3327522bc253425ea1de40ffe1daaac8)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:51.833562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d259b-5c2f-4a2e-85fe-d452da45a2c8 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:51.835620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 209/432] 10.222.0.81 () {56 vars in 1180 bytes} [Tue Sep 6 21:02:51 2022] GET /identity/v3/groups/3327522bc253425ea1de40ffe1daaac8 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:51.836706 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d259b-5c2f-4a2e-85fe-d452da45a2c8 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:51.847770 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3e80f-894f-48d8-94fb-86fb1a1dd914 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:51.870245 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:51.886021 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35182fe5-278e-4d86-8daf-3a6a4b37b6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:51.886872 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35182fe5-278e-4d86-8daf-3a6a4b37b6d7 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:51.887327 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35182fe5-278e-4d86-8daf-3a6a4b37b6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:51.887747 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35182fe5-278e-4d86-8daf-3a6a4b37b6d7 None admin] PATH_INFO: `/v3/projects/b6011351cf9b462d964aff9e303a826d` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:51.889052 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35182fe5-278e-4d86-8daf-3a6a4b37b6d7 None admin] RBAC: Authorizing `identity:get_project(project_id=b6011351cf9b462d964aff9e303a826d)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:51.890684 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35182fe5-278e-4d86-8daf-3a6a4b37b6d7 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:51.892533 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 224/433] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:51 2022] GET /identity/v3/projects/b6011351cf9b462d964aff9e303a826d => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:51.893506 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35182fe5-278e-4d86-8daf-3a6a4b37b6d7 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:51.958414 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d259b-5c2f-4a2e-85fe-d452da45a2c8 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:51.988065 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:52.007449 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35182fe5-278e-4d86-8daf-3a6a4b37b6d7 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:52.010741 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fc2bd7-662b-4417-9e77-63d125739981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:52.011374 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc2bd7-662b-4417-9e77-63d125739981 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:52.011656 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc2bd7-662b-4417-9e77-63d125739981 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:52.011931 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fc2bd7-662b-4417-9e77-63d125739981 None admin] PATH_INFO: `/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:52.013097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc2bd7-662b-4417-9e77-63d125739981 None admin] RBAC: Authorizing `identity:get_project(project_id=d3beaaf3de6a4ec9857978f70d555f6a)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:52.014538 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fc2bd7-662b-4417-9e77-63d125739981 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:52.016166 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 210/434] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:51 2022] GET /identity/v3/projects/d3beaaf3de6a4ec9857978f70d555f6a => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:52.021723 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0d56c-33b8-450c-979e-6bd631b31310 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:52.022008 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0d56c-33b8-450c-979e-6bd631b31310 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:52.022283 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b0d56c-33b8-450c-979e-6bd631b31310 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:52.023561 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 211/435] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:52.024954 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0d56c-33b8-450c-979e-6bd631b31310 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:52.046362 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18512713-bf4d-416f-89d1-9bd45a047bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:52.046991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18512713-bf4d-416f-89d1-9bd45a047bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:52.047300 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18512713-bf4d-416f-89d1-9bd45a047bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:52.047588 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18512713-bf4d-416f-89d1-9bd45a047bf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:52.048818 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18512713-bf4d-416f-89d1-9bd45a047bf0 None admin] RBAC: Adding query filter params (group.id=3327522bc253425ea1de40ffe1daaac8, role.id=be70fb8abf3148dda8e8e51be3a212e6, scope.project.id=d3beaaf3de6a4ec9857978f70d555f6a) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:52.049416 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18512713-bf4d-416f-89d1-9bd45a047bf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:52.051041 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18512713-bf4d-416f-89d1-9bd45a047bf0 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:52.058628 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 225/436] 10.222.0.81 () {56 vars in 1376 bytes} [Tue Sep 6 21:02:51 2022] GET /identity/v3/role_assignments?group.id=3327522bc253425ea1de40ffe1daaac8&scope.project.id=d3beaaf3de6a4ec9857978f70d555f6a&role.id=be70fb8abf3148dda8e8e51be3a212e6 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:52.059508 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18512713-bf4d-416f-89d1-9bd45a047bf0 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:52.162909 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:52.171364 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b0d56c-33b8-450c-979e-6bd631b31310 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:52.194187 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18512713-bf4d-416f-89d1-9bd45a047bf0 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:52.211738 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e9a40-5f7b-42aa-a611-91a0f16187da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:52.212427 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e9a40-5f7b-42aa-a611-91a0f16187da None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:52.212831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e9a40-5f7b-42aa-a611-91a0f16187da None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:52.213177 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e9a40-5f7b-42aa-a611-91a0f16187da None admin] PATH_INFO: `/v3/groups/3327522bc253425ea1de40ffe1daaac8` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:52.214471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e9a40-5f7b-42aa-a611-91a0f16187da None admin] RBAC: Authorizing `identity:get_group(group_id=3327522bc253425ea1de40ffe1daaac8)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:52.215953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e9a40-5f7b-42aa-a611-91a0f16187da None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:52.220442 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 212/437] 10.222.0.81 () {56 vars in 1180 bytes} [Tue Sep 6 21:02:52 2022] GET /identity/v3/groups/3327522bc253425ea1de40ffe1daaac8 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:52.220442 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ce7b0-7b00-4080-9dcd-8f39d4472b13 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:52.220442 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ce7b0-7b00-4080-9dcd-8f39d4472b13 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:52.220442 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ce7b0-7b00-4080-9dcd-8f39d4472b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:52.235426 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba044a-b145-430d-bb73-8837252ffe22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:52.235983 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba044a-b145-430d-bb73-8837252ffe22 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:52.236295 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba044a-b145-430d-bb73-8837252ffe22 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:52.236576 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba044a-b145-430d-bb73-8837252ffe22 None admin] PATH_INFO: `/v3/groups/3327522bc253425ea1de40ffe1daaac8` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:52.237789 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba044a-b145-430d-bb73-8837252ffe22 None admin] RBAC: Authorizing `identity:get_group(group_id=3327522bc253425ea1de40ffe1daaac8)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:52.239164 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ba044a-b145-430d-bb73-8837252ffe22 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:52.240777 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 226/438] 10.222.0.81 () {56 vars in 1180 bytes} [Tue Sep 6 21:02:52 2022] GET /identity/v3/groups/3327522bc253425ea1de40ffe1daaac8 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:52.241099 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-413ce7b0-7b00-4080-9dcd-8f39d4472b13 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:52.242314 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-413ce7b0-7b00-4080-9dcd-8f39d4472b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:52.247792 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdea46-812f-4a3b-96ec-bc5abc2fc8da None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:52.248076 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdea46-812f-4a3b-96ec-bc5abc2fc8da None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:52.248374 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bdea46-812f-4a3b-96ec-bc5abc2fc8da None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:52.249990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 227/439] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:52.250710 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdea46-812f-4a3b-96ec-bc5abc2fc8da None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:52.267943 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:52.339642 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 213/440] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:52.341259 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ce7b0-7b00-4080-9dcd-8f39d4472b13 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:52.386755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bdea46-812f-4a3b-96ec-bc5abc2fc8da None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:52.436198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a75480-56b3-4486-8d0e-02245ada29af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:52.436825 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a75480-56b3-4486-8d0e-02245ada29af None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:52.437105 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a75480-56b3-4486-8d0e-02245ada29af None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:52.437384 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a75480-56b3-4486-8d0e-02245ada29af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:52.438101 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a75480-56b3-4486-8d0e-02245ada29af None admin] RBAC: Adding query filter params (group.id=3327522bc253425ea1de40ffe1daaac8, role.id=be70fb8abf3148dda8e8e51be3a212e6, scope.project.id=b6011351cf9b462d964aff9e303a826d) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:52.438522 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a75480-56b3-4486-8d0e-02245ada29af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:52.439868 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a75480-56b3-4486-8d0e-02245ada29af None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:52.446411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 228/441] 10.222.0.81 () {56 vars in 1376 bytes} [Tue Sep 6 21:02:52 2022] GET /identity/v3/role_assignments?group.id=3327522bc253425ea1de40ffe1daaac8&scope.project.id=b6011351cf9b462d964aff9e303a826d&role.id=be70fb8abf3148dda8e8e51be3a212e6 => generated 611 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:52.447440 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dad030-7690-454b-9f55-b771a368b8cf None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:52.447726 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dad030-7690-454b-9f55-b771a368b8cf None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:52.448003 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dad030-7690-454b-9f55-b771a368b8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:52.462180 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:52.468175 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-40dad030-7690-454b-9f55-b771a368b8cf None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:52.469460 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-40dad030-7690-454b-9f55-b771a368b8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:52.472053 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ce7b0-7b00-4080-9dcd-8f39d4472b13 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:52.514990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4beea05-ca5c-42d8-9ca8-6d5fe79b1238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:52.516011 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4beea05-ca5c-42d8-9ca8-6d5fe79b1238 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:52.516630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4beea05-ca5c-42d8-9ca8-6d5fe79b1238 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:52.517124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4beea05-ca5c-42d8-9ca8-6d5fe79b1238 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:52.518219 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4beea05-ca5c-42d8-9ca8-6d5fe79b1238 None admin] RBAC: Adding query filter params (group.id=3327522bc253425ea1de40ffe1daaac8, role.id=c1dd3aa5113d434ab8306e2453a5ba6a, scope.project.id=d3beaaf3de6a4ec9857978f70d555f6a) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:52.518742 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4beea05-ca5c-42d8-9ca8-6d5fe79b1238 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:52.520564 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4beea05-ca5c-42d8-9ca8-6d5fe79b1238 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:52.528118 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 214/442] 10.222.0.81 () {56 vars in 1376 bytes} [Tue Sep 6 21:02:52 2022] GET /identity/v3/role_assignments?group.id=3327522bc253425ea1de40ffe1daaac8&scope.project.id=d3beaaf3de6a4ec9857978f70d555f6a&role.id=c1dd3aa5113d434ab8306e2453a5ba6a => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:52.549266 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 229/443] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:52.635253 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4beea05-ca5c-42d8-9ca8-6d5fe79b1238 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:52.761062 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4beea05-ca5c-42d8-9ca8-6d5fe79b1238 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:52.801253 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d22411-9723-4431-adf1-d61cf0fb65f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:52.801928 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d22411-9723-4431-adf1-d61cf0fb65f7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:52.802210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d22411-9723-4431-adf1-d61cf0fb65f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:52.802483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d22411-9723-4431-adf1-d61cf0fb65f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:52.813276 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d22411-9723-4431-adf1-d61cf0fb65f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:52.818289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-09d22411-9723-4431-adf1-d61cf0fb65f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 21:02:52.818289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:52.818289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:52.818289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:52.818289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:52.818289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:52.818289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:52.818289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:52.818289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:52.818289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:52.818289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:52.818289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:52.818289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:52.818289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:52.818289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:52.818289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:52.819208 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:52.819208 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:52.819208 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:52.819208 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:52.819208 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:52.819208 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:52.819208 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:52.819208 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:52.819208 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:52.819208 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:52.819208 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:52.819208 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:52.819208 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:52.819208 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:52.819208 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:52.819208 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:52.820211 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:52.820211 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:52.820211 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:52.820211 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:52.820211 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:52.820211 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:52.820211 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:52.820211 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:52.820211 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:52.820211 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:52.820211 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 21:02:52.820211 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:52.820211 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 215/444] 10.222.0.81 () {56 vars in 1114 bytes} [Tue Sep 6 21:02:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:52.826300 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dad030-7690-454b-9f55-b771a368b8cf None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:52.832015 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d22411-9723-4431-adf1-d61cf0fb65f7 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:52.840308 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:52.856433 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:52.944910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d22411-9723-4431-adf1-d61cf0fb65f7 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:52.953794 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dad030-7690-454b-9f55-b771a368b8cf None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:52.986746 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ada07-c7f3-4727-9b87-2306f8bda2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:52.988139 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ada07-c7f3-4727-9b87-2306f8bda2ea None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:52.988139 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ada07-c7f3-4727-9b87-2306f8bda2ea None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:52.988139 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ada07-c7f3-4727-9b87-2306f8bda2ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:52.997934 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3be99-5526-40ef-94d6-2505612a0893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:52.998560 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3be99-5526-40ef-94d6-2505612a0893 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:52.998844 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3be99-5526-40ef-94d6-2505612a0893 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:52.999119 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3be99-5526-40ef-94d6-2505612a0893 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:52.999787 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3be99-5526-40ef-94d6-2505612a0893 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:53.000090 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3be99-5526-40ef-94d6-2505612a0893 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:53.001581 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ada07-c7f3-4727-9b87-2306f8bda2ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:53.001718 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3be99-5526-40ef-94d6-2505612a0893 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:53.007537 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-aa3ada07-c7f3-4727-9b87-2306f8bda2ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:02:53.007537 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:53.007537 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:53.007537 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:53.007537 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:53.007537 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:53.007537 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:53.007537 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:53.007537 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:53.007537 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:53.007537 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:53.007537 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:53.007537 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:53.007537 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:53.007537 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:53.007537 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:53.008571 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:53.008571 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:53.008571 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:53.008571 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:53.008571 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:53.008571 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:53.008571 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:53.008571 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:53.008571 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:53.008571 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:53.008571 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:53.008571 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:53.008571 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:53.008571 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:53.008571 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:53.008571 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:53.009377 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:53.009377 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:53.009377 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:53.009377 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:53.009377 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:53.009377 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:53.009377 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:53.009377 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:53.009377 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:53.009377 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:53.009377 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:02:53.009377 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:53.009377 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 216/445] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:02:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:02:53.014820 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ada07-c7f3-4727-9b87-2306f8bda2ea None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:53.014967 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 230/446] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:02:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:53.024170 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3be99-5526-40ef-94d6-2505612a0893 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:53.108150 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:53.111246 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:53.136741 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ada07-c7f3-4727-9b87-2306f8bda2ea None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:53.145322 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3be99-5526-40ef-94d6-2505612a0893 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:53.174223 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8b4cd-9b19-42c4-b140-4848b4aed8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:53.174830 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8b4cd-9b19-42c4-b140-4848b4aed8a9 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:53.175109 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8b4cd-9b19-42c4-b140-4848b4aed8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:53.175380 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b8b4cd-9b19-42c4-b140-4848b4aed8a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:53.176053 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8b4cd-9b19-42c4-b140-4848b4aed8a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:53.176409 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8b4cd-9b19-42c4-b140-4848b4aed8a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:53.177800 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b8b4cd-9b19-42c4-b140-4848b4aed8a9 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:53.182014 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a390f-037f-4ed9-bef1-0467dcfd10dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:53.182623 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a390f-037f-4ed9-bef1-0467dcfd10dd None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:53.182901 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a390f-037f-4ed9-bef1-0467dcfd10dd None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:53.183167 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a390f-037f-4ed9-bef1-0467dcfd10dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:53.187500 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 217/447] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:02:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:53.193351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8b4cd-9b19-42c4-b140-4848b4aed8a9 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:53.251235 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a390f-037f-4ed9-bef1-0467dcfd10dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:53.252723 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093a390f-037f-4ed9-bef1-0467dcfd10dd None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:53.293025 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b8b4cd-9b19-42c4-b140-4848b4aed8a9 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:53.320555 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:53.326661 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3feded-aefa-440e-9b7f-cfc7751b5edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:53.327271 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3feded-aefa-440e-9b7f-cfc7751b5edb None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:53.327554 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3feded-aefa-440e-9b7f-cfc7751b5edb None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:53.327836 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3feded-aefa-440e-9b7f-cfc7751b5edb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:53.338837 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:53.351499 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 231/448] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:02:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 06 21:02:53.358092 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a390f-037f-4ed9-bef1-0467dcfd10dd None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:53.397620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3feded-aefa-440e-9b7f-cfc7751b5edb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:53.399464 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3feded-aefa-440e-9b7f-cfc7751b5edb None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:53.456387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a390f-037f-4ed9-bef1-0467dcfd10dd None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:53.491423 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ceeadc-2321-48f3-93cb-f39d84feaf9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:53.492055 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ceeadc-2321-48f3-93cb-f39d84feaf9d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:53.492383 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ceeadc-2321-48f3-93cb-f39d84feaf9d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:53.492636 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ceeadc-2321-48f3-93cb-f39d84feaf9d None admin] PATH_INFO: `/v3/projects/b6011351cf9b462d964aff9e303a826d` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:53.493747 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ceeadc-2321-48f3-93cb-f39d84feaf9d None admin] RBAC: Authorizing `identity:get_project(project_id=b6011351cf9b462d964aff9e303a826d)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:53.495172 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ceeadc-2321-48f3-93cb-f39d84feaf9d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:53.496042 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 218/449] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:02:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 21:02:53.501372 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 232/450] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:53 2022] GET /identity/v3/projects/b6011351cf9b462d964aff9e303a826d => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:53.501660 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3feded-aefa-440e-9b7f-cfc7751b5edb None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:53.502264 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ceeadc-2321-48f3-93cb-f39d84feaf9d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:53.542729 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:53.543159 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:53.598524 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3feded-aefa-440e-9b7f-cfc7751b5edb None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:53.601137 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ceeadc-2321-48f3-93cb-f39d84feaf9d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:53.633576 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eadaee-29ab-4b5e-baff-96e90cbfda0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:53.634198 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eadaee-29ab-4b5e-baff-96e90cbfda0c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:53.634474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eadaee-29ab-4b5e-baff-96e90cbfda0c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:53.634742 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eadaee-29ab-4b5e-baff-96e90cbfda0c None admin] PATH_INFO: `/v3/projects/1e0790087f9147d99a7f175c2c23386d` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:53.635845 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eadaee-29ab-4b5e-baff-96e90cbfda0c None admin] RBAC: Authorizing `identity:get_project(project_id=1e0790087f9147d99a7f175c2c23386d)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:53.637303 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eadaee-29ab-4b5e-baff-96e90cbfda0c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:53.638657 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0f752-7311-4162-82f3-dbb85420073e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:53.638931 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 219/451] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:02:53 2022] GET /identity/v3/projects/1e0790087f9147d99a7f175c2c23386d => generated 344 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:53.640050 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0f752-7311-4162-82f3-dbb85420073e None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:53.640050 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0f752-7311-4162-82f3-dbb85420073e None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:53.640050 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c0f752-7311-4162-82f3-dbb85420073e None admin] PATH_INFO: `/v3/groups/3327522bc253425ea1de40ffe1daaac8` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:53.641089 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0f752-7311-4162-82f3-dbb85420073e None admin] RBAC: Authorizing `identity:get_group(group_id=3327522bc253425ea1de40ffe1daaac8)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:53.642533 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c0f752-7311-4162-82f3-dbb85420073e None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:53.649488 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 233/452] 10.222.0.81 () {56 vars in 1180 bytes} [Tue Sep 6 21:02:53 2022] GET /identity/v3/groups/3327522bc253425ea1de40ffe1daaac8 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:53.649622 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eadaee-29ab-4b5e-baff-96e90cbfda0c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:53.650212 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0f752-7311-4162-82f3-dbb85420073e None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:53.743665 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eadaee-29ab-4b5e-baff-96e90cbfda0c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:53.748742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c0f752-7311-4162-82f3-dbb85420073e None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:53.752869 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:53.756314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:53.777942 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a3616-5547-4a43-ab02-748075230582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:53.778575 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a3616-5547-4a43-ab02-748075230582 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:53.778852 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a3616-5547-4a43-ab02-748075230582 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:53.779131 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a3616-5547-4a43-ab02-748075230582 None admin] PATH_INFO: `/v3/groups/c5c59943377940ceaec89709daa89e27` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:53.780280 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a3616-5547-4a43-ab02-748075230582 None admin] RBAC: Authorizing `identity:get_group(group_id=c5c59943377940ceaec89709daa89e27)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:53.781773 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a3616-5547-4a43-ab02-748075230582 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:53.783655 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 220/453] 10.222.0.81 () {56 vars in 1180 bytes} [Tue Sep 6 21:02:53 2022] GET /identity/v3/groups/c5c59943377940ceaec89709daa89e27 => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:53.783785 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc2bed-9533-456c-ae2f-2c168e2d3df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:53.784412 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc2bed-9533-456c-ae2f-2c168e2d3df1 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:53.784690 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc2bed-9533-456c-ae2f-2c168e2d3df1 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:53.784960 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc2bed-9533-456c-ae2f-2c168e2d3df1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:53.785674 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc2bed-9533-456c-ae2f-2c168e2d3df1 None admin] RBAC: Adding query filter params (group.id=3327522bc253425ea1de40ffe1daaac8, role.id=c1dd3aa5113d434ab8306e2453a5ba6a, scope.project.id=b6011351cf9b462d964aff9e303a826d) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:53.785980 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc2bed-9533-456c-ae2f-2c168e2d3df1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:53.787393 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc2bed-9533-456c-ae2f-2c168e2d3df1 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:53.789709 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a3616-5547-4a43-ab02-748075230582 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:53.794245 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 234/454] 10.222.0.81 () {56 vars in 1376 bytes} [Tue Sep 6 21:02:53 2022] GET /identity/v3/role_assignments?group.id=3327522bc253425ea1de40ffe1daaac8&scope.project.id=b6011351cf9b462d964aff9e303a826d&role.id=c1dd3aa5113d434ab8306e2453a5ba6a => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:02:53.898581 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a3616-5547-4a43-ab02-748075230582 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:53.936623 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6e2e63-3da4-4de8-8e66-c2ea6b16968e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:53.937154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e2e63-3da4-4de8-8e66-c2ea6b16968e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:53.937429 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e2e63-3da4-4de8-8e66-c2ea6b16968e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:53.937698 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6e2e63-3da4-4de8-8e66-c2ea6b16968e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:53.938458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e2e63-3da4-4de8-8e66-c2ea6b16968e None admin] RBAC: Adding query filter params (group.id=c5c59943377940ceaec89709daa89e27, role.id=fe9661f095094dd0931e0b96a1d6ef74, scope.project.id=1e0790087f9147d99a7f175c2c23386d) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:53.938763 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e2e63-3da4-4de8-8e66-c2ea6b16968e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:53.940261 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6e2e63-3da4-4de8-8e66-c2ea6b16968e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:53.947552 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 221/455] 10.222.0.81 () {56 vars in 1376 bytes} [Tue Sep 6 21:02:53 2022] GET /identity/v3/role_assignments?group.id=c5c59943377940ceaec89709daa89e27&scope.project.id=1e0790087f9147d99a7f175c2c23386d&role.id=fe9661f095094dd0931e0b96a1d6ef74 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:56.596328 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b05e3-87bb-464c-a1f7-fc8cb944bbc3 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:56.596865 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b05e3-87bb-464c-a1f7-fc8cb944bbc3 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:56.597067 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b05e3-87bb-464c-a1f7-fc8cb944bbc3 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:56.598571 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 235/456] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:56.605214 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaabe73-4a7f-4821-b77f-79830b317e2f None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:56.606041 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaabe73-4a7f-4821-b77f-79830b317e2f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:56.606467 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaabe73-4a7f-4821-b77f-79830b317e2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:56.633653 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-feaabe73-4a7f-4821-b77f-79830b317e2f None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:56.635084 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-feaabe73-4a7f-4821-b77f-79830b317e2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:56.678279 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:56.730543 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 222/457] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:56.918120 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf6df9-0009-4506-8df5-8d360ba8d1fc None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:56.918619 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf6df9-0009-4506-8df5-8d360ba8d1fc None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:56.919056 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bf6df9-0009-4506-8df5-8d360ba8d1fc None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:56.920577 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 236/458] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:56.926608 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7888ad-a57c-44ca-88d4-9fc4c06e8ca8 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:56.927088 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7888ad-a57c-44ca-88d4-9fc4c06e8ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:56.927502 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7888ad-a57c-44ca-88d4-9fc4c06e8ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:56.953199 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-1b7888ad-a57c-44ca-88d4-9fc4c06e8ca8 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:56.954434 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1b7888ad-a57c-44ca-88d4-9fc4c06e8ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:56.966774 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccf58f-5cda-42d6-aae0-41bec1508b96 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:56.967362 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccf58f-5cda-42d6-aae0-41bec1508b96 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:56.967829 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccf58f-5cda-42d6-aae0-41bec1508b96 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:56.969629 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 237/459] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:02:56.983605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f161efe-432a-4c7e-9358-020931ffe8cc None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:56.983912 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f161efe-432a-4c7e-9358-020931ffe8cc None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:56.984209 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f161efe-432a-4c7e-9358-020931ffe8cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:57.011871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-9f161efe-432a-4c7e-9358-020931ffe8cc None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:57.013225 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-9f161efe-432a-4c7e-9358-020931ffe8cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:57.063647 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 223/460] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:57.122430 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 238/461] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:57.147573 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7888ad-a57c-44ca-88d4-9fc4c06e8ca8 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:57.278312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:57.282442 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7888ad-a57c-44ca-88d4-9fc4c06e8ca8 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:57.329660 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0243ce0-a1b7-48a9-a42f-14065226a13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:57.330322 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0243ce0-a1b7-48a9-a42f-14065226a13b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:57.330598 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0243ce0-a1b7-48a9-a42f-14065226a13b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:57.330867 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0243ce0-a1b7-48a9-a42f-14065226a13b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:57.346112 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0243ce0-a1b7-48a9-a42f-14065226a13b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:57.347572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0243ce0-a1b7-48a9-a42f-14065226a13b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:57.350294 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f161efe-432a-4c7e-9358-020931ffe8cc None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:57.372141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-a0243ce0-a1b7-48a9-a42f-14065226a13b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:02:57.372141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:57.372141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:57.372141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:57.372141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:57.372141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:57.372141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:57.372141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:57.372141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:57.372141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:57.372141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:57.372141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:57.372141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:02:57.372141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:02:57.372141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:02:57.372141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:02:57.373134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:57.373134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:57.373134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:57.373134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:57.373134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:57.373134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:57.373134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:57.373134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:57.373134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:57.373134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:57.373134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:57.373134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:57.373134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:57.373134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:57.373134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:57.373134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:57.373134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:02:57.373996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:02:57.373996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:02:57.373996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:57.380779 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 224/462] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:02:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:57.384609 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0243ce0-a1b7-48a9-a42f-14065226a13b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:57.521284 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:57.525589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f161efe-432a-4c7e-9358-020931ffe8cc None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:57.561382 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b747c9-b92f-4f3e-8996-ef3102e0563c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:57.562184 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b747c9-b92f-4f3e-8996-ef3102e0563c None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:57.562610 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b747c9-b92f-4f3e-8996-ef3102e0563c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:57.562983 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b747c9-b92f-4f3e-8996-ef3102e0563c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:57.574324 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b747c9-b92f-4f3e-8996-ef3102e0563c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:57.575957 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b747c9-b92f-4f3e-8996-ef3102e0563c None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:57.591802 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0243ce0-a1b7-48a9-a42f-14065226a13b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:57.593534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-04b747c9-b92f-4f3e-8996-ef3102e0563c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:02:57.593534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:57.593534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:57.593534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:57.593534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:57.593534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:57.593534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:57.593534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:57.593534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:57.593534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:57.593534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:57.593534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:57.593534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:02:57.593534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:02:57.593534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:02:57.593534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:02:57.594473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:57.594473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:57.594473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:57.594473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:57.594473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:57.594473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:57.594473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:57.594473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:57.594473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:57.594473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:57.594473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:57.594473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:57.594473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:57.594473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:57.594473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:57.594473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:57.594473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:02:57.595334 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:02:57.595334 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:02:57.595334 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:02:57.600002 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 239/463] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:02:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:02:57.601390 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55ffe8-a32a-413b-bacd-df301e068c09 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:57.601720 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55ffe8-a32a-413b-bacd-df301e068c09 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:57.602080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55ffe8-a32a-413b-bacd-df301e068c09 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:57.603519 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 240/464] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:57.604318 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55ffe8-a32a-413b-bacd-df301e068c09 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:57.634306 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40b391-c98c-4591-9ee2-30c58bf5a6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:57.635730 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40b391-c98c-4591-9ee2-30c58bf5a6ac None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:57.636394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40b391-c98c-4591-9ee2-30c58bf5a6ac None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:57.636865 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40b391-c98c-4591-9ee2-30c58bf5a6ac None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:57.637681 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a40b391-c98c-4591-9ee2-30c58bf5a6ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:57.638155 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a40b391-c98c-4591-9ee2-30c58bf5a6ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:57.639673 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a40b391-c98c-4591-9ee2-30c58bf5a6ac None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:57.653432 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 225/465] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:57.658008 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40b391-c98c-4591-9ee2-30c58bf5a6ac None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:57.671235 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:57.718549 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55ffe8-a32a-413b-bacd-df301e068c09 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:57.762663 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbd1a3-434c-47bf-9ddb-91d80797326f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:57.763310 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbd1a3-434c-47bf-9ddb-91d80797326f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:57.763585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbd1a3-434c-47bf-9ddb-91d80797326f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:57.763863 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbd1a3-434c-47bf-9ddb-91d80797326f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:57.768630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40b391-c98c-4591-9ee2-30c58bf5a6ac None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:57.776443 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbd1a3-434c-47bf-9ddb-91d80797326f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:57.778028 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbd1a3-434c-47bf-9ddb-91d80797326f None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:57.794466 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-11cbd1a3-434c-47bf-9ddb-91d80797326f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:02:57.794466 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:57.794466 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:57.794466 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:57.794466 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:57.794466 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:57.794466 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:57.794466 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:57.794466 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:57.794466 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:57.794466 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:57.794466 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:57.794466 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:02:57.794466 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:02:57.794466 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:02:57.794466 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:02:57.795440 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:57.795440 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:57.795440 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:57.795440 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:57.795440 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:57.795440 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:57.795440 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:57.795440 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:57.795440 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:57.795440 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:57.795440 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:57.795440 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:57.795440 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:57.795440 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:57.795440 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:57.795440 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:57.795440 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:02:57.796334 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:02:57.796334 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:02:57.796334 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:02:57.796334 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 241/466] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:02:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:57.797180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a9a74-5713-4491-af2e-af0af63ab76b None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:57.797180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a9a74-5713-4491-af2e-af0af63ab76b None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:57.797435 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a9a74-5713-4491-af2e-af0af63ab76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:57.807642 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:57.812940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ad3dc-a3e5-41fe-9563-d22efa59ac17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:57.813553 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ad3dc-a3e5-41fe-9563-d22efa59ac17 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:57.813832 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ad3dc-a3e5-41fe-9563-d22efa59ac17 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:57.814102 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190ad3dc-a3e5-41fe-9563-d22efa59ac17 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:57.814741 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ad3dc-a3e5-41fe-9563-d22efa59ac17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:57.815040 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ad3dc-a3e5-41fe-9563-d22efa59ac17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:57.816616 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190ad3dc-a3e5-41fe-9563-d22efa59ac17 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:57.819690 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-ce9a9a74-5713-4491-af2e-af0af63ab76b None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:57.821692 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ce9a9a74-5713-4491-af2e-af0af63ab76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:57.829099 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 226/467] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:57.829714 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ad3dc-a3e5-41fe-9563-d22efa59ac17 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:57.899288 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 242/468] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:57.900606 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a9a74-5713-4491-af2e-af0af63ab76b None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:57.915204 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:57.958800 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190ad3dc-a3e5-41fe-9563-d22efa59ac17 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:58.003755 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe4abc-57f9-4623-8c8f-c373bfab2aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:58.004763 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe4abc-57f9-4623-8c8f-c373bfab2aa9 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:58.005066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe4abc-57f9-4623-8c8f-c373bfab2aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:58.005338 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe4abc-57f9-4623-8c8f-c373bfab2aa9 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:58.006005 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe4abc-57f9-4623-8c8f-c373bfab2aa9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:58.007816 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe4abc-57f9-4623-8c8f-c373bfab2aa9 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:58.035015 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a9a74-5713-4491-af2e-af0af63ab76b None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:58.072711 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18fea97-5b9d-4e78-8e98-1cee95d278be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:58.073323 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fea97-5b9d-4e78-8e98-1cee95d278be None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:58.073602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fea97-5b9d-4e78-8e98-1cee95d278be None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:58.073871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fea97-5b9d-4e78-8e98-1cee95d278be None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:58.074502 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18fea97-5b9d-4e78-8e98-1cee95d278be None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:58.074801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18fea97-5b9d-4e78-8e98-1cee95d278be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:58.076255 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18fea97-5b9d-4e78-8e98-1cee95d278be None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:58.077924 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:58.093670 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 243/469] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:58.094486 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18fea97-5b9d-4e78-8e98-1cee95d278be None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:58.111436 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 227/470] 10.222.0.81 () {60 vars in 1132 bytes} [Tue Sep 6 21:02:57 2022] POST /identity/v3/users => generated 246 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:02:58.112525 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd743ba-5553-4c0a-8d4e-22d4eb7ec399 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:58.112814 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd743ba-5553-4c0a-8d4e-22d4eb7ec399 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:58.113090 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd743ba-5553-4c0a-8d4e-22d4eb7ec399 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:58.114464 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 228/471] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:02:58.120132 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd743ba-5553-4c0a-8d4e-22d4eb7ec399 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:58.234567 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18fea97-5b9d-4e78-8e98-1cee95d278be None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:58.249709 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd743ba-5553-4c0a-8d4e-22d4eb7ec399 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:58.280314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fc4c3-08af-4c99-90c3-18f508e1d3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:58.280954 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fc4c3-08af-4c99-90c3-18f508e1d3d2 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:58.281234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fc4c3-08af-4c99-90c3-18f508e1d3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:58.281508 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fc4c3-08af-4c99-90c3-18f508e1d3d2 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:58.282152 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1fc4c3-08af-4c99-90c3-18f508e1d3d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:58.283693 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1fc4c3-08af-4c99-90c3-18f508e1d3d2 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:58.285850 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:58.297444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e43eb9-695a-4ab2-9fbc-1c99ce7cbde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:58.298077 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e43eb9-695a-4ab2-9fbc-1c99ce7cbde1 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:58.298346 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e43eb9-695a-4ab2-9fbc-1c99ce7cbde1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:58.298624 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e43eb9-695a-4ab2-9fbc-1c99ce7cbde1 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:58.299273 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e43eb9-695a-4ab2-9fbc-1c99ce7cbde1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:58.304277 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e43eb9-695a-4ab2-9fbc-1c99ce7cbde1 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:58.435007 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 244/472] 10.222.0.81 () {60 vars in 1132 bytes} [Tue Sep 6 21:02:58 2022] POST /identity/v3/users => generated 248 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:02:58.437379 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd6baa-61ec-40db-8160-c018cc2cc36e None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:58.437664 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd6baa-61ec-40db-8160-c018cc2cc36e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:58.437946 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd6baa-61ec-40db-8160-c018cc2cc36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:58.458498 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-bbdd6baa-61ec-40db-8160-c018cc2cc36e None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:02:58.460080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-bbdd6baa-61ec-40db-8160-c018cc2cc36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:02:58.478005 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 229/473] 10.222.0.81 () {60 vars in 1132 bytes} [Tue Sep 6 21:02:58 2022] POST /identity/v3/users => generated 248 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:02:58.479149 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e43eb9-695a-4ab2-9fbc-1c99ce7cbde1 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:58.566162 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:58.610213 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 245/474] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:02:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:02:58.670089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e43eb9-695a-4ab2-9fbc-1c99ce7cbde1 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:58.719662 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de5aaf-1a6b-4d18-bfb8-3beb3e646f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:58.720721 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de5aaf-1a6b-4d18-bfb8-3beb3e646f5c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:58.720996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de5aaf-1a6b-4d18-bfb8-3beb3e646f5c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:58.721262 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de5aaf-1a6b-4d18-bfb8-3beb3e646f5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:58.736397 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de5aaf-1a6b-4d18-bfb8-3beb3e646f5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:58.737840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de5aaf-1a6b-4d18-bfb8-3beb3e646f5c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:58.754676 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-68de5aaf-1a6b-4d18-bfb8-3beb3e646f5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:02:58.754676 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:58.754676 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:58.754676 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:58.754676 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:58.754676 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:58.754676 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:58.754676 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:58.754676 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:58.754676 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:58.754676 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:58.754676 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:58.754676 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:02:58.754676 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:02:58.754676 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:02:58.754676 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:02:58.755615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:58.755615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:58.755615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:58.755615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:58.755615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:58.755615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:58.755615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:58.755615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:58.755615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:58.755615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:58.755615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:58.755615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:58.755615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:58.755615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:58.755615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:58.755615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:58.755615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:02:58.756961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:02:58.756961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:02:58.756961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:58.756961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 230/475] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:02:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:58.762502 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd6baa-61ec-40db-8160-c018cc2cc36e None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:58.874140 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd6baa-61ec-40db-8160-c018cc2cc36e None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:58.910929 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de5aaf-1a6b-4d18-bfb8-3beb3e646f5c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:58.911143 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f889c01-c336-4690-9115-80d6ad74a0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:58.911710 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f889c01-c336-4690-9115-80d6ad74a0cd None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:58.911987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f889c01-c336-4690-9115-80d6ad74a0cd None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:58.912287 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f889c01-c336-4690-9115-80d6ad74a0cd None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:58.912935 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f889c01-c336-4690-9115-80d6ad74a0cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:58.913489 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f889c01-c336-4690-9115-80d6ad74a0cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:58.915622 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f889c01-c336-4690-9115-80d6ad74a0cd None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:58.933330 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 246/476] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:02:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:02:58.937344 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f889c01-c336-4690-9115-80d6ad74a0cd None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:58.990568 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:58.993126 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:59.052277 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f889c01-c336-4690-9115-80d6ad74a0cd None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:59.093989 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d088e-b537-4469-99dc-245c93a4a4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:59.095178 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d088e-b537-4469-99dc-245c93a4a4f3 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:59.095462 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d088e-b537-4469-99dc-245c93a4a4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:59.095734 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d088e-b537-4469-99dc-245c93a4a4f3 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:59.096478 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d088e-b537-4469-99dc-245c93a4a4f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:59.098406 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d088e-b537-4469-99dc-245c93a4a4f3 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:59.149572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de5aaf-1a6b-4d18-bfb8-3beb3e646f5c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:59.188320 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed7b32-7e9c-4855-a7b0-a0f8dd66a0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:59.188973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed7b32-7e9c-4855-a7b0-a0f8dd66a0eb None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:59.189261 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed7b32-7e9c-4855-a7b0-a0f8dd66a0eb None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:59.189537 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed7b32-7e9c-4855-a7b0-a0f8dd66a0eb None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:59.190318 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed7b32-7e9c-4855-a7b0-a0f8dd66a0eb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:59.191744 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bed7b32-7e9c-4855-a7b0-a0f8dd66a0eb None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:59.223896 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 247/477] 10.222.0.81 () {60 vars in 1132 bytes} [Tue Sep 6 21:02:58 2022] POST /identity/v3/users => generated 249 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:02:59.271345 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.sql.core [None req-5bed7b32-7e9c-4855-a7b0-a0f8dd66a0eb None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 06 21:02:59.271345 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 06 21:02:59.271345 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [parameters: {'id': 'b8e9615083c54ed482e0c76f98fd1c86', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 06 21:02:59.271345 dv-cinder-749155-11-smb devstack@keystone.service[81778]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81778) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 06 21:02:59.294086 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-5bed7b32-7e9c-4855-a7b0-a0f8dd66a0eb None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 06 21:02:59.294086 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:59.294086 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 21:02:59.294086 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 21:02:59.294086 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 21:02:59.294086 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 21:02:59.294086 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 21:02:59.294086 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 21:02:59.294086 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 21:02:59.294086 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application conn.query(q) Sep 06 21:02:59.294086 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 21:02:59.294086 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 21:02:59.294086 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 21:02:59.294086 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application result.read() Sep 06 21:02:59.294086 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 21:02:59.295089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 21:02:59.295089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 21:02:59.295089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 21:02:59.295089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 21:02:59.295089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 21:02:59.295089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 21:02:59.295089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 21:02:59.295089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 06 21:02:59.295089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:59.295089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 06 21:02:59.295089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:59.295089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:59.295089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 06 21:02:59.295089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 06 21:02:59.295089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 06 21:02:59.295089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return ref.to_dict() Sep 06 21:02:59.295089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 21:02:59.295089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application next(self.gen) Sep 06 21:02:59.296479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 06 21:02:59.296479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application yield resource Sep 06 21:02:59.296479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 21:02:59.296479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application next(self.gen) Sep 06 21:02:59.296479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 06 21:02:59.296479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self.session.rollback() Sep 06 21:02:59.296479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 21:02:59.296479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self.force_reraise() Sep 06 21:02:59.296479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 21:02:59.296479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise self.value Sep 06 21:02:59.296479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 06 21:02:59.296479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 06 21:02:59.296479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 06 21:02:59.296479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application session.commit() Sep 06 21:02:59.296479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 06 21:02:59.296479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 06 21:02:59.296479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 06 21:02:59.297620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._prepare_impl() Sep 06 21:02:59.297620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 06 21:02:59.297620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self.session.flush() Sep 06 21:02:59.297620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 06 21:02:59.297620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._flush(objects) Sep 06 21:02:59.297620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 06 21:02:59.297620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 06 21:02:59.297620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 06 21:02:59.297620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application compat.raise_( Sep 06 21:02:59.297620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 21:02:59.297620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception Sep 06 21:02:59.297620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 06 21:02:59.297620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application flush_context.execute() Sep 06 21:02:59.297620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 06 21:02:59.297620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rec.execute(self) Sep 06 21:02:59.297620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 06 21:02:59.297620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 06 21:02:59.298496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 06 21:02:59.298496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 06 21:02:59.298496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 06 21:02:59.298496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 06 21:02:59.298496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 06 21:02:59.298496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 06 21:02:59.298496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 06 21:02:59.298496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 06 21:02:59.298496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 06 21:02:59.298496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 06 21:02:59.298496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 06 21:02:59.298496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 06 21:02:59.298496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 06 21:02:59.298496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 06 21:02:59.298496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 21:02:59.298496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception Sep 06 21:02:59.299302 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 21:02:59.299302 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 21:02:59.299302 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 21:02:59.299302 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 21:02:59.299302 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 21:02:59.299302 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 21:02:59.299302 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 21:02:59.299302 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application conn.query(q) Sep 06 21:02:59.299302 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 21:02:59.299302 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 21:02:59.299302 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 21:02:59.299302 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application result.read() Sep 06 21:02:59.299302 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 21:02:59.299302 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 21:02:59.299302 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 21:02:59.299302 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 21:02:59.300089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 21:02:59.300089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 21:02:59.300089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 21:02:59.300089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 21:02:59.300089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 06 21:02:59.300089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 06 21:02:59.300089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [parameters: {'id': 'b8e9615083c54ed482e0c76f98fd1c86', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 06 21:02:59.300089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 06 21:02:59.300089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:59.300089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 21:02:59.300089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:59.300089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:59.300089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:59.300089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:59.300089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:59.300089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:59.302823 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:59.302823 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:59.302823 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:59.302823 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:59.302823 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:59.302823 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:59.302823 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 06 21:02:59.302823 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 06 21:02:59.302823 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:59.302823 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:59.302823 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 06 21:02:59.302823 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 06 21:02:59.302823 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 06 21:02:59.302823 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 06 21:02:59.302823 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 06 21:02:59.302823 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:02:59.305400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 231/478] 10.222.0.81 () {60 vars in 1131 bytes} [Tue Sep 6 21:02:58 2022] POST /identity/v3/roles => generated 144 bytes in 385 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:02:59.305540 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d088e-b537-4469-99dc-245c93a4a4f3 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:59.448633 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:59.452686 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d088e-b537-4469-99dc-245c93a4a4f3 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:59.489586 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d761f9-6e59-4654-9062-268082b4d697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:59.490235 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d761f9-6e59-4654-9062-268082b4d697 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:59.490514 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d761f9-6e59-4654-9062-268082b4d697 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:59.490788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d761f9-6e59-4654-9062-268082b4d697 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:59.502429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d761f9-6e59-4654-9062-268082b4d697 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:02:59.509722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-f4d761f9-6e59-4654-9062-268082b4d697 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 21:02:59.509722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:02:59.509722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:02:59.509722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:02:59.509722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:02:59.509722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:02:59.509722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:02:59.509722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:02:59.509722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:02:59.509722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:02:59.509722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:02:59.509722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:02:59.509722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:02:59.509722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:02:59.509722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:02:59.509722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:02:59.510587 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:02:59.510587 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:02:59.510587 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:02:59.510587 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:02:59.510587 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:02:59.510587 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:02:59.510587 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:02:59.510587 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:02:59.510587 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:02:59.510587 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:02:59.510587 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:02:59.510587 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:02:59.510587 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:02:59.510587 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:02:59.510587 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:02:59.510587 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:02:59.511391 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:02:59.511391 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:02:59.511391 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:02:59.511391 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:02:59.511391 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:02:59.511391 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:02:59.511391 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:02:59.511391 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:02:59.511391 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:02:59.511391 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:02:59.511391 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 06 21:02:59.511391 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:02:59.511391 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 248/479] 10.222.0.81 () {56 vars in 1114 bytes} [Tue Sep 6 21:02:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:02:59.514631 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed7b32-7e9c-4855-a7b0-a0f8dd66a0eb None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:02:59.625649 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:02:59.628803 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed7b32-7e9c-4855-a7b0-a0f8dd66a0eb None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:02:59.669545 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544564f3-5d88-41b8-bb85-82072afcdbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:02:59.670167 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544564f3-5d88-41b8-bb85-82072afcdbb3 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:02:59.670717 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544564f3-5d88-41b8-bb85-82072afcdbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:02:59.670717 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544564f3-5d88-41b8-bb85-82072afcdbb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:02:59.671360 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544564f3-5d88-41b8-bb85-82072afcdbb3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:02:59.671662 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544564f3-5d88-41b8-bb85-82072afcdbb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:02:59.673177 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544564f3-5d88-41b8-bb85-82072afcdbb3 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:02:59.682406 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 232/480] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:02:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:00.528507 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a216f-feb3-4856-a6ed-417fb40fefbf None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:00.529230 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a216f-feb3-4856-a6ed-417fb40fefbf None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:00.529230 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a216f-feb3-4856-a6ed-417fb40fefbf None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:00.530821 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 249/481] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:00.542713 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338fec4-1954-46fb-8bd4-a43ea13f92f7 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:00.543000 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338fec4-1954-46fb-8bd4-a43ea13f92f7 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:00.543274 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3338fec4-1954-46fb-8bd4-a43ea13f92f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:00.562317 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-3338fec4-1954-46fb-8bd4-a43ea13f92f7 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:00.563502 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3338fec4-1954-46fb-8bd4-a43ea13f92f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:00.654825 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 233/482] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:03:01.063278 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a216f-feb3-4856-a6ed-417fb40fefbf None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:01.201356 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae4e04-8cb9-4311-92e5-3b3de3055259 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:01.201886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae4e04-8cb9-4311-92e5-3b3de3055259 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:01.201960 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae4e04-8cb9-4311-92e5-3b3de3055259 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:01.205074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 234/483] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:01.209763 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93770e70-8563-4de2-8c53-278286921950 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:01.210066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93770e70-8563-4de2-8c53-278286921950 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:01.210321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93770e70-8563-4de2-8c53-278286921950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:01.231763 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-93770e70-8563-4de2-8c53-278286921950 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:01.232998 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-93770e70-8563-4de2-8c53-278286921950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:01.236123 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a216f-feb3-4856-a6ed-417fb40fefbf None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:01.307819 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b063ce54-8606-41d8-ab25-0b3609a77685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:01.308492 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063ce54-8606-41d8-ab25-0b3609a77685 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:01.308784 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063ce54-8606-41d8-ab25-0b3609a77685 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:01.309062 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063ce54-8606-41d8-ab25-0b3609a77685 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:01.330219 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b063ce54-8606-41d8-ab25-0b3609a77685 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:03:01.335841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-b063ce54-8606-41d8-ab25-0b3609a77685 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:01.335841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:01.335841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:01.335841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:01.335841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:01.335841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:01.335841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:01.335841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:01.335841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:01.335841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:01.335841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:01.335841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:01.335841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:03:01.335841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:03:01.335841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:03:01.335841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:03:01.337324 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:03:01.337324 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:03:01.337324 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:03:01.337324 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:03:01.337324 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:01.337324 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:01.337324 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:01.337324 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:01.337324 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:01.337324 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:01.337324 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:01.337324 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:01.337324 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:01.337324 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:01.337324 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:01.337324 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:01.338218 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:01.338218 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:01.338218 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:01.338218 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:01.338218 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:03:01.338218 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:03:01.338218 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:03:01.338218 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:03:01.338218 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:03:01.338218 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:03:01.338218 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:01.338218 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:01.338218 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 250/484] 10.222.0.81 () {56 vars in 1102 bytes} [Tue Sep 6 21:03:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:01.339370 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ad64b-037f-4504-a9fe-d9c5901df180 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:01.339370 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ad64b-037f-4504-a9fe-d9c5901df180 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:01.339532 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ad64b-037f-4504-a9fe-d9c5901df180 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:01.344127 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 251/485] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:01.345821 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ad64b-037f-4504-a9fe-d9c5901df180 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:01.353775 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 235/486] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 21:03:01.355157 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90702b63-0b77-4f61-a61d-1de1044a356a None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:01.355535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90702b63-0b77-4f61-a61d-1de1044a356a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:01.355809 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90702b63-0b77-4f61-a61d-1de1044a356a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:01.365569 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:01.393856 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-90702b63-0b77-4f61-a61d-1de1044a356a None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:01.393856 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-90702b63-0b77-4f61-a61d-1de1044a356a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:01.428454 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:01.512813 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 236/487] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:03:01.514736 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ad64b-037f-4504-a9fe-d9c5901df180 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:01.562812 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481bb30-5e03-4828-83ef-be73d411580d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:01.563483 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481bb30-5e03-4828-83ef-be73d411580d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:01.563748 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481bb30-5e03-4828-83ef-be73d411580d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:01.564021 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481bb30-5e03-4828-83ef-be73d411580d None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:01.564843 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3481bb30-5e03-4828-83ef-be73d411580d None admin] RBAC: Adding query filter params (name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:01.565147 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3481bb30-5e03-4828-83ef-be73d411580d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:01.566546 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3481bb30-5e03-4828-83ef-be73d411580d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:01.583596 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 252/488] 10.222.0.81 () {56 vars in 1103 bytes} [Tue Sep 6 21:03:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:01.589296 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90702b63-0b77-4f61-a61d-1de1044a356a None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:01.715861 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481bb30-5e03-4828-83ef-be73d411580d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:01.739174 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90702b63-0b77-4f61-a61d-1de1044a356a None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:01.811385 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ecfa5-8fec-4ca3-bdef-de70152c5174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:01.812034 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ecfa5-8fec-4ca3-bdef-de70152c5174 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:01.812348 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ecfa5-8fec-4ca3-bdef-de70152c5174 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:01.812625 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99ecfa5-8fec-4ca3-bdef-de70152c5174 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:01.835923 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99ecfa5-8fec-4ca3-bdef-de70152c5174 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:01.837410 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99ecfa5-8fec-4ca3-bdef-de70152c5174 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:01.840001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:01.868632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-c99ecfa5-8fec-4ca3-bdef-de70152c5174 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:01.868632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:01.868632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:01.868632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:01.868632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:01.868632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:01.868632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:01.868632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:01.868632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:01.868632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:01.868632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:01.868632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:01.868632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:01.868632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:01.868632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:01.868632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:01.869618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:01.869618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:01.869618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:01.869618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:01.869618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:01.869618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:01.869618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:01.869618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:01.869618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:01.869618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:01.869618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:01.869618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:01.869618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:01.869618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:01.869618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:01.869618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:01.869618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:01.870476 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:01.870476 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:01.870476 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:01.870476 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 237/489] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:01.879368 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ecfa5-8fec-4ca3-bdef-de70152c5174 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:01.888592 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:01.890480 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481bb30-5e03-4828-83ef-be73d411580d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:01.951854 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6d137-b23f-46de-be3a-cc6f1478ac87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:01.953196 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6d137-b23f-46de-be3a-cc6f1478ac87 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:01.953710 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6d137-b23f-46de-be3a-cc6f1478ac87 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:01.954175 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6d137-b23f-46de-be3a-cc6f1478ac87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:01.968557 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f6d137-b23f-46de-be3a-cc6f1478ac87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:03:01.974131 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-08f6d137-b23f-46de-be3a-cc6f1478ac87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:01.974131 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:01.974131 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:01.974131 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:01.974131 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:01.974131 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:01.974131 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:01.974131 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:01.974131 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:01.974131 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:01.974131 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:01.974131 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:01.974131 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:03:01.974131 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:03:01.974131 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:03:01.974131 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:03:01.975023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:03:01.975023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:03:01.975023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:03:01.975023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:03:01.975023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:01.975023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:01.975023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:01.975023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:01.975023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:01.975023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:01.975023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:01.975023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:01.975023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:01.975023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:01.975023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:01.975023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:01.975843 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:01.975843 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:01.975843 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:01.975843 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:01.975843 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:03:01.975843 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:03:01.975843 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:03:01.975843 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:03:01.975843 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:03:01.975843 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:03:01.975843 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:01.975843 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:01.980138 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 253/490] 10.222.0.81 () {56 vars in 1102 bytes} [Tue Sep 6 21:03:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:03:01.981106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6d137-b23f-46de-be3a-cc6f1478ac87 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:02.028662 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99ecfa5-8fec-4ca3-bdef-de70152c5174 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:02.066633 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56081059-203e-4311-b3c1-019ac599a0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:02.067634 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56081059-203e-4311-b3c1-019ac599a0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:02.068150 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56081059-203e-4311-b3c1-019ac599a0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:02.068639 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56081059-203e-4311-b3c1-019ac599a0d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:02.069558 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56081059-203e-4311-b3c1-019ac599a0d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:02.070094 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56081059-203e-4311-b3c1-019ac599a0d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:02.072207 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56081059-203e-4311-b3c1-019ac599a0d7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:02.085687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 238/491] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:02.087414 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56081059-203e-4311-b3c1-019ac599a0d7 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:02.103734 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f6d137-b23f-46de-be3a-cc6f1478ac87 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:02.141413 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8815b0f-60d9-46c3-a50e-aa616e6eece8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:02.142053 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8815b0f-60d9-46c3-a50e-aa616e6eece8 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:02.142337 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8815b0f-60d9-46c3-a50e-aa616e6eece8 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:02.142826 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8815b0f-60d9-46c3-a50e-aa616e6eece8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:02.150195 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:02.154511 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8815b0f-60d9-46c3-a50e-aa616e6eece8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:03:02.157457 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:02.159755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-b8815b0f-60d9-46c3-a50e-aa616e6eece8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:02.159755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:02.159755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:02.159755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:02.159755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:02.159755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:02.159755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:02.159755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:02.159755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:02.159755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:02.159755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:02.159755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:02.159755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:03:02.159755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:03:02.159755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:03:02.159755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:03:02.168987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:03:02.168987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:03:02.168987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:03:02.168987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:03:02.168987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:02.168987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:02.168987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:02.168987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:02.168987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:02.168987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:02.168987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:02.168987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:02.168987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:02.168987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:02.168987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:02.168987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:02.169776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:02.169776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:02.169776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:02.169776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:02.169776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:03:02.169776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:03:02.169776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:03:02.169776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:03:02.169776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:03:02.169776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:03:02.169776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:02.169776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:02.169776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 254/492] 10.222.0.81 () {56 vars in 1102 bytes} [Tue Sep 6 21:03:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:02.169776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8815b0f-60d9-46c3-a50e-aa616e6eece8 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:02.203043 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56081059-203e-4311-b3c1-019ac599a0d7 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:02.242125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77d44d-812b-4493-ba52-9be4896a1068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:02.243264 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77d44d-812b-4493-ba52-9be4896a1068 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:02.243815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77d44d-812b-4493-ba52-9be4896a1068 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:02.243815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77d44d-812b-4493-ba52-9be4896a1068 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:02.244460 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77d44d-812b-4493-ba52-9be4896a1068 None admin] RBAC: Adding query filter params (name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:02.245103 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77d44d-812b-4493-ba52-9be4896a1068 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:02.248033 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77d44d-812b-4493-ba52-9be4896a1068 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:02.256017 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 239/493] 10.222.0.81 () {56 vars in 1103 bytes} [Tue Sep 6 21:03:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:02.257131 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d6bf7-1b6a-473f-810c-a6ea8e086acb None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:02.257415 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d6bf7-1b6a-473f-810c-a6ea8e086acb None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:02.257684 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665d6bf7-1b6a-473f-810c-a6ea8e086acb None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:02.265390 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 240/494] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:02.265390 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d6bf7-1b6a-473f-810c-a6ea8e086acb None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:02.281720 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8815b0f-60d9-46c3-a50e-aa616e6eece8 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:02.317582 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef57209-2e49-4f61-9e0c-766c0caae6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:02.318219 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef57209-2e49-4f61-9e0c-766c0caae6d6 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:02.318502 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef57209-2e49-4f61-9e0c-766c0caae6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:02.318799 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef57209-2e49-4f61-9e0c-766c0caae6d6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:02.326288 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef57209-2e49-4f61-9e0c-766c0caae6d6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:02.327751 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef57209-2e49-4f61-9e0c-766c0caae6d6 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:02.341362 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-eef57209-2e49-4f61-9e0c-766c0caae6d6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 21:03:02.341362 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:02.341362 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:02.341362 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:02.341362 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:02.341362 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:02.341362 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:02.341362 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:02.341362 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:02.341362 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:02.341362 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:02.341362 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:02.341362 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:03:02.341362 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:03:02.341362 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:03:02.341362 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:03:02.342388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:02.342388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:02.342388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:03:02.342388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:02.342388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:03:02.342388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:02.342388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:02.342388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:02.342388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:02.342388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:02.342388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:02.342388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:02.342388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:02.342388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:02.342388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:02.342388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:02.342388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:02.342388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:02.343290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:02.343290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:02.343290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:03:02.343290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:03:02.343290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:03:02.343290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:03:02.343290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:03:02.343290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:03:02.343290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 21:03:02.343290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:02.343290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 255/495] 10.222.0.81 () {56 vars in 1093 bytes} [Tue Sep 6 21:03:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:02.343290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef57209-2e49-4f61-9e0c-766c0caae6d6 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:02.382528 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665d6bf7-1b6a-473f-810c-a6ea8e086acb None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:02.410792 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:02.412737 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:02.422778 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661ea956-19e2-49c7-8686-1f2cd74db910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:02.423390 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ea956-19e2-49c7-8686-1f2cd74db910 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:02.423719 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ea956-19e2-49c7-8686-1f2cd74db910 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:02.425581 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661ea956-19e2-49c7-8686-1f2cd74db910 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:02.425581 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ea956-19e2-49c7-8686-1f2cd74db910 None admin] RBAC: Adding query filter params (name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:02.425581 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ea956-19e2-49c7-8686-1f2cd74db910 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:02.426379 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661ea956-19e2-49c7-8686-1f2cd74db910 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:02.440015 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 241/496] 10.222.0.81 () {56 vars in 1103 bytes} [Tue Sep 6 21:03:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:02.440015 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70f50c-4f3e-42f0-9b50-2aecdff7fc48 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:02.440015 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70f50c-4f3e-42f0-9b50-2aecdff7fc48 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:02.440015 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70f50c-4f3e-42f0-9b50-2aecdff7fc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:02.456878 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-7f70f50c-4f3e-42f0-9b50-2aecdff7fc48 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:02.458308 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7f70f50c-4f3e-42f0-9b50-2aecdff7fc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:02.462030 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef57209-2e49-4f61-9e0c-766c0caae6d6 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:02.508614 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8e28e-00de-42c8-98b3-7bf4c413f2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:02.509288 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8e28e-00de-42c8-98b3-7bf4c413f2e2 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:02.509565 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8e28e-00de-42c8-98b3-7bf4c413f2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:02.509840 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a8e28e-00de-42c8-98b3-7bf4c413f2e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:02.522461 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8e28e-00de-42c8-98b3-7bf4c413f2e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:02.524547 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a8e28e-00de-42c8-98b3-7bf4c413f2e2 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:02.540643 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-85a8e28e-00de-42c8-98b3-7bf4c413f2e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:02.540643 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:02.540643 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:02.540643 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:02.540643 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:02.540643 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:02.540643 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:02.540643 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:02.540643 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:02.540643 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:02.540643 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:02.540643 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:02.540643 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:02.540643 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:02.540643 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:02.540643 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:02.541815 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:02.541815 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:02.541815 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:02.541815 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:02.541815 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:02.541815 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:02.541815 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:02.541815 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:02.541815 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:02.541815 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:02.541815 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:02.541815 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:02.541815 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:02.541815 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:02.541815 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:02.541815 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:02.541815 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:02.542669 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:02.542669 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:02.542669 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:02.542669 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 256/497] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:02.542669 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8e28e-00de-42c8-98b3-7bf4c413f2e2 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:02.554351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 242/498] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:03:02.554351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70f50c-4f3e-42f0-9b50-2aecdff7fc48 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:02.653767 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f70f50c-4f3e-42f0-9b50-2aecdff7fc48 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:02.665422 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a8e28e-00de-42c8-98b3-7bf4c413f2e2 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:02.672755 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:02.677690 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:02.690195 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46433e82-ef51-4042-a01a-a69ab244ca42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:02.697918 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46433e82-ef51-4042-a01a-a69ab244ca42 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:02.697918 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46433e82-ef51-4042-a01a-a69ab244ca42 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:02.697918 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46433e82-ef51-4042-a01a-a69ab244ca42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:02.702201 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e205026-610c-4459-a8e0-5a48e9b014f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:02.702601 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46433e82-ef51-4042-a01a-a69ab244ca42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:02.703024 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e205026-610c-4459-a8e0-5a48e9b014f0 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:02.703401 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e205026-610c-4459-a8e0-5a48e9b014f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:02.703772 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e205026-610c-4459-a8e0-5a48e9b014f0 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:02.704037 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46433e82-ef51-4042-a01a-a69ab244ca42 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:02.704803 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e205026-610c-4459-a8e0-5a48e9b014f0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:02.705207 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e205026-610c-4459-a8e0-5a48e9b014f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:02.706743 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e205026-610c-4459-a8e0-5a48e9b014f0 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:02.719192 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-46433e82-ef51-4042-a01a-a69ab244ca42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:02.719192 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:02.719192 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:02.719192 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:02.719192 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:02.719192 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:02.719192 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:02.719192 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:02.719192 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:02.719192 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:02.719192 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:02.719192 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:02.719192 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:02.719192 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:02.719192 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:02.719192 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:02.720198 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:02.720198 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:02.720198 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:02.720198 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:02.720198 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:02.720198 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:02.720198 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:02.720198 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:02.720198 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:02.720198 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:02.720198 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:02.720198 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:02.720198 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:02.720198 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:02.720198 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:02.720198 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:02.720198 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:02.721048 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:02.721048 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:02.721048 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:02.721048 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 243/499] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:02.721262 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46433e82-ef51-4042-a01a-a69ab244ca42 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:02.754750 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 257/500] 10.222.0.81 () {56 vars in 1133 bytes} [Tue Sep 6 21:03:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:02.757039 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41aa6ce-5032-45f4-89b2-67f6451f1a18 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:02.757508 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41aa6ce-5032-45f4-89b2-67f6451f1a18 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:02.758440 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41aa6ce-5032-45f4-89b2-67f6451f1a18 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:02.761411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 258/501] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:02.762363 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41aa6ce-5032-45f4-89b2-67f6451f1a18 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:02.839608 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46433e82-ef51-4042-a01a-a69ab244ca42 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:02.873204 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2119eb-225f-453a-8cde-7b38c7a51a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:02.873865 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2119eb-225f-453a-8cde-7b38c7a51a51 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:02.874147 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2119eb-225f-453a-8cde-7b38c7a51a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:02.874419 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2119eb-225f-453a-8cde-7b38c7a51a51 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:02.874954 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41aa6ce-5032-45f4-89b2-67f6451f1a18 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:02.875051 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2119eb-225f-453a-8cde-7b38c7a51a51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:02.875334 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2119eb-225f-453a-8cde-7b38c7a51a51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:02.876725 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2119eb-225f-453a-8cde-7b38c7a51a51 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:02.889363 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 244/502] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:02.890187 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2119eb-225f-453a-8cde-7b38c7a51a51 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:02.910456 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760d7c4-7222-4511-827a-e5d0f655467f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:02.910996 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760d7c4-7222-4511-827a-e5d0f655467f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:02.911277 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760d7c4-7222-4511-827a-e5d0f655467f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:02.911553 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760d7c4-7222-4511-827a-e5d0f655467f None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:02.912226 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760d7c4-7222-4511-827a-e5d0f655467f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:02.912533 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760d7c4-7222-4511-827a-e5d0f655467f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:02.914210 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760d7c4-7222-4511-827a-e5d0f655467f None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:02.921768 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:02.925933 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 259/503] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:02.927152 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c82ada-3f59-44a5-91ef-34cb167f9729 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:02.927465 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c82ada-3f59-44a5-91ef-34cb167f9729 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:02.927745 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c82ada-3f59-44a5-91ef-34cb167f9729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:02.946292 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c8c82ada-3f59-44a5-91ef-34cb167f9729 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:02.947499 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c8c82ada-3f59-44a5-91ef-34cb167f9729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:02.970101 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:02.998038 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2119eb-225f-453a-8cde-7b38c7a51a51 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:03.017858 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 260/504] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:03:03.018709 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c82ada-3f59-44a5-91ef-34cb167f9729 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:03.036386 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91212bd-d707-483b-94b5-28ffd9826a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:03.037132 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91212bd-d707-483b-94b5-28ffd9826a5d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:03.037480 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91212bd-d707-483b-94b5-28ffd9826a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:03.037871 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91212bd-d707-483b-94b5-28ffd9826a5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:03.124263 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91212bd-d707-483b-94b5-28ffd9826a5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:03.125813 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91212bd-d707-483b-94b5-28ffd9826a5d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:03.134818 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c82ada-3f59-44a5-91ef-34cb167f9729 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:03.156703 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:03.170869 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b150dc7-bd16-43a2-9fa1-29a9dc5002df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:03.171523 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b150dc7-bd16-43a2-9fa1-29a9dc5002df None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:03.171875 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b150dc7-bd16-43a2-9fa1-29a9dc5002df None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:03.172250 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b150dc7-bd16-43a2-9fa1-29a9dc5002df None admin] PATH_INFO: `/v3/roles/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:03.183163 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b150dc7-bd16-43a2-9fa1-29a9dc5002df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:03:03.188090 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-9b150dc7-bd16-43a2-9fa1-29a9dc5002df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:03.188090 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:03.188090 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:03.188090 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:03.188090 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:03.188090 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:03.188090 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:03.188090 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:03.188090 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:03.188090 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:03.188090 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:03.188090 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:03.188090 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:03:03.188090 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:03:03.188090 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:03:03.188090 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:03:03.189313 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:03:03.189313 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:03:03.189313 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:03:03.189313 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:03:03.189313 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:03.189313 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:03.189313 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:03.189313 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:03.189313 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:03.189313 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:03.189313 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:03.189313 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:03.189313 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:03.189313 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:03.189313 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:03.189313 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:03.190186 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:03.190186 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:03.190186 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:03.190186 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:03.190186 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:03:03.190186 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:03:03.190186 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:03:03.190186 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:03:03.190186 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:03:03.190186 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:03:03.190186 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:03.190186 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:03.190186 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 261/505] 10.222.0.81 () {56 vars in 1102 bytes} [Tue Sep 6 21:03:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:03.191250 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b150dc7-bd16-43a2-9fa1-29a9dc5002df None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:03.210826 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:03.240891 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 245/506] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:03:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 21:03:03.240891 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91212bd-d707-483b-94b5-28ffd9826a5d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:03.305519 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b150dc7-bd16-43a2-9fa1-29a9dc5002df None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:03.340390 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db97cf5-6a31-4093-a97e-499575ac3929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:03.341026 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db97cf5-6a31-4093-a97e-499575ac3929 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:03.341306 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db97cf5-6a31-4093-a97e-499575ac3929 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:03.341581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db97cf5-6a31-4093-a97e-499575ac3929 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:03.348695 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db97cf5-6a31-4093-a97e-499575ac3929 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:03.348980 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91212bd-d707-483b-94b5-28ffd9826a5d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:03.350163 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db97cf5-6a31-4093-a97e-499575ac3929 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:03.361790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-9db97cf5-6a31-4093-a97e-499575ac3929 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 21:03:03.361790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:03.361790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:03.361790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:03.361790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:03.361790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:03.361790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:03.361790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:03.361790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:03.361790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:03.361790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:03.361790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:03.361790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:03:03.361790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:03:03.361790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:03:03.361790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:03:03.362880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:03.362880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:03.362880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:03:03.362880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:03.362880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:03:03.362880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:03.362880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:03.362880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:03.362880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:03.362880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:03.362880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:03.362880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:03.362880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:03.362880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:03.362880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:03.362880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:03.362880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:03.362880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:03.363804 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:03.363804 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:03.363804 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:03:03.363804 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:03:03.363804 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:03:03.363804 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:03:03.363804 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:03:03.363804 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:03:03.363804 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 21:03:03.363804 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:03.363804 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 262/507] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:03:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:03.364446 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db97cf5-6a31-4093-a97e-499575ac3929 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:03.386907 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:03.392620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417a80e-47f2-4aa7-afbf-ab57bdfecc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:03.393263 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417a80e-47f2-4aa7-afbf-ab57bdfecc7d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:03.393536 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417a80e-47f2-4aa7-afbf-ab57bdfecc7d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:03.393815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4417a80e-47f2-4aa7-afbf-ab57bdfecc7d None admin] PATH_INFO: `/v3/users/glance` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:03.401774 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417a80e-47f2-4aa7-afbf-ab57bdfecc7d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:03.402837 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4417a80e-47f2-4aa7-afbf-ab57bdfecc7d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:03.416365 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-4417a80e-47f2-4aa7-afbf-ab57bdfecc7d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 06 21:03:03.416365 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:03.416365 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:03.416365 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:03.416365 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:03.416365 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:03.416365 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:03.416365 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:03.416365 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:03.416365 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:03.416365 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:03.416365 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:03.416365 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:03:03.416365 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:03:03.416365 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:03:03.416365 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:03:03.417430 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:03.417430 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:03.417430 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:03:03.417430 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:03.417430 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:03:03.417430 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:03.417430 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:03.417430 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:03.417430 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:03.417430 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:03.417430 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:03.417430 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:03.417430 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:03.417430 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:03.417430 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:03.417430 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:03.417430 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:03.417430 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:03.418600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:03.418600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:03.418600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:03:03.418600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:03:03.418600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:03:03.418600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:03:03.418600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:03:03.418600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:03:03.418600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 06 21:03:03.418600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:03.418600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 246/508] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:03:03 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:03.419405 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417a80e-47f2-4aa7-afbf-ab57bdfecc7d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:03.446753 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:03.467280 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db97cf5-6a31-4093-a97e-499575ac3929 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:03.502328 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e468d9-3ce1-410c-b7d0-8422e00d8870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:03.502938 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e468d9-3ce1-410c-b7d0-8422e00d8870 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:03.503218 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e468d9-3ce1-410c-b7d0-8422e00d8870 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:03.503491 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e468d9-3ce1-410c-b7d0-8422e00d8870 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:03.504169 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e468d9-3ce1-410c-b7d0-8422e00d8870 None admin] RBAC: Adding query filter params (name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:03.504473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e468d9-3ce1-410c-b7d0-8422e00d8870 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:03.505853 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e468d9-3ce1-410c-b7d0-8422e00d8870 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:03.513540 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 263/509] 10.222.0.81 () {56 vars in 1103 bytes} [Tue Sep 6 21:03:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:03.514319 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e468d9-3ce1-410c-b7d0-8422e00d8870 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:03.522544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4417a80e-47f2-4aa7-afbf-ab57bdfecc7d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:03.556562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5b4b6-333f-4a30-a45a-9d7cc23747c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:03.557196 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5b4b6-333f-4a30-a45a-9d7cc23747c0 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:03.557481 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5b4b6-333f-4a30-a45a-9d7cc23747c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:03.557763 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5b4b6-333f-4a30-a45a-9d7cc23747c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:03.569092 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5b4b6-333f-4a30-a45a-9d7cc23747c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:03.570556 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5b4b6-333f-4a30-a45a-9d7cc23747c0 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:03.584547 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-aee5b4b6-333f-4a30-a45a-9d7cc23747c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:03.584547 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:03.584547 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:03.584547 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:03.584547 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:03.584547 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:03.584547 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:03.584547 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:03.584547 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:03.584547 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:03.584547 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:03.584547 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:03.584547 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:03.584547 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:03.584547 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:03.584547 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:03.585516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:03.585516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:03.585516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:03.585516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:03.585516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:03.585516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:03.585516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:03.585516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:03.585516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:03.585516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:03.585516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:03.585516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:03.585516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:03.585516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:03.585516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:03.585516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:03.585516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:03.586358 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:03.586358 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:03.586358 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:03.586358 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 247/510] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:03.586587 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5b4b6-333f-4a30-a45a-9d7cc23747c0 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:03.615470 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e468d9-3ce1-410c-b7d0-8422e00d8870 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:03.630753 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:03.650194 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8514d48-c9b2-4c23-acb5-51914e3e9809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:03.650823 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8514d48-c9b2-4c23-acb5-51914e3e9809 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:03.651102 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8514d48-c9b2-4c23-acb5-51914e3e9809 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:03.651374 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8514d48-c9b2-4c23-acb5-51914e3e9809 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:03.659883 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:03.662162 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8514d48-c9b2-4c23-acb5-51914e3e9809 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:03.663905 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8514d48-c9b2-4c23-acb5-51914e3e9809 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:03.678871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-e8514d48-c9b2-4c23-acb5-51914e3e9809 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:03.678871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:03.678871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:03.678871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:03.678871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:03.678871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:03.678871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:03.678871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:03.678871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:03.678871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:03.678871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:03.678871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:03.678871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:03.678871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:03.678871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:03.678871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:03.681106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:03.681106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:03.681106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:03.681106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:03.681106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:03.681106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:03.681106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:03.681106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:03.681106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:03.681106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:03.681106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:03.681106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:03.681106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:03.681106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:03.681106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:03.681106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:03.681106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:03.681963 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:03.681963 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:03.681963 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:03.681963 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 264/511] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:03.681963 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8514d48-c9b2-4c23-acb5-51914e3e9809 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:03.693575 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5b4b6-333f-4a30-a45a-9d7cc23747c0 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:03.727177 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb09ee-8294-47f9-aa2b-0ea2f52436a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:03.727650 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb09ee-8294-47f9-aa2b-0ea2f52436a4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:03.727930 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb09ee-8294-47f9-aa2b-0ea2f52436a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:03.728230 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cb09ee-8294-47f9-aa2b-0ea2f52436a4 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:03.728956 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb09ee-8294-47f9-aa2b-0ea2f52436a4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:03.729261 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb09ee-8294-47f9-aa2b-0ea2f52436a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:03.730684 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cb09ee-8294-47f9-aa2b-0ea2f52436a4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:03.767563 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 248/512] 10.222.0.81 () {56 vars in 1137 bytes} [Tue Sep 6 21:03:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:03.768241 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb09ee-8294-47f9-aa2b-0ea2f52436a4 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:03.784614 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8514d48-c9b2-4c23-acb5-51914e3e9809 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:03.821158 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9997d-b6c0-4d72-9d8b-6de34b2e36f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:03.821878 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9997d-b6c0-4d72-9d8b-6de34b2e36f6 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:03.822162 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9997d-b6c0-4d72-9d8b-6de34b2e36f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:03.822438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9997d-b6c0-4d72-9d8b-6de34b2e36f6 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:03.823187 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9997d-b6c0-4d72-9d8b-6de34b2e36f6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:03.823495 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9997d-b6c0-4d72-9d8b-6de34b2e36f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:03.824958 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9997d-b6c0-4d72-9d8b-6de34b2e36f6 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:03.842737 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 265/513] 10.222.0.81 () {56 vars in 1137 bytes} [Tue Sep 6 21:03:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:03.843574 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9997d-b6c0-4d72-9d8b-6de34b2e36f6 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:03.870092 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:03.873513 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cb09ee-8294-47f9-aa2b-0ea2f52436a4 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:03.893077 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:03.910299 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533cd3e1-45d4-4118-b50f-c4da8fab0aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:03.910933 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cd3e1-45d4-4118-b50f-c4da8fab0aad None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:03.911229 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cd3e1-45d4-4118-b50f-c4da8fab0aad None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:03.911485 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cd3e1-45d4-4118-b50f-c4da8fab0aad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:03.922790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533cd3e1-45d4-4118-b50f-c4da8fab0aad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:03.924272 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533cd3e1-45d4-4118-b50f-c4da8fab0aad None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:03.938815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-533cd3e1-45d4-4118-b50f-c4da8fab0aad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:03.938815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:03.938815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:03.938815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:03.938815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:03.938815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:03.938815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:03.938815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:03.938815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:03.938815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:03.938815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:03.938815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:03.938815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:03.938815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:03.938815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:03.938815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:03.944271 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:03.944271 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:03.944271 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:03.944271 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:03.944271 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:03.944271 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:03.944271 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:03.944271 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:03.944271 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:03.944271 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:03.944271 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:03.944271 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:03.944271 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:03.944271 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:03.944271 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:03.944271 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:03.944271 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:03.945214 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:03.945214 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:03.945214 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:03.945214 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 249/514] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:03.945214 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533cd3e1-45d4-4118-b50f-c4da8fab0aad None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:03.947882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9997d-b6c0-4d72-9d8b-6de34b2e36f6 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:03.983172 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691868c0-b2b0-463a-b615-4c663c800833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:03.983905 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691868c0-b2b0-463a-b615-4c663c800833 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:03.984215 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691868c0-b2b0-463a-b615-4c663c800833 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:03.984498 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691868c0-b2b0-463a-b615-4c663c800833 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:03.985161 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691868c0-b2b0-463a-b615-4c663c800833 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:03.985462 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691868c0-b2b0-463a-b615-4c663c800833 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:03.986835 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691868c0-b2b0-463a-b615-4c663c800833 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:03.998160 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 266/515] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:03.998989 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691868c0-b2b0-463a-b615-4c663c800833 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:04.047069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533cd3e1-45d4-4118-b50f-c4da8fab0aad None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:04.080355 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f112d-9e17-4934-bdf2-cb3c3da741d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:04.081009 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f112d-9e17-4934-bdf2-cb3c3da741d5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:04.081285 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f112d-9e17-4934-bdf2-cb3c3da741d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:04.081556 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f112d-9e17-4934-bdf2-cb3c3da741d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:04.082194 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f112d-9e17-4934-bdf2-cb3c3da741d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:04.082494 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f112d-9e17-4934-bdf2-cb3c3da741d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:04.083860 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f112d-9e17-4934-bdf2-cb3c3da741d5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:04.095940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 250/516] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:04.096754 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f112d-9e17-4934-bdf2-cb3c3da741d5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:04.098365 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691868c0-b2b0-463a-b615-4c663c800833 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:04.110107 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:04.113946 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:04.134004 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdacc7-f4fe-41cf-80d8-3a5d40c9d285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:04.134613 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdacc7-f4fe-41cf-80d8-3a5d40c9d285 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:04.134894 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdacc7-f4fe-41cf-80d8-3a5d40c9d285 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:04.135169 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdacc7-f4fe-41cf-80d8-3a5d40c9d285 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:04.197665 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f112d-9e17-4934-bdf2-cb3c3da741d5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:04.204887 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cdacc7-f4fe-41cf-80d8-3a5d40c9d285 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:04.206373 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cdacc7-f4fe-41cf-80d8-3a5d40c9d285 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:04.232364 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d975a8-9db7-4a57-91ff-daabeb530a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:04.233107 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d975a8-9db7-4a57-91ff-daabeb530a8c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:04.233435 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d975a8-9db7-4a57-91ff-daabeb530a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:04.233654 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d975a8-9db7-4a57-91ff-daabeb530a8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:04.300845 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d975a8-9db7-4a57-91ff-daabeb530a8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:04.302362 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d975a8-9db7-4a57-91ff-daabeb530a8c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:04.313288 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 267/517] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:03:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 21:03:04.314219 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdacc7-f4fe-41cf-80d8-3a5d40c9d285 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:04.316257 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:04.327707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:04.402695 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 251/518] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:03:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 21:03:04.405365 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d975a8-9db7-4a57-91ff-daabeb530a8c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:04.419998 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdacc7-f4fe-41cf-80d8-3a5d40c9d285 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:04.453785 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b5164-88a2-4253-b97d-5385f46f38da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:04.454442 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b5164-88a2-4253-b97d-5385f46f38da None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:04.454667 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b5164-88a2-4253-b97d-5385f46f38da None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:04.454946 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52b5164-88a2-4253-b97d-5385f46f38da None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:04.455574 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b5164-88a2-4253-b97d-5385f46f38da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:04.455935 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b5164-88a2-4253-b97d-5385f46f38da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:04.457355 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52b5164-88a2-4253-b97d-5385f46f38da None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:04.469052 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 268/519] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:04.469837 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b5164-88a2-4253-b97d-5385f46f38da None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:04.515002 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d975a8-9db7-4a57-91ff-daabeb530a8c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:04.528286 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:04.537956 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:04.548794 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8510475-41d7-401e-984c-0a9921c1e851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:04.549421 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8510475-41d7-401e-984c-0a9921c1e851 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:04.549699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8510475-41d7-401e-984c-0a9921c1e851 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:04.549970 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8510475-41d7-401e-984c-0a9921c1e851 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:04.556998 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8510475-41d7-401e-984c-0a9921c1e851 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:04.558418 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8510475-41d7-401e-984c-0a9921c1e851 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:04.568274 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52b5164-88a2-4253-b97d-5385f46f38da None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:04.575951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-c8510475-41d7-401e-984c-0a9921c1e851 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:04.575951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:04.575951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:04.575951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:04.575951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:04.575951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:04.575951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:04.575951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:04.575951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:04.575951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:04.575951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:04.575951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:04.575951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:03:04.575951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:03:04.575951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:03:04.576909 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:03:04.576909 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:04.576909 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:04.576909 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:04.576909 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:04.576909 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:04.576909 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:04.576909 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:04.576909 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:04.576909 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:04.576909 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:04.576909 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:04.576909 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:04.576909 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:04.576909 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:04.576909 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:04.576909 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:04.577804 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:03:04.577804 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:03:04.577804 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:03:04.577804 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:03:04.577804 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:03:04.577804 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:03:04.577804 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:04.577804 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:04.577804 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 252/520] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:03:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:04.577804 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8510475-41d7-401e-984c-0a9921c1e851 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:04.602543 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20841cc9-a8bd-4a52-83bc-5e7bcb7227c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:04.603153 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20841cc9-a8bd-4a52-83bc-5e7bcb7227c7 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:04.603439 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20841cc9-a8bd-4a52-83bc-5e7bcb7227c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:04.603716 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20841cc9-a8bd-4a52-83bc-5e7bcb7227c7 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:04.604387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20841cc9-a8bd-4a52-83bc-5e7bcb7227c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:04.605822 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20841cc9-a8bd-4a52-83bc-5e7bcb7227c7 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:04.673796 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8510475-41d7-401e-984c-0a9921c1e851 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:04.707307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09547b2-a68c-4998-8602-fed58edc4c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:04.707935 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 269/521] 10.222.0.81 () {60 vars in 1132 bytes} [Tue Sep 6 21:03:04 2022] POST /identity/v3/users => generated 247 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:03:04.708408 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09547b2-a68c-4998-8602-fed58edc4c60 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:04.708408 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09547b2-a68c-4998-8602-fed58edc4c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:04.708572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09547b2-a68c-4998-8602-fed58edc4c60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:04.708793 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20841cc9-a8bd-4a52-83bc-5e7bcb7227c7 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:04.731083 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09547b2-a68c-4998-8602-fed58edc4c60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:04.732764 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09547b2-a68c-4998-8602-fed58edc4c60 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:04.752307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-e09547b2-a68c-4998-8602-fed58edc4c60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:04.752307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:04.752307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:04.752307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:04.752307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:04.752307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:04.752307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:04.752307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:04.752307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:04.752307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:04.752307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:04.752307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:04.752307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:04.752307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:04.752307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:04.752307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:04.753444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:04.753444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:04.753444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:04.753444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:04.753444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:04.753444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:04.753444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:04.753444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:04.753444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:04.753444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:04.753444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:04.753444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:04.753444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:04.753444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:04.753444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:04.753444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:04.753444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:04.760151 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:04.760151 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:04.760151 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:04.760151 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 253/522] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:04.760151 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09547b2-a68c-4998-8602-fed58edc4c60 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:04.787626 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:04.828367 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20841cc9-a8bd-4a52-83bc-5e7bcb7227c7 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:04.858974 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:04.869431 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f244a-2f74-46ca-b5a4-f4b78dbf5644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:04.870182 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f244a-2f74-46ca-b5a4-f4b78dbf5644 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:04.870560 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f244a-2f74-46ca-b5a4-f4b78dbf5644 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:04.870893 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f244a-2f74-46ca-b5a4-f4b78dbf5644 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:04.880402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09547b2-a68c-4998-8602-fed58edc4c60 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:04.882214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f244a-2f74-46ca-b5a4-f4b78dbf5644 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:04.884279 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f244a-2f74-46ca-b5a4-f4b78dbf5644 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:04.899103 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-a50f244a-2f74-46ca-b5a4-f4b78dbf5644 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:04.899103 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:04.899103 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:04.899103 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:04.899103 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:04.899103 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:04.899103 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:04.899103 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:04.899103 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:04.899103 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:04.899103 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:04.899103 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:04.899103 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:04.899103 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:04.899103 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:04.899103 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:04.900298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:04.900298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:04.900298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:04.900298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:04.900298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:04.900298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:04.900298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:04.900298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:04.900298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:04.900298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:04.900298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:04.900298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:04.900298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:04.900298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:04.900298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:04.900298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:04.900298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:04.901815 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:04.901815 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:04.901815 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:04.901815 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 270/523] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:04.902055 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f244a-2f74-46ca-b5a4-f4b78dbf5644 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:04.925041 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c8c5b-cd5c-41a7-a9cb-a3dc73bbc932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:04.925697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c8c5b-cd5c-41a7-a9cb-a3dc73bbc932 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:04.925984 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c8c5b-cd5c-41a7-a9cb-a3dc73bbc932 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:04.926325 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c8c5b-cd5c-41a7-a9cb-a3dc73bbc932 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:04.935354 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c8c5b-cd5c-41a7-a9cb-a3dc73bbc932 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:04.936948 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c8c5b-cd5c-41a7-a9cb-a3dc73bbc932 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:04.950944 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-334c8c5b-cd5c-41a7-a9cb-a3dc73bbc932 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 21:03:04.950944 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:04.950944 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:04.950944 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:04.950944 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:04.950944 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:04.950944 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:04.950944 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:04.950944 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:04.950944 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:04.950944 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:04.950944 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:04.950944 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:03:04.950944 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:03:04.950944 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:03:04.950944 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:03:04.952068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:04.952068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:04.952068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:03:04.952068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:04.952068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:03:04.952068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:04.952068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:04.952068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:04.952068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:04.952068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:04.952068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:04.952068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:04.952068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:04.952068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:04.952068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:04.952068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:04.952068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:04.952068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:04.953115 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:04.953115 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:04.953115 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:03:04.953115 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:03:04.953115 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:03:04.953115 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:03:04.953115 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:03:04.953115 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:03:04.953115 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 21:03:04.953115 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:04.953115 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 254/524] 10.222.0.81 () {56 vars in 1102 bytes} [Tue Sep 6 21:03:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:04.953115 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c8c5b-cd5c-41a7-a9cb-a3dc73bbc932 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:05.019545 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f244a-2f74-46ca-b5a4-f4b78dbf5644 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:05.042831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:05.057659 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4ada6-8221-4aca-b653-2d2b226b2d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:05.058369 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4ada6-8221-4aca-b653-2d2b226b2d08 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:05.058711 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4ada6-8221-4aca-b653-2d2b226b2d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:05.059047 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4ada6-8221-4aca-b653-2d2b226b2d08 None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:05.059805 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4ada6-8221-4aca-b653-2d2b226b2d08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:05.060207 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4ada6-8221-4aca-b653-2d2b226b2d08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:05.060463 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c8c5b-cd5c-41a7-a9cb-a3dc73bbc932 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:05.061780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4ada6-8221-4aca-b653-2d2b226b2d08 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:05.085730 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 271/525] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:03:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:05.086729 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4ada6-8221-4aca-b653-2d2b226b2d08 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:05.102610 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e51f82-2cb7-423b-9f90-4d7ce2606fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:05.103507 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e51f82-2cb7-423b-9f90-4d7ce2606fec None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:05.103882 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e51f82-2cb7-423b-9f90-4d7ce2606fec None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:05.104290 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e51f82-2cb7-423b-9f90-4d7ce2606fec None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:05.105058 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e51f82-2cb7-423b-9f90-4d7ce2606fec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:05.105990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e51f82-2cb7-423b-9f90-4d7ce2606fec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:05.107858 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e51f82-2cb7-423b-9f90-4d7ce2606fec None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:05.122318 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 255/526] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:05.123261 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e51f82-2cb7-423b-9f90-4d7ce2606fec None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:05.142525 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:05.212425 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4ada6-8221-4aca-b653-2d2b226b2d08 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:05.248612 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e51f82-2cb7-423b-9f90-4d7ce2606fec None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:05.248804 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2101106-d4b8-40bc-b7b2-ca6a591fab66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:05.249234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2101106-d4b8-40bc-b7b2-ca6a591fab66 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:05.249517 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2101106-d4b8-40bc-b7b2-ca6a591fab66 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:05.249793 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2101106-d4b8-40bc-b7b2-ca6a591fab66 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:05.250609 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2101106-d4b8-40bc-b7b2-ca6a591fab66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:05.250767 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2101106-d4b8-40bc-b7b2-ca6a591fab66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:05.252327 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2101106-d4b8-40bc-b7b2-ca6a591fab66 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:05.269377 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 272/527] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:05.269377 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2101106-d4b8-40bc-b7b2-ca6a591fab66 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:05.292642 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73751f-d568-4319-9fe5-5c35e571c2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:05.293443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73751f-d568-4319-9fe5-5c35e571c2d5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:05.293731 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73751f-d568-4319-9fe5-5c35e571c2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:05.294573 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c73751f-d568-4319-9fe5-5c35e571c2d5 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:05.295378 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c73751f-d568-4319-9fe5-5c35e571c2d5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:05.295677 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c73751f-d568-4319-9fe5-5c35e571c2d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:05.297199 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c73751f-d568-4319-9fe5-5c35e571c2d5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:05.318544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 256/528] 10.222.0.81 () {56 vars in 1139 bytes} [Tue Sep 6 21:03:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:05.319512 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73751f-d568-4319-9fe5-5c35e571c2d5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:05.325719 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:05.377849 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:05.381574 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2101106-d4b8-40bc-b7b2-ca6a591fab66 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:05.419715 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0aeb2-75de-4662-9541-987df3862292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:05.420532 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0aeb2-75de-4662-9541-987df3862292 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:05.420903 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0aeb2-75de-4662-9541-987df3862292 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:05.421277 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0aeb2-75de-4662-9541-987df3862292 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:05.422106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0aeb2-75de-4662-9541-987df3862292 None admin] RBAC: Adding query filter params (role.id=747c70d4cefb4a82816c17da1259b90f, scope.project.id=002e09339d4e49ce98434571d3b64248, user.id=4441d8fea57f401a96fb8cbd2b501059) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:05.422412 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0aeb2-75de-4662-9541-987df3862292 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:05.423929 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0aeb2-75de-4662-9541-987df3862292 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:05.430142 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 273/529] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:03:05 2022] GET /identity/v3/role_assignments?user.id=4441d8fea57f401a96fb8cbd2b501059&scope.project.id=002e09339d4e49ce98434571d3b64248&role.id=747c70d4cefb4a82816c17da1259b90f => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:05.430904 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c73751f-d568-4319-9fe5-5c35e571c2d5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:05.431013 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0aeb2-75de-4662-9541-987df3862292 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:05.485814 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ff696-7d47-440c-a899-4d5686888d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:05.486555 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ff696-7d47-440c-a899-4d5686888d23 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:05.486837 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ff696-7d47-440c-a899-4d5686888d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:05.487108 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ff696-7d47-440c-a899-4d5686888d23 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:05.497954 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ff696-7d47-440c-a899-4d5686888d23 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:05.500175 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ff696-7d47-440c-a899-4d5686888d23 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:05.517122 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-7f9ff696-7d47-440c-a899-4d5686888d23 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:05.517122 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:05.517122 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:05.517122 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:05.517122 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:05.517122 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:05.517122 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:05.517122 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:05.517122 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:05.517122 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:05.517122 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:05.517122 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:05.517122 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:03:05.517122 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:03:05.517122 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:03:05.518232 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:03:05.518232 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:05.518232 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:05.518232 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:05.518232 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:05.518232 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:05.518232 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:05.518232 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:05.518232 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:05.518232 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:05.518232 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:05.518232 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:05.518232 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:05.518232 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:05.518232 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:05.518232 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:05.518232 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:05.519281 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:03:05.519281 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:03:05.519281 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:03:05.519281 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:03:05.519281 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:03:05.519281 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:03:05.519281 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:05.519281 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:05.519281 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 257/530] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:03:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:05.519778 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ff696-7d47-440c-a899-4d5686888d23 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:05.583973 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0aeb2-75de-4662-9541-987df3862292 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:05.623105 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:05.635298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9128627c-e27a-4736-bae1-0f308154ca53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:05.635946 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128627c-e27a-4736-bae1-0f308154ca53 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:05.636256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128627c-e27a-4736-bae1-0f308154ca53 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:05.636532 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128627c-e27a-4736-bae1-0f308154ca53 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:05.644082 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9128627c-e27a-4736-bae1-0f308154ca53 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:05.650871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9128627c-e27a-4736-bae1-0f308154ca53 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:05.660247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-9128627c-e27a-4736-bae1-0f308154ca53 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:05.660247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:05.660247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:05.660247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:05.660247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:05.660247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:05.660247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:05.660247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:05.660247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:05.660247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:05.660247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:05.660247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:05.660247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:03:05.660247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:03:05.660247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:03:05.661206 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:03:05.661206 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:05.661206 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:05.661206 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:05.661206 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:05.661206 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:05.661206 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:05.661206 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:05.661206 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:05.661206 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:05.661206 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:05.661206 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:05.661206 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:05.661206 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:05.661206 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:05.661206 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:05.661206 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:05.662059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:03:05.662059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:03:05.662059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:03:05.662059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:03:05.662059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:03:05.662059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:03:05.662059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:05.662059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:05.662059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 274/531] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:03:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:05.662540 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9128627c-e27a-4736-bae1-0f308154ca53 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:05.683389 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ff696-7d47-440c-a899-4d5686888d23 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:05.696244 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:05.732353 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbf613-a174-4f45-baf2-ab54248cb3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:05.733221 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbf613-a174-4f45-baf2-ab54248cb3e5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:05.733503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbf613-a174-4f45-baf2-ab54248cb3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:05.733776 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfbf613-a174-4f45-baf2-ab54248cb3e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:05.786429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9128627c-e27a-4736-bae1-0f308154ca53 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:05.824847 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f25f9-f210-4a55-848b-48129ba26b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:05.826136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbf613-a174-4f45-baf2-ab54248cb3e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:05.826434 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f25f9-f210-4a55-848b-48129ba26b47 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:05.826920 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f25f9-f210-4a55-848b-48129ba26b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:05.827368 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f25f9-f210-4a55-848b-48129ba26b47 None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:05.827906 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfbf613-a174-4f45-baf2-ab54248cb3e5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:05.828520 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f25f9-f210-4a55-848b-48129ba26b47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:05.829058 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f25f9-f210-4a55-848b-48129ba26b47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:05.831661 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f25f9-f210-4a55-848b-48129ba26b47 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:05.853319 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 275/532] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:03:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:05.853319 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f25f9-f210-4a55-848b-48129ba26b47 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:05.901733 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:05.948951 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:05.949602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 258/533] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:03:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 21:03:05.950714 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbf613-a174-4f45-baf2-ab54248cb3e5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:05.968461 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f25f9-f210-4a55-848b-48129ba26b47 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:06.010222 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44db193-157a-4f82-ba77-a19eb8f9f775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:06.010841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44db193-157a-4f82-ba77-a19eb8f9f775 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:06.011117 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44db193-157a-4f82-ba77-a19eb8f9f775 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:06.011386 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44db193-157a-4f82-ba77-a19eb8f9f775 None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:06.012203 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44db193-157a-4f82-ba77-a19eb8f9f775 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:06.012504 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44db193-157a-4f82-ba77-a19eb8f9f775 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:06.013952 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44db193-157a-4f82-ba77-a19eb8f9f775 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:06.028376 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 276/534] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:03:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:06.029270 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44db193-157a-4f82-ba77-a19eb8f9f775 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:06.059460 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfbf613-a174-4f45-baf2-ab54248cb3e5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:06.095185 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ff251-2dfa-4388-a5d9-51a18a99fdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:06.096178 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ff251-2dfa-4388-a5d9-51a18a99fdd6 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:06.096655 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ff251-2dfa-4388-a5d9-51a18a99fdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:06.097122 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ff251-2dfa-4388-a5d9-51a18a99fdd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:06.098032 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ff251-2dfa-4388-a5d9-51a18a99fdd6 None admin] RBAC: Adding query filter params (role.id=747c70d4cefb4a82816c17da1259b90f, scope.project.id=002e09339d4e49ce98434571d3b64248, user.id=af9589aaba334db494ed0b036e94062f) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:06.098574 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ff251-2dfa-4388-a5d9-51a18a99fdd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:06.100325 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920ff251-2dfa-4388-a5d9-51a18a99fdd6 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:06.112470 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 259/535] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:03:05 2022] GET /identity/v3/role_assignments?user.id=af9589aaba334db494ed0b036e94062f&scope.project.id=002e09339d4e49ce98434571d3b64248&role.id=747c70d4cefb4a82816c17da1259b90f => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:06.113863 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ff251-2dfa-4388-a5d9-51a18a99fdd6 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:06.142074 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44db193-157a-4f82-ba77-a19eb8f9f775 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:06.165581 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:06.194162 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819589f-7ff2-4c2a-b3c4-2f785f52ef00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:06.194816 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819589f-7ff2-4c2a-b3c4-2f785f52ef00 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:06.195131 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819589f-7ff2-4c2a-b3c4-2f785f52ef00 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:06.195957 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819589f-7ff2-4c2a-b3c4-2f785f52ef00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:06.218094 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819589f-7ff2-4c2a-b3c4-2f785f52ef00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:06.221008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819589f-7ff2-4c2a-b3c4-2f785f52ef00 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:06.225667 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:06.243310 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-a819589f-7ff2-4c2a-b3c4-2f785f52ef00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:06.243310 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:06.243310 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:06.243310 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:06.243310 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:06.243310 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:06.243310 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:06.243310 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:06.243310 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:06.243310 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:06.243310 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:06.243310 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:06.243310 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:06.243310 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:06.243310 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:06.243310 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:06.248704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:06.248704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:06.248704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:06.248704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:06.248704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:06.248704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:06.248704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:06.248704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:06.248704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:06.248704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:06.248704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:06.248704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:06.248704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:06.248704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:06.248704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:06.248704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:06.248704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:06.249545 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:06.249545 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:06.249545 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:06.249545 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 277/536] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:06.252614 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819589f-7ff2-4c2a-b3c4-2f785f52ef00 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:06.308284 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ff251-2dfa-4388-a5d9-51a18a99fdd6 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:06.377962 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c29cfb-4377-4426-bddc-879614388d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:06.379541 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c29cfb-4377-4426-bddc-879614388d8e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:06.380046 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c29cfb-4377-4426-bddc-879614388d8e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:06.380553 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c29cfb-4377-4426-bddc-879614388d8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:06.381708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c29cfb-4377-4426-bddc-879614388d8e None admin] RBAC: Adding query filter params (role.id=747c70d4cefb4a82816c17da1259b90f, scope.project.id=002e09339d4e49ce98434571d3b64248, user.id=c2ba30d9c40641bf8abb580a219b5352) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:06.382290 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c29cfb-4377-4426-bddc-879614388d8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:06.384707 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c29cfb-4377-4426-bddc-879614388d8e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:06.398918 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819589f-7ff2-4c2a-b3c4-2f785f52ef00 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:06.409855 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 260/537] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:03:06 2022] GET /identity/v3/role_assignments?user.id=c2ba30d9c40641bf8abb580a219b5352&scope.project.id=002e09339d4e49ce98434571d3b64248&role.id=747c70d4cefb4a82816c17da1259b90f => generated 259 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:06.446096 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3438d74-4747-4aea-b268-ec7b3bbda120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:06.446892 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3438d74-4747-4aea-b268-ec7b3bbda120 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:06.447178 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3438d74-4747-4aea-b268-ec7b3bbda120 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:06.447457 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3438d74-4747-4aea-b268-ec7b3bbda120 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:06.448143 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3438d74-4747-4aea-b268-ec7b3bbda120 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:06.448458 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3438d74-4747-4aea-b268-ec7b3bbda120 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:06.449896 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3438d74-4747-4aea-b268-ec7b3bbda120 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:06.466103 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 278/538] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:06.472392 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c29cfb-4377-4426-bddc-879614388d8e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:06.612565 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:06.623477 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c29cfb-4377-4426-bddc-879614388d8e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:06.662959 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900f9f8-bb2e-409b-88c1-1be97519a2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:06.664875 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900f9f8-bb2e-409b-88c1-1be97519a2a7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:06.665353 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900f9f8-bb2e-409b-88c1-1be97519a2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:06.665835 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900f9f8-bb2e-409b-88c1-1be97519a2a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:06.673610 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900f9f8-bb2e-409b-88c1-1be97519a2a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:06.675551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900f9f8-bb2e-409b-88c1-1be97519a2a7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:06.689190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-0900f9f8-bb2e-409b-88c1-1be97519a2a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:06.689190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:06.689190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:06.689190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:06.689190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:06.689190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:06.689190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:06.689190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:06.689190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:06.689190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:06.689190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:06.689190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:06.689190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:03:06.689190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:03:06.689190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:03:06.690085 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:03:06.690085 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:06.690085 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:06.690085 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:06.690085 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:06.690085 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:06.690085 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:06.690085 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:06.690085 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:06.690085 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:06.690085 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:06.690085 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:06.690085 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:06.690085 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:06.690085 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:06.690085 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:06.690085 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:06.690950 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:03:06.690950 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:03:06.690950 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:03:06.690950 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:03:06.690950 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:03:06.690950 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:03:06.690950 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:06.690950 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:06.693304 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 261/539] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:03:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:06.698669 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3438d74-4747-4aea-b268-ec7b3bbda120 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:06.765060 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:06.812076 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3438d74-4747-4aea-b268-ec7b3bbda120 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:06.854287 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1ff4f9-8438-40dc-9dcb-93d7e7ffba1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:06.854524 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ff4f9-8438-40dc-9dcb-93d7e7ffba1a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:06.854719 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ff4f9-8438-40dc-9dcb-93d7e7ffba1a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:06.854964 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1ff4f9-8438-40dc-9dcb-93d7e7ffba1a None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:06.855673 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ff4f9-8438-40dc-9dcb-93d7e7ffba1a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:06.855982 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ff4f9-8438-40dc-9dcb-93d7e7ffba1a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:06.857459 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1ff4f9-8438-40dc-9dcb-93d7e7ffba1a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:06.875403 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 279/540] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:03:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:03:06.880924 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900f9f8-bb2e-409b-88c1-1be97519a2a7 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:07.002732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900f9f8-bb2e-409b-88c1-1be97519a2a7 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:07.040613 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22f979-bfc8-4cbb-98ac-cade8734ed72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:07.040613 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22f979-bfc8-4cbb-98ac-cade8734ed72 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:07.040613 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22f979-bfc8-4cbb-98ac-cade8734ed72 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:07.040613 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22f979-bfc8-4cbb-98ac-cade8734ed72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:07.041197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22f979-bfc8-4cbb-98ac-cade8734ed72 None admin] RBAC: Adding query filter params (role.id=747c70d4cefb4a82816c17da1259b90f, scope.project.id=002e09339d4e49ce98434571d3b64248, user.id=c9aebd6c7ef24f42949918c99a72722d) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:07.041386 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22f979-bfc8-4cbb-98ac-cade8734ed72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:07.042833 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22f979-bfc8-4cbb-98ac-cade8734ed72 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:07.049224 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 262/541] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:03:06 2022] GET /identity/v3/role_assignments?user.id=c9aebd6c7ef24f42949918c99a72722d&scope.project.id=002e09339d4e49ce98434571d3b64248&role.id=747c70d4cefb4a82816c17da1259b90f => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:07.232905 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4f3d9-9f8b-470c-b92a-7f40f01a9f31 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:07.233299 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4f3d9-9f8b-470c-b92a-7f40f01a9f31 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:07.233497 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4f3d9-9f8b-470c-b92a-7f40f01a9f31 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:07.235148 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 280/542] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:07.240916 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834137d-3de9-415f-bd43-6adaf8bbc856 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:07.241219 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834137d-3de9-415f-bd43-6adaf8bbc856 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:07.241466 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834137d-3de9-415f-bd43-6adaf8bbc856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:07.262250 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-7834137d-3de9-415f-bd43-6adaf8bbc856 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:07.263388 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7834137d-3de9-415f-bd43-6adaf8bbc856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:07.274659 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:07.341376 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 263/543] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 21:03:07.665279 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4f3d9-9f8b-470c-b92a-7f40f01a9f31 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:07.808839 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4f3d9-9f8b-470c-b92a-7f40f01a9f31 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:07.824418 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:07.852240 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129e2b2-9beb-4004-b84c-419025e3b309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:07.852888 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129e2b2-9beb-4004-b84c-419025e3b309 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:07.853168 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129e2b2-9beb-4004-b84c-419025e3b309 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:07.853442 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129e2b2-9beb-4004-b84c-419025e3b309 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:07.874576 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0129e2b2-9beb-4004-b84c-419025e3b309 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:03:07.879346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-0129e2b2-9beb-4004-b84c-419025e3b309 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:07.879346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:07.879346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:07.879346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:07.879346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:07.879346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:07.879346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:07.879346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:07.879346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:07.879346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:07.879346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:07.879346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:07.879346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:03:07.879346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:03:07.879346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:03:07.879346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:03:07.880244 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:03:07.880244 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:03:07.880244 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:03:07.880244 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:03:07.880244 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:07.880244 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:07.880244 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:07.880244 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:07.880244 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:07.880244 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:07.880244 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:07.880244 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:07.880244 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:07.880244 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:07.880244 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:07.880244 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:07.881198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:07.881198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:07.881198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:07.881198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:07.881198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:03:07.881198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:03:07.881198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:03:07.881198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:03:07.881198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:03:07.881198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:03:07.881198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:07.881198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:07.881198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 281/544] 10.222.0.81 () {56 vars in 1102 bytes} [Tue Sep 6 21:03:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:07.886499 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834137d-3de9-415f-bd43-6adaf8bbc856 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:07.933272 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9565e-2748-402e-89d7-e509cd5d3cd6 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:07.933451 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9565e-2748-402e-89d7-e509cd5d3cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:07.933719 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9565e-2748-402e-89d7-e509cd5d3cd6 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:07.935311 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 282/545] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:07.940506 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf48f90-5889-4d5f-8ed1-b55621f41890 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:07.940782 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf48f90-5889-4d5f-8ed1-b55621f41890 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:07.941059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf48f90-5889-4d5f-8ed1-b55621f41890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:07.967051 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-adf48f90-5889-4d5f-8ed1-b55621f41890 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:07.968288 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-adf48f90-5889-4d5f-8ed1-b55621f41890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:08.060132 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834137d-3de9-415f-bd43-6adaf8bbc856 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:08.089137 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 283/546] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 06 21:03:08.114380 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb185b-20f8-41c6-a47b-bbc99954b4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:08.115036 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb185b-20f8-41c6-a47b-bbc99954b4fc None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:08.115317 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb185b-20f8-41c6-a47b-bbc99954b4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:08.115585 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eb185b-20f8-41c6-a47b-bbc99954b4fc None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:08.116266 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb185b-20f8-41c6-a47b-bbc99954b4fc None admin] RBAC: Adding query filter params (name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:08.116566 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb185b-20f8-41c6-a47b-bbc99954b4fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:08.118024 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eb185b-20f8-41c6-a47b-bbc99954b4fc None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:08.127406 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 264/547] 10.222.0.81 () {56 vars in 1103 bytes} [Tue Sep 6 21:03:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:08.133284 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf48f90-5889-4d5f-8ed1-b55621f41890 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:08.284073 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf48f90-5889-4d5f-8ed1-b55621f41890 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:08.289426 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:08.331593 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376dd0a-2553-422e-a5f3-5a4578a37856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:08.332271 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376dd0a-2553-422e-a5f3-5a4578a37856 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:08.332548 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376dd0a-2553-422e-a5f3-5a4578a37856 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:08.332818 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376dd0a-2553-422e-a5f3-5a4578a37856 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:08.347251 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376dd0a-2553-422e-a5f3-5a4578a37856 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:08.348740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376dd0a-2553-422e-a5f3-5a4578a37856 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:08.367733 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-5376dd0a-2553-422e-a5f3-5a4578a37856 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:08.367733 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:08.367733 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:08.367733 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:08.367733 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:08.367733 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:08.367733 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:08.367733 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:08.367733 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:08.367733 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:08.367733 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:08.367733 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:08.367733 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:08.367733 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:08.367733 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:08.367733 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:08.368713 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:08.368713 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:08.368713 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:08.368713 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:08.368713 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:08.368713 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:08.368713 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:08.368713 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:08.368713 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:08.368713 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:08.368713 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:08.368713 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:08.368713 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:08.368713 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:08.368713 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:08.368713 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:08.368713 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:08.370675 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:08.370675 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:08.370675 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:08.370675 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 284/548] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:08.374664 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb185b-20f8-41c6-a47b-bbc99954b4fc None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:08.384773 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:08.486730 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eb185b-20f8-41c6-a47b-bbc99954b4fc None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:08.523045 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566271e-c796-45dd-9669-8785776f3ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:08.524153 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566271e-c796-45dd-9669-8785776f3ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:08.524438 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566271e-c796-45dd-9669-8785776f3ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:08.524701 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566271e-c796-45dd-9669-8785776f3ea9 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:08.525339 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e566271e-c796-45dd-9669-8785776f3ea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:08.525710 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e566271e-c796-45dd-9669-8785776f3ea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:08.527068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e566271e-c796-45dd-9669-8785776f3ea9 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:08.540898 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 265/549] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:08.545681 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376dd0a-2553-422e-a5f3-5a4578a37856 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:08.547049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566271e-c796-45dd-9669-8785776f3ea9 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:08.627613 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:08.657042 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376dd0a-2553-422e-a5f3-5a4578a37856 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:08.669907 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566271e-c796-45dd-9669-8785776f3ea9 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:08.694778 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ad7d1-8f3d-4b7f-8f9c-56c5d190e25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:08.696354 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ad7d1-8f3d-4b7f-8f9c-56c5d190e25d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:08.696868 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ad7d1-8f3d-4b7f-8f9c-56c5d190e25d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:08.697645 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405ad7d1-8f3d-4b7f-8f9c-56c5d190e25d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:08.709618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d75c6-4dac-45cf-9de2-fd6a2a9696c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:08.710386 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d75c6-4dac-45cf-9de2-fd6a2a9696c6 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:08.710817 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d75c6-4dac-45cf-9de2-fd6a2a9696c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:08.711460 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378d75c6-4dac-45cf-9de2-fd6a2a9696c6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:08.719797 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405ad7d1-8f3d-4b7f-8f9c-56c5d190e25d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:03:08.720274 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d75c6-4dac-45cf-9de2-fd6a2a9696c6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:08.721717 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378d75c6-4dac-45cf-9de2-fd6a2a9696c6 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:08.727639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-405ad7d1-8f3d-4b7f-8f9c-56c5d190e25d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:08.727639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:08.727639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:08.727639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:08.727639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:08.727639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:08.727639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:08.727639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:08.727639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:08.727639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:08.727639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:08.727639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:08.727639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:03:08.727639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:03:08.727639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:03:08.727639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:03:08.728597 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:03:08.728597 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:03:08.728597 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:03:08.728597 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:03:08.728597 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:08.728597 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:08.728597 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:08.728597 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:08.728597 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:08.728597 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:08.728597 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:08.728597 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:08.728597 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:08.728597 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:08.728597 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:08.728597 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:08.729411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:08.729411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:08.729411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:08.729411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:08.729411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:03:08.729411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:03:08.729411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:03:08.729411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:03:08.729411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:03:08.729411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:03:08.729411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:08.729411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:08.735481 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-378d75c6-4dac-45cf-9de2-fd6a2a9696c6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 21:03:08.735481 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:08.735481 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:08.735481 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:08.735481 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:08.735481 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:08.735481 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:08.735481 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:08.735481 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:08.735481 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:08.735481 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:08.735481 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:08.735481 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:03:08.735481 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:03:08.735481 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:03:08.735481 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:03:08.736979 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:08.736979 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:08.736979 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:03:08.736979 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:08.736979 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:03:08.736979 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:08.736979 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:08.736979 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:08.736979 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:08.736979 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:08.736979 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:08.736979 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:08.736979 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:08.736979 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:08.736979 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:08.736979 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:08.736979 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:08.736979 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:08.737905 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:08.737905 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:08.737905 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:03:08.737905 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:03:08.737905 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:03:08.737905 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:03:08.737905 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:03:08.737905 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:03:08.737905 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 21:03:08.737905 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:08.737905 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 266/551] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:03:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:08.738855 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 285/551] 10.222.0.81 () {56 vars in 1102 bytes} [Tue Sep 6 21:03:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:08.745098 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d75c6-4dac-45cf-9de2-fd6a2a9696c6 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:08.745431 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ad7d1-8f3d-4b7f-8f9c-56c5d190e25d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:08.783663 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:08.918216 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405ad7d1-8f3d-4b7f-8f9c-56c5d190e25d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:08.939991 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378d75c6-4dac-45cf-9de2-fd6a2a9696c6 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:08.991357 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:08.993774 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7562d39-0110-432f-90c9-fffe9b4c877e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:08.994396 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7562d39-0110-432f-90c9-fffe9b4c877e None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:08.994681 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7562d39-0110-432f-90c9-fffe9b4c877e None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:08.994954 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7562d39-0110-432f-90c9-fffe9b4c877e None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:08.995626 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7562d39-0110-432f-90c9-fffe9b4c877e None admin] RBAC: Adding query filter params (name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:08.995929 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7562d39-0110-432f-90c9-fffe9b4c877e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:08.997355 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7562d39-0110-432f-90c9-fffe9b4c877e None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:09.006287 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 286/552] 10.222.0.81 () {56 vars in 1103 bytes} [Tue Sep 6 21:03:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:09.012633 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7562d39-0110-432f-90c9-fffe9b4c877e None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:09.012858 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fca734-d98a-481d-9d97-672d82e6e57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:09.013370 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fca734-d98a-481d-9d97-672d82e6e57a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:09.013649 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fca734-d98a-481d-9d97-672d82e6e57a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:09.013924 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fca734-d98a-481d-9d97-672d82e6e57a None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:09.014670 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fca734-d98a-481d-9d97-672d82e6e57a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:09.014978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fca734-d98a-481d-9d97-672d82e6e57a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:09.016528 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fca734-d98a-481d-9d97-672d82e6e57a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:09.036959 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 267/553] 10.222.0.81 () {56 vars in 1135 bytes} [Tue Sep 6 21:03:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:09.042441 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fca734-d98a-481d-9d97-672d82e6e57a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:09.146010 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:09.174417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7562d39-0110-432f-90c9-fffe9b4c877e None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:09.201932 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fca734-d98a-481d-9d97-672d82e6e57a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:09.231910 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c305ec-1cec-4f19-be8a-105f106a3c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:09.232582 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c305ec-1cec-4f19-be8a-105f106a3c3e None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:09.232893 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c305ec-1cec-4f19-be8a-105f106a3c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:09.233194 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c305ec-1cec-4f19-be8a-105f106a3c3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:09.240672 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9d89c-7139-439f-85ed-acd99ede8069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:09.241284 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9d89c-7139-439f-85ed-acd99ede8069 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:09.241567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9d89c-7139-439f-85ed-acd99ede8069 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:09.241842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9d89c-7139-439f-85ed-acd99ede8069 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:09.248516 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c305ec-1cec-4f19-be8a-105f106a3c3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:09.249983 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c305ec-1cec-4f19-be8a-105f106a3c3e None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:09.265901 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-b1c305ec-1cec-4f19-be8a-105f106a3c3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:09.265901 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:09.265901 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:09.265901 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:09.265901 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:09.265901 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:09.265901 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:09.265901 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:09.265901 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:09.265901 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:09.265901 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:09.265901 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:09.265901 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:09.265901 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:09.265901 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:09.265901 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:09.266915 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:09.266915 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:09.266915 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:09.266915 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:09.266915 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:09.266915 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:09.266915 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:09.266915 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:09.266915 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:09.266915 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:09.266915 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:09.266915 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:09.266915 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:09.266915 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:09.266915 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:09.266915 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:09.266915 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:09.267790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:09.267790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:09.267790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:09.267790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 287/554] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:09.268618 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cf56a-4096-4704-a26d-31b08f622fb9 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:09.268752 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cf56a-4096-4704-a26d-31b08f622fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:09.269173 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84cf56a-4096-4704-a26d-31b08f622fb9 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:09.274706 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 288/555] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:09.275991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74038f-90b2-42a5-8069-1f4fc291da09 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:09.276214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74038f-90b2-42a5-8069-1f4fc291da09 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:09.276456 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74038f-90b2-42a5-8069-1f4fc291da09 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:09.277841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 289/556] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:09.278362 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74038f-90b2-42a5-8069-1f4fc291da09 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:09.321046 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:09.336738 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9d89c-7139-439f-85ed-acd99ede8069 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:09.338237 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9d89c-7139-439f-85ed-acd99ede8069 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:09.405983 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74038f-90b2-42a5-8069-1f4fc291da09 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:09.440212 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:09.446182 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5345e-bd49-447b-bb68-127986779e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:09.446791 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5345e-bd49-447b-bb68-127986779e30 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:09.447075 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5345e-bd49-447b-bb68-127986779e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:09.447349 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5345e-bd49-447b-bb68-127986779e30 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:09.448079 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5345e-bd49-447b-bb68-127986779e30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:09.448412 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5345e-bd49-447b-bb68-127986779e30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:09.452039 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5345e-bd49-447b-bb68-127986779e30 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:09.466060 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 290/557] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:09.466060 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702742f1-9f9f-405b-9932-1518c0e61a47 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:09.466060 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702742f1-9f9f-405b-9932-1518c0e61a47 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:09.466060 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702742f1-9f9f-405b-9932-1518c0e61a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:09.466447 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 268/558] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:03:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 21:03:09.468612 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e36b8f-ce0e-411f-83e7-4266a37e45e3 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:09.469818 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e36b8f-ce0e-411f-83e7-4266a37e45e3 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:09.470338 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e36b8f-ce0e-411f-83e7-4266a37e45e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:09.487439 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-702742f1-9f9f-405b-9932-1518c0e61a47 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:09.488673 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-702742f1-9f9f-405b-9932-1518c0e61a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:09.488781 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-07e36b8f-ce0e-411f-83e7-4266a37e45e3 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:09.490009 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-07e36b8f-ce0e-411f-83e7-4266a37e45e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:09.567955 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 269/559] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:03:09.569306 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e36b8f-ce0e-411f-83e7-4266a37e45e3 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:09.575586 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 291/560] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:03:09.576198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702742f1-9f9f-405b-9932-1518c0e61a47 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:09.595081 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:09.750783 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e36b8f-ce0e-411f-83e7-4266a37e45e3 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:09.753181 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702742f1-9f9f-405b-9932-1518c0e61a47 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:09.788463 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:09.805745 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b6800-4c9f-4869-a58e-75924bbb94cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:09.806776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b6800-4c9f-4869-a58e-75924bbb94cc None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:09.807257 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b6800-4c9f-4869-a58e-75924bbb94cc None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:09.807723 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b6800-4c9f-4869-a58e-75924bbb94cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:09.822181 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b6800-4c9f-4869-a58e-75924bbb94cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:09.824314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b6800-4c9f-4869-a58e-75924bbb94cc None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:09.843001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-a82b6800-4c9f-4869-a58e-75924bbb94cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:09.843001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:09.843001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:09.843001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:09.843001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:09.843001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:09.843001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:09.843001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:09.843001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:09.843001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:09.843001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:09.843001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:09.843001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:09.843001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:09.843001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:09.843001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:09.843969 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:09.843969 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:09.843969 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:09.843969 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:09.843969 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:09.843969 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:09.843969 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:09.843969 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:09.843969 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:09.843969 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:09.843969 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:09.843969 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:09.843969 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:09.843969 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:09.843969 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:09.843969 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:09.843969 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:09.844954 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:09.844954 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:09.844954 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:09.845205 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bec85-2d9c-4784-b7ea-d5721489fc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:09.845768 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bec85-2d9c-4784-b7ea-d5721489fc49 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:09.845867 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bec85-2d9c-4784-b7ea-d5721489fc49 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:09.846083 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bec85-2d9c-4784-b7ea-d5721489fc49 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:09.847984 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 292/561] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:09.853985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b6800-4c9f-4869-a58e-75924bbb94cc None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:09.861245 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bec85-2d9c-4784-b7ea-d5721489fc49 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:09.862735 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bec85-2d9c-4784-b7ea-d5721489fc49 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:09.886154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-8c8bec85-2d9c-4784-b7ea-d5721489fc49 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 21:03:09.886154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:09.886154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:09.886154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:09.886154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:09.886154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:09.886154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:09.886154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:09.886154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:09.886154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:09.886154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:09.886154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:09.886154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:03:09.886154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:03:09.886154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:03:09.886154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:03:09.887168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:09.887168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:09.887168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:03:09.887168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:09.887168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:03:09.887168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:09.887168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:09.887168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:09.887168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:09.887168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:09.887168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:09.887168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:09.887168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:09.887168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:09.887168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:09.887168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:09.887168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:09.887168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:09.892948 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:09.892948 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:09.892948 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:03:09.892948 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:03:09.892948 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:03:09.892948 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:03:09.892948 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:03:09.892948 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:03:09.892948 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 21:03:09.892948 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:09.892948 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 270/562] 10.222.0.81 () {56 vars in 1093 bytes} [Tue Sep 6 21:03:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:09.895251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bec85-2d9c-4784-b7ea-d5721489fc49 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:09.986487 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b6800-4c9f-4869-a58e-75924bbb94cc None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:09.987076 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:10.015101 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bec85-2d9c-4784-b7ea-d5721489fc49 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:10.023870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10bcc7-ea48-46c5-850b-54d549c0b3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:10.024513 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10bcc7-ea48-46c5-850b-54d549c0b3cb None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:10.024794 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10bcc7-ea48-46c5-850b-54d549c0b3cb None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:10.025068 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10bcc7-ea48-46c5-850b-54d549c0b3cb None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:10.025707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10bcc7-ea48-46c5-850b-54d549c0b3cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:10.026008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10bcc7-ea48-46c5-850b-54d549c0b3cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:10.027385 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10bcc7-ea48-46c5-850b-54d549c0b3cb None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:10.040824 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 293/563] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:03:10.041437 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10bcc7-ea48-46c5-850b-54d549c0b3cb None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:10.052290 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b1da3-24f6-440c-b3bf-27801c39f3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:10.052909 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b1da3-24f6-440c-b3bf-27801c39f3b6 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:10.053188 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b1da3-24f6-440c-b3bf-27801c39f3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:10.053461 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437b1da3-24f6-440c-b3bf-27801c39f3b6 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:10.054190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b1da3-24f6-440c-b3bf-27801c39f3b6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:10.055020 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b1da3-24f6-440c-b3bf-27801c39f3b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:10.056466 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437b1da3-24f6-440c-b3bf-27801c39f3b6 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:10.074032 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:10.074985 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 271/564] 10.222.0.81 () {56 vars in 1133 bytes} [Tue Sep 6 21:03:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:10.075812 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b1da3-24f6-440c-b3bf-27801c39f3b6 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:10.143024 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10bcc7-ea48-46c5-850b-54d549c0b3cb None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:10.177396 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437b1da3-24f6-440c-b3bf-27801c39f3b6 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:10.177816 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3aab42-9593-4936-a9d3-496d16b7ec16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:10.178449 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3aab42-9593-4936-a9d3-496d16b7ec16 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:10.178732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3aab42-9593-4936-a9d3-496d16b7ec16 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:10.178998 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3aab42-9593-4936-a9d3-496d16b7ec16 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:10.190700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3aab42-9593-4936-a9d3-496d16b7ec16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:03:10.195421 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-bf3aab42-9593-4936-a9d3-496d16b7ec16 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:10.195421 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:10.195421 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:10.195421 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:10.195421 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:10.195421 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:10.195421 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:10.195421 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:10.195421 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:10.195421 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:10.195421 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:10.195421 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:10.195421 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:03:10.195421 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:03:10.195421 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:03:10.195421 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:03:10.196420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:03:10.196420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:03:10.196420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:03:10.196420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:03:10.196420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:10.196420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:10.196420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:10.196420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:10.196420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:10.196420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:10.196420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:10.196420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:10.196420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:10.196420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:10.196420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:10.196420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:10.197269 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:10.197269 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:10.197269 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:10.197269 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:10.197269 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:03:10.197269 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:03:10.197269 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:03:10.197269 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:03:10.197269 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:03:10.197269 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:03:10.197269 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:10.197269 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:10.197269 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 294/565] 10.222.0.81 () {56 vars in 1102 bytes} [Tue Sep 6 21:03:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:10.198046 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6a9d4-213d-43ee-8070-6419e8c1fe32 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:10.198046 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6a9d4-213d-43ee-8070-6419e8c1fe32 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:10.198907 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f6a9d4-213d-43ee-8070-6419e8c1fe32 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:10.199740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 295/566] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:10.203966 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6a9d4-213d-43ee-8070-6419e8c1fe32 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:10.210672 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:10.216699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef5861-2ad2-4da7-bfa6-bd9edc706cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:10.219670 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef5861-2ad2-4da7-bfa6-bd9edc706cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:10.219670 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef5861-2ad2-4da7-bfa6-bd9edc706cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:10.219670 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ef5861-2ad2-4da7-bfa6-bd9edc706cf5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:10.229344 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ef5861-2ad2-4da7-bfa6-bd9edc706cf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:03:10.234402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-76ef5861-2ad2-4da7-bfa6-bd9edc706cf5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:10.234402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:10.234402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:10.234402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:10.234402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:10.234402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:10.234402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:10.234402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:10.234402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:10.234402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:10.234402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:10.234402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:10.234402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:03:10.234402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:03:10.234402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:03:10.234402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:03:10.235450 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:03:10.235450 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:03:10.235450 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:03:10.235450 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:03:10.235450 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:10.235450 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:10.235450 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:10.235450 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:10.235450 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:10.235450 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:10.235450 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:10.235450 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:10.235450 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:10.235450 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:10.235450 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:10.235450 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:10.236775 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:10.236775 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:10.236775 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:10.236775 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:10.236775 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:03:10.236775 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:03:10.236775 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:03:10.236775 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:03:10.236775 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:03:10.236775 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:03:10.236775 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:10.236775 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:10.236775 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 272/567] 10.222.0.81 () {56 vars in 1102 bytes} [Tue Sep 6 21:03:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:10.236775 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef5861-2ad2-4da7-bfa6-bd9edc706cf5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:10.309238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:10.319398 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f6a9d4-213d-43ee-8070-6419e8c1fe32 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:10.346328 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ef5861-2ad2-4da7-bfa6-bd9edc706cf5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:10.356615 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba006d30-5304-4e74-bddf-b2ac8252706b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:10.357454 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba006d30-5304-4e74-bddf-b2ac8252706b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:10.357734 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba006d30-5304-4e74-bddf-b2ac8252706b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:10.358008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba006d30-5304-4e74-bddf-b2ac8252706b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:10.365539 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba006d30-5304-4e74-bddf-b2ac8252706b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:10.367637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba006d30-5304-4e74-bddf-b2ac8252706b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:10.379835 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-ba006d30-5304-4e74-bddf-b2ac8252706b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:10.379835 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:10.379835 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:10.379835 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:10.379835 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:10.379835 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:10.379835 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:10.379835 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:10.379835 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:10.379835 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:10.379835 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:10.379835 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:10.379835 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:03:10.379835 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:03:10.379835 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:03:10.380872 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:03:10.380872 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:10.380872 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:10.380872 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:10.380872 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:10.380872 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:10.380872 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:10.380872 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:10.380872 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:10.380872 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:10.380872 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:10.380872 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:10.380872 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:10.380872 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:10.380872 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:10.380872 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:10.380872 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:10.387429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:03:10.387429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:03:10.387429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:03:10.387429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:03:10.387429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:03:10.387429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:03:10.387429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:10.387429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:10.387429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 296/568] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:03:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:10.387429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba006d30-5304-4e74-bddf-b2ac8252706b None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:10.389380 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801efbd1-8186-46bf-b43f-3f6c6aed9fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:10.390032 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801efbd1-8186-46bf-b43f-3f6c6aed9fcb None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:10.390314 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801efbd1-8186-46bf-b43f-3f6c6aed9fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:10.390591 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801efbd1-8186-46bf-b43f-3f6c6aed9fcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:10.402165 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801efbd1-8186-46bf-b43f-3f6c6aed9fcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:10.403551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801efbd1-8186-46bf-b43f-3f6c6aed9fcb None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:10.418260 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-801efbd1-8186-46bf-b43f-3f6c6aed9fcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:10.418260 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:10.418260 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:10.418260 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:10.418260 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:10.418260 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:10.418260 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:10.418260 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:10.418260 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:10.418260 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:10.418260 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:10.418260 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:10.418260 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:10.418260 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:10.418260 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:10.418260 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:10.419367 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:10.419367 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:10.419367 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:10.419367 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:10.419367 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:10.419367 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:10.419367 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:10.419367 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:10.419367 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:10.419367 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:10.419367 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:10.419367 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:10.419367 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:10.419367 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:10.419367 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:10.419367 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:10.419367 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:10.420606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:10.420606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:10.420606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:10.420606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 273/569] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:10.420606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331cf41-4046-4210-a2a8-95c28bb2d5c0 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:10.420916 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331cf41-4046-4210-a2a8-95c28bb2d5c0 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:10.421142 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6331cf41-4046-4210-a2a8-95c28bb2d5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:10.439120 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-6331cf41-4046-4210-a2a8-95c28bb2d5c0 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:10.440354 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6331cf41-4046-4210-a2a8-95c28bb2d5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:10.483302 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:10.486451 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba006d30-5304-4e74-bddf-b2ac8252706b None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:10.510338 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 274/570] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:03:10.511166 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331cf41-4046-4210-a2a8-95c28bb2d5c0 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:10.535719 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14f62e-34ed-4d76-84d7-e07cf96129fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:10.536476 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14f62e-34ed-4d76-84d7-e07cf96129fa None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:10.536678 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14f62e-34ed-4d76-84d7-e07cf96129fa None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:10.536959 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14f62e-34ed-4d76-84d7-e07cf96129fa None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:10.537789 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14f62e-34ed-4d76-84d7-e07cf96129fa None admin] RBAC: Adding query filter params (name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:10.537910 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14f62e-34ed-4d76-84d7-e07cf96129fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:10.539590 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14f62e-34ed-4d76-84d7-e07cf96129fa None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:10.558718 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 297/571] 10.222.0.81 () {56 vars in 1103 bytes} [Tue Sep 6 21:03:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:10.558718 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14f62e-34ed-4d76-84d7-e07cf96129fa None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:10.577002 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:10.630803 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6331cf41-4046-4210-a2a8-95c28bb2d5c0 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:10.667783 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e37040-fb3f-4e3d-bd31-fc8ae251ab0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:10.668345 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e37040-fb3f-4e3d-bd31-fc8ae251ab0e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:10.668629 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e37040-fb3f-4e3d-bd31-fc8ae251ab0e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:10.668903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e37040-fb3f-4e3d-bd31-fc8ae251ab0e None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:10.669560 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e37040-fb3f-4e3d-bd31-fc8ae251ab0e None admin] RBAC: Adding query filter params (name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:10.669864 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e37040-fb3f-4e3d-bd31-fc8ae251ab0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:10.671231 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e37040-fb3f-4e3d-bd31-fc8ae251ab0e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:10.680358 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 275/572] 10.222.0.81 () {56 vars in 1103 bytes} [Tue Sep 6 21:03:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:10.682767 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14f62e-34ed-4d76-84d7-e07cf96129fa None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:10.685449 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e37040-fb3f-4e3d-bd31-fc8ae251ab0e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:10.722314 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:10.726536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84043c-4131-41f7-9aec-a56d779de539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:10.727164 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84043c-4131-41f7-9aec-a56d779de539 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:10.727447 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84043c-4131-41f7-9aec-a56d779de539 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:10.727725 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84043c-4131-41f7-9aec-a56d779de539 None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:10.728510 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84043c-4131-41f7-9aec-a56d779de539 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:10.728823 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84043c-4131-41f7-9aec-a56d779de539 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:10.730337 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af84043c-4131-41f7-9aec-a56d779de539 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:10.747857 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 298/573] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:03:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:10.748786 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84043c-4131-41f7-9aec-a56d779de539 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:10.790974 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e37040-fb3f-4e3d-bd31-fc8ae251ab0e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:10.825008 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f30ef2-1572-4b47-812b-abd60cf01725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:10.825614 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f30ef2-1572-4b47-812b-abd60cf01725 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:10.825890 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f30ef2-1572-4b47-812b-abd60cf01725 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:10.826160 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f30ef2-1572-4b47-812b-abd60cf01725 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:10.826792 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f30ef2-1572-4b47-812b-abd60cf01725 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:10.827094 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f30ef2-1572-4b47-812b-abd60cf01725 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:10.828470 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f30ef2-1572-4b47-812b-abd60cf01725 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:10.832298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:10.839934 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 276/574] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:10.840763 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f30ef2-1572-4b47-812b-abd60cf01725 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:10.857946 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84043c-4131-41f7-9aec-a56d779de539 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:10.898835 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b3f00-29f2-46aa-9470-e215684eca6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:10.899807 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b3f00-29f2-46aa-9470-e215684eca6c None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:10.900295 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b3f00-29f2-46aa-9470-e215684eca6c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:10.900661 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b3f00-29f2-46aa-9470-e215684eca6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:10.917497 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b3f00-29f2-46aa-9470-e215684eca6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:10.920081 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b3f00-29f2-46aa-9470-e215684eca6c None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:10.941790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-3b8b3f00-29f2-46aa-9470-e215684eca6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:10.941790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:10.941790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:10.941790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:10.941790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:10.941790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:10.941790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:10.941790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:10.941790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:10.941790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:10.941790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:10.941790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:10.941790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:10.941790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:10.941790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:10.941790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:10.943136 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:10.943136 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:10.943136 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:10.943136 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:10.943136 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:10.943136 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:10.943136 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:10.943136 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:10.943136 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:10.943136 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:10.943136 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:10.943136 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:10.943136 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:10.943136 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:10.943136 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:10.943136 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:10.943136 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:10.944521 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:10.944521 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:10.944521 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:10.944521 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 299/575] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:10.944918 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b3f00-29f2-46aa-9470-e215684eca6c None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:10.964555 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:10.970502 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f30ef2-1572-4b47-812b-abd60cf01725 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:11.020999 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cde9d6-ce77-4f35-85b5-5fd2b190fb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:11.021699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cde9d6-ce77-4f35-85b5-5fd2b190fb7f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:11.021908 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cde9d6-ce77-4f35-85b5-5fd2b190fb7f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:11.022184 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cde9d6-ce77-4f35-85b5-5fd2b190fb7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:11.032285 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cde9d6-ce77-4f35-85b5-5fd2b190fb7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:11.033748 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cde9d6-ce77-4f35-85b5-5fd2b190fb7f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:11.049465 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-67cde9d6-ce77-4f35-85b5-5fd2b190fb7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:11.049465 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:11.049465 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:11.049465 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:11.049465 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:11.049465 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:11.049465 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:11.049465 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:11.049465 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:11.049465 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:11.049465 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:11.049465 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:11.049465 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:11.049465 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:11.049465 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:11.049465 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:11.052197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:11.052197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:11.052197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:11.052197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:11.052197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:11.052197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:11.052197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:11.052197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:11.052197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:11.052197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:11.052197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:11.052197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:11.052197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:11.052197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:11.052197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:11.052197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:11.052197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:11.055070 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:11.055070 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:11.055070 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:11.055577 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b3f00-29f2-46aa-9470-e215684eca6c None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:11.055986 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 277/576] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:11.055986 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cde9d6-ce77-4f35-85b5-5fd2b190fb7f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:11.082351 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:11.091382 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dccb2b-628e-42b2-9783-9bccb9e2f8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:11.091993 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dccb2b-628e-42b2-9783-9bccb9e2f8a0 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:11.092304 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dccb2b-628e-42b2-9783-9bccb9e2f8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:11.092583 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dccb2b-628e-42b2-9783-9bccb9e2f8a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:11.098151 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dccb2b-628e-42b2-9783-9bccb9e2f8a0 None admin] RBAC: Adding query filter params (role.id=747c70d4cefb4a82816c17da1259b90f, scope.project.id=002e09339d4e49ce98434571d3b64248, user.id=cf0aac45d8b549afafae0a3f623bce46) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:11.098151 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dccb2b-628e-42b2-9783-9bccb9e2f8a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:11.098151 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dccb2b-628e-42b2-9783-9bccb9e2f8a0 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:11.101188 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 300/577] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:03:10 2022] GET /identity/v3/role_assignments?user.id=cf0aac45d8b549afafae0a3f623bce46&scope.project.id=002e09339d4e49ce98434571d3b64248&role.id=747c70d4cefb4a82816c17da1259b90f => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:11.102591 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dccb2b-628e-42b2-9783-9bccb9e2f8a0 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:11.170610 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cde9d6-ce77-4f35-85b5-5fd2b190fb7f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:11.219906 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0c483-4f55-4d71-b5ae-5fbae0cd4b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:11.220604 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0c483-4f55-4d71-b5ae-5fbae0cd4b1d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:11.220885 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0c483-4f55-4d71-b5ae-5fbae0cd4b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:11.221156 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0c483-4f55-4d71-b5ae-5fbae0cd4b1d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:11.234002 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0c483-4f55-4d71-b5ae-5fbae0cd4b1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:03:11.240420 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-40e0c483-4f55-4d71-b5ae-5fbae0cd4b1d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:11.240420 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:11.240420 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:11.240420 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:11.240420 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:11.240420 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:11.240420 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:11.240420 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:11.240420 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:11.240420 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:11.240420 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:11.240420 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:11.240420 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:03:11.240420 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:03:11.240420 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:03:11.240420 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:03:11.241445 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:03:11.241445 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:03:11.241445 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:03:11.241445 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:03:11.241445 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:11.241445 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:11.241445 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:11.241445 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:11.241445 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:11.241445 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:11.241445 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:11.241445 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:11.241445 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:11.241445 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:11.241445 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:11.241445 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:11.243025 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:11.243025 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:11.243025 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:11.243025 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:11.243025 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:03:11.243025 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:03:11.243025 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:03:11.243025 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:03:11.243025 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:03:11.243025 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:03:11.243025 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:11.243025 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:11.243025 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 278/578] 10.222.0.81 () {56 vars in 1102 bytes} [Tue Sep 6 21:03:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:11.244653 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0c483-4f55-4d71-b5ae-5fbae0cd4b1d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:11.249640 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dccb2b-628e-42b2-9783-9bccb9e2f8a0 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:11.260448 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:11.297995 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78095352-0586-4389-9a9c-60816f0c5d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:11.298634 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78095352-0586-4389-9a9c-60816f0c5d89 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:11.298914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78095352-0586-4389-9a9c-60816f0c5d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:11.299186 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78095352-0586-4389-9a9c-60816f0c5d89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:11.307353 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78095352-0586-4389-9a9c-60816f0c5d89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:11.308849 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78095352-0586-4389-9a9c-60816f0c5d89 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:11.327841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-78095352-0586-4389-9a9c-60816f0c5d89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:11.327841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:11.327841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:11.327841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:11.327841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:11.327841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:11.327841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:11.327841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:11.327841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:11.327841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:11.327841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:11.327841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:11.327841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:03:11.327841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:03:11.327841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:03:11.329009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:03:11.329009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:11.329009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:11.329009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:11.329009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:11.329009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:11.329009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:11.329009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:11.329009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:11.329009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:11.329009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:11.329009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:11.329009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:11.329009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:11.329009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:11.329009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:11.329009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:11.330108 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:03:11.330108 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:03:11.330108 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:03:11.330108 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:03:11.330108 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:03:11.330108 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:03:11.330108 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:11.330108 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:11.333651 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 301/579] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:03:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:11.334379 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78095352-0586-4389-9a9c-60816f0c5d89 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:11.378209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0c483-4f55-4d71-b5ae-5fbae0cd4b1d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:11.395027 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:11.418011 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d1ed3-9030-42bc-85e9-a335f9ee0299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:11.418833 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d1ed3-9030-42bc-85e9-a335f9ee0299 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:11.419116 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d1ed3-9030-42bc-85e9-a335f9ee0299 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:11.419392 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d1ed3-9030-42bc-85e9-a335f9ee0299 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:11.420042 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d1ed3-9030-42bc-85e9-a335f9ee0299 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:11.420376 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d1ed3-9030-42bc-85e9-a335f9ee0299 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:11.421831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d1ed3-9030-42bc-85e9-a335f9ee0299 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:11.436429 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 279/580] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:11.437332 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d1ed3-9030-42bc-85e9-a335f9ee0299 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:11.459090 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78095352-0586-4389-9a9c-60816f0c5d89 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:11.499206 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14df7dc-8812-434d-9d92-969d8d2bc4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:11.499827 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14df7dc-8812-434d-9d92-969d8d2bc4c5 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:11.500257 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14df7dc-8812-434d-9d92-969d8d2bc4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:11.500440 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14df7dc-8812-434d-9d92-969d8d2bc4c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:11.501051 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14df7dc-8812-434d-9d92-969d8d2bc4c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:11.501496 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14df7dc-8812-434d-9d92-969d8d2bc4c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:11.502783 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14df7dc-8812-434d-9d92-969d8d2bc4c5 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:11.512572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:11.516529 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 302/581] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:11.517481 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14df7dc-8812-434d-9d92-969d8d2bc4c5 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:11.555111 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d1ed3-9030-42bc-85e9-a335f9ee0299 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:11.592504 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd0c0c-a2b9-461f-8e07-6391aac60090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:11.593322 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd0c0c-a2b9-461f-8e07-6391aac60090 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:11.593725 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd0c0c-a2b9-461f-8e07-6391aac60090 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:11.594006 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd0c0c-a2b9-461f-8e07-6391aac60090 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:11.594745 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd0c0c-a2b9-461f-8e07-6391aac60090 None admin] RBAC: Adding query filter params (name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:11.595055 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd0c0c-a2b9-461f-8e07-6391aac60090 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:11.596454 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cd0c0c-a2b9-461f-8e07-6391aac60090 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:11.612166 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 280/582] 10.222.0.81 () {56 vars in 1103 bytes} [Tue Sep 6 21:03:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:11.612166 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd0c0c-a2b9-461f-8e07-6391aac60090 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:11.632203 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14df7dc-8812-434d-9d92-969d8d2bc4c5 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:11.644381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:11.669932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e067453-d06a-4071-b0f6-c7c129a9afec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:11.670549 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e067453-d06a-4071-b0f6-c7c129a9afec None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:11.670833 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e067453-d06a-4071-b0f6-c7c129a9afec None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:11.671113 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e067453-d06a-4071-b0f6-c7c129a9afec None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:11.671814 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e067453-d06a-4071-b0f6-c7c129a9afec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:11.672212 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e067453-d06a-4071-b0f6-c7c129a9afec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:11.673850 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e067453-d06a-4071-b0f6-c7c129a9afec None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:11.690531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 303/583] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:03:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:11.690531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e067453-d06a-4071-b0f6-c7c129a9afec None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:11.727965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cd0c0c-a2b9-461f-8e07-6391aac60090 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:11.760871 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:11.766891 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb57de-03f2-4a68-8c79-585b1d9a938f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:11.767550 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb57de-03f2-4a68-8c79-585b1d9a938f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:11.767827 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb57de-03f2-4a68-8c79-585b1d9a938f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:11.773266 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb57de-03f2-4a68-8c79-585b1d9a938f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:11.777616 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb57de-03f2-4a68-8c79-585b1d9a938f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:11.779142 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb57de-03f2-4a68-8c79-585b1d9a938f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:11.791003 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-d7cb57de-03f2-4a68-8c79-585b1d9a938f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 06 21:03:11.791003 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:11.791003 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:11.791003 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:11.791003 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:11.791003 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:11.791003 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:11.791003 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:11.791003 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:11.791003 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:11.791003 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:11.791003 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:11.791003 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:03:11.791003 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:03:11.791003 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:03:11.791003 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:03:11.791990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:11.791990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:11.791990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:03:11.791990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:11.791990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:03:11.791990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:11.791990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:11.791990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:11.791990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:11.791990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:11.791990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:11.791990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:11.791990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:11.791990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:11.791990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:11.791990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:11.791990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:11.791990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:11.793313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:11.793313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:11.793313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:03:11.793313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:03:11.793313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:03:11.793313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:03:11.793313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:03:11.793313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:03:11.793313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 06 21:03:11.793313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:11.793313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 281/584] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:03:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:11.793313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb57de-03f2-4a68-8c79-585b1d9a938f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:11.805457 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e067453-d06a-4071-b0f6-c7c129a9afec None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:11.847861 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90120957-a202-4331-9945-28bcdb14d85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:11.848541 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90120957-a202-4331-9945-28bcdb14d85d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:11.848828 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90120957-a202-4331-9945-28bcdb14d85d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:11.849220 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90120957-a202-4331-9945-28bcdb14d85d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:11.857705 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90120957-a202-4331-9945-28bcdb14d85d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:11.859283 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90120957-a202-4331-9945-28bcdb14d85d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:11.871720 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-90120957-a202-4331-9945-28bcdb14d85d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 21:03:11.871720 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:11.871720 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:11.871720 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:11.871720 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:11.871720 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:11.871720 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:11.871720 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:11.871720 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:11.871720 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:11.871720 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:11.871720 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:11.871720 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:03:11.871720 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:03:11.871720 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:03:11.871720 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:03:11.872866 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:11.872866 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:11.872866 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:03:11.872866 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:11.872866 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:03:11.872866 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:11.872866 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:11.872866 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:11.872866 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:11.872866 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:11.872866 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:11.872866 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:11.872866 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:11.872866 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:11.872866 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:11.872866 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:11.872866 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:11.872866 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:11.873814 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:11.873814 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:11.873814 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:03:11.873814 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:03:11.873814 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:03:11.873814 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:03:11.873814 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:03:11.873814 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:03:11.873814 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 21:03:11.873814 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:11.873814 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 304/585] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:03:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:11.873814 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90120957-a202-4331-9945-28bcdb14d85d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:11.915739 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb57de-03f2-4a68-8c79-585b1d9a938f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:11.924347 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:11.954491 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe46ec-e87b-4114-a7ec-4631b048ce88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:11.955137 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe46ec-e87b-4114-a7ec-4631b048ce88 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:11.955394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe46ec-e87b-4114-a7ec-4631b048ce88 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:11.955800 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe46ec-e87b-4114-a7ec-4631b048ce88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:11.967517 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe46ec-e87b-4114-a7ec-4631b048ce88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:11.969049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe46ec-e87b-4114-a7ec-4631b048ce88 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:11.984771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-13fe46ec-e87b-4114-a7ec-4631b048ce88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:11.984771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:11.984771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:11.984771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:11.984771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:11.984771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:11.984771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:11.984771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:11.984771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:11.984771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:11.984771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:11.984771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:11.984771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:11.984771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:11.984771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:11.984771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:11.986138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:11.986138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:11.986138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:11.986138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:11.986138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:11.986138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:11.986138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:11.986138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:11.986138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:11.986138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:11.986138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:11.986138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:11.986138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:11.986138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:11.986138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:11.986138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:11.986138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:11.987043 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:11.987043 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:11.987043 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:11.987043 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 282/586] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:11.987043 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe46ec-e87b-4114-a7ec-4631b048ce88 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:12.005134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90120957-a202-4331-9945-28bcdb14d85d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:12.043990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:12.047880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd110da-f39c-487b-8dac-4068f2462935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:12.049155 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd110da-f39c-487b-8dac-4068f2462935 None admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:12.049926 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd110da-f39c-487b-8dac-4068f2462935 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:12.050665 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd110da-f39c-487b-8dac-4068f2462935 None admin] PATH_INFO: `/v3/projects/002e09339d4e49ce98434571d3b64248/users/4441d8fea57f401a96fb8cbd2b501059/roles/747c70d4cefb4a82816c17da1259b90f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:12.072930 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd110da-f39c-487b-8dac-4068f2462935 None admin] RBAC: Authorizing `identity:create_grant(project_id=002e09339d4e49ce98434571d3b64248, user_id=4441d8fea57f401a96fb8cbd2b501059, role_id=747c70d4cefb4a82816c17da1259b90f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:12.074476 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd110da-f39c-487b-8dac-4068f2462935 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:12.103790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe46ec-e87b-4114-a7ec-4631b048ce88 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:12.137550 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859e779-f4d8-451b-af2b-e8404b496234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:12.138153 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859e779-f4d8-451b-af2b-e8404b496234 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:12.138429 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859e779-f4d8-451b-af2b-e8404b496234 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:12.138700 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859e779-f4d8-451b-af2b-e8404b496234 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:12.139412 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859e779-f4d8-451b-af2b-e8404b496234 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:12.139717 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859e779-f4d8-451b-af2b-e8404b496234 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:12.141285 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859e779-f4d8-451b-af2b-e8404b496234 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:12.162538 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 283/588] 10.222.0.81 () {56 vars in 1137 bytes} [Tue Sep 6 21:03:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:12.162538 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859e779-f4d8-451b-af2b-e8404b496234 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:12.166313 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 305/588] 10.222.0.81 () {58 vars in 1439 bytes} [Tue Sep 6 21:03:11 2022] PUT /identity/v3/projects/002e09339d4e49ce98434571d3b64248/users/4441d8fea57f401a96fb8cbd2b501059/roles/747c70d4cefb4a82816c17da1259b90f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:03:12.168278 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd110da-f39c-487b-8dac-4068f2462935 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:12.282957 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:12.286098 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859e779-f4d8-451b-af2b-e8404b496234 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:12.296760 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:12.320044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd110da-f39c-487b-8dac-4068f2462935 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:12.327287 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8584c95-8175-4236-a9a8-718f4fcfb09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:12.328175 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8584c95-8175-4236-a9a8-718f4fcfb09e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:12.328553 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8584c95-8175-4236-a9a8-718f4fcfb09e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:12.328959 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8584c95-8175-4236-a9a8-718f4fcfb09e None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:12.329762 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8584c95-8175-4236-a9a8-718f4fcfb09e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:12.330128 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8584c95-8175-4236-a9a8-718f4fcfb09e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:12.331826 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8584c95-8175-4236-a9a8-718f4fcfb09e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:12.351861 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 284/589] 10.222.0.81 () {56 vars in 1137 bytes} [Tue Sep 6 21:03:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:12.352881 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8584c95-8175-4236-a9a8-718f4fcfb09e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:12.364875 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7394c39-00e2-4d4b-8db1-af500ea30715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:12.365865 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7394c39-00e2-4d4b-8db1-af500ea30715 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:12.372666 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7394c39-00e2-4d4b-8db1-af500ea30715 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:12.372959 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7394c39-00e2-4d4b-8db1-af500ea30715 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:12.373651 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7394c39-00e2-4d4b-8db1-af500ea30715 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:12.373971 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7394c39-00e2-4d4b-8db1-af500ea30715 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:12.375372 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7394c39-00e2-4d4b-8db1-af500ea30715 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:12.389538 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 306/590] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:12.390389 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7394c39-00e2-4d4b-8db1-af500ea30715 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:12.474017 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8584c95-8175-4236-a9a8-718f4fcfb09e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:12.518500 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb13e43-1038-4619-abb3-97615154f2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:12.519537 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb13e43-1038-4619-abb3-97615154f2d0 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:12.519991 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb13e43-1038-4619-abb3-97615154f2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:12.520478 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb13e43-1038-4619-abb3-97615154f2d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:12.531672 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb13e43-1038-4619-abb3-97615154f2d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:12.533394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb13e43-1038-4619-abb3-97615154f2d0 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:12.537708 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7394c39-00e2-4d4b-8db1-af500ea30715 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:12.550074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-5cb13e43-1038-4619-abb3-97615154f2d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:12.550074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:12.550074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:12.550074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:12.550074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:12.550074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:12.550074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:12.550074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:12.550074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:12.550074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:12.550074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:12.550074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:12.550074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:12.550074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:12.550074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:12.550074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:12.551060 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:12.551060 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:12.551060 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:12.551060 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:12.551060 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:12.551060 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:12.551060 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:12.551060 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:12.551060 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:12.551060 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:12.551060 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:12.551060 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:12.551060 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:12.551060 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:12.551060 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:12.551060 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:12.551060 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:12.551972 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:12.551972 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:12.551972 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:12.553870 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 285/591] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:12.555485 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb13e43-1038-4619-abb3-97615154f2d0 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:12.574105 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:12.578502 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bbb225-0997-480a-aaf0-8939f871f8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:12.579634 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbb225-0997-480a-aaf0-8939f871f8d2 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:12.580073 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbb225-0997-480a-aaf0-8939f871f8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:12.580702 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbb225-0997-480a-aaf0-8939f871f8d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:12.594183 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:12.597205 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bbb225-0997-480a-aaf0-8939f871f8d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:12.599103 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bbb225-0997-480a-aaf0-8939f871f8d2 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:12.618023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-52bbb225-0997-480a-aaf0-8939f871f8d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:12.618023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:12.618023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:12.618023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:12.618023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:12.618023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:12.618023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:12.618023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:12.618023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:12.618023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:12.618023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:12.618023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:12.618023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:12.618023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:12.618023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:12.618023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:12.630154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:12.630154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:12.630154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:12.630154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:12.630154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:12.630154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:12.630154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:12.630154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:12.630154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:12.630154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:12.630154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:12.630154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:12.630154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:12.630154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:12.630154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:12.630154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:12.630154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:12.632785 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:12.632785 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:12.632785 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:12.632785 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 307/592] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:12.632785 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bbb225-0997-480a-aaf0-8939f871f8d2 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:12.687179 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb13e43-1038-4619-abb3-97615154f2d0 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:12.723075 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e096f-f084-4d2c-96ee-315a8ae199f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:12.724128 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e096f-f084-4d2c-96ee-315a8ae199f0 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:12.724654 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e096f-f084-4d2c-96ee-315a8ae199f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:12.725151 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e096f-f084-4d2c-96ee-315a8ae199f0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:12.733954 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e096f-f084-4d2c-96ee-315a8ae199f0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:12.735373 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bbb225-0997-480a-aaf0-8939f871f8d2 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:12.735951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e096f-f084-4d2c-96ee-315a8ae199f0 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:12.751965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-cf6e096f-f084-4d2c-96ee-315a8ae199f0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 21:03:12.751965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:12.751965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:12.751965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:12.751965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:12.751965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:12.751965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:12.751965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:12.751965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:12.751965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:12.751965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:12.751965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:12.751965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:03:12.751965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:03:12.751965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:03:12.751965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:03:12.753127 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:12.753127 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:12.753127 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:03:12.753127 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:12.753127 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:03:12.753127 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:12.753127 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:12.753127 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:12.753127 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:12.753127 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:12.753127 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:12.753127 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:12.753127 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:12.753127 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:12.753127 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:12.753127 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:12.753127 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:12.753127 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:12.754073 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:12.754073 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:12.754073 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:03:12.754073 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:03:12.754073 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:03:12.754073 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:03:12.754073 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:03:12.754073 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:03:12.754073 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 21:03:12.754073 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:12.757136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 286/593] 10.222.0.81 () {56 vars in 1102 bytes} [Tue Sep 6 21:03:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:12.758402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e096f-f084-4d2c-96ee-315a8ae199f0 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:12.777064 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50dcfd5-d4ec-4f58-a846-2ec829cc2108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:12.777575 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50dcfd5-d4ec-4f58-a846-2ec829cc2108 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:12.777858 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50dcfd5-d4ec-4f58-a846-2ec829cc2108 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:12.778125 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50dcfd5-d4ec-4f58-a846-2ec829cc2108 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:12.778774 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50dcfd5-d4ec-4f58-a846-2ec829cc2108 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:12.779083 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50dcfd5-d4ec-4f58-a846-2ec829cc2108 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:12.780518 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50dcfd5-d4ec-4f58-a846-2ec829cc2108 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:12.796641 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 308/594] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:12.798516 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50dcfd5-d4ec-4f58-a846-2ec829cc2108 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:12.846075 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:12.878825 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e096f-f084-4d2c-96ee-315a8ae199f0 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:12.880711 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:12.917401 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8091ecd-fad4-44f8-840f-8cacb9047a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:12.918071 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8091ecd-fad4-44f8-840f-8cacb9047a6e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:12.918353 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8091ecd-fad4-44f8-840f-8cacb9047a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:12.918682 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8091ecd-fad4-44f8-840f-8cacb9047a6e None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:12.919375 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8091ecd-fad4-44f8-840f-8cacb9047a6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:12.919660 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8091ecd-fad4-44f8-840f-8cacb9047a6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:12.921086 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8091ecd-fad4-44f8-840f-8cacb9047a6e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:12.940060 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 287/595] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:12.940060 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8091ecd-fad4-44f8-840f-8cacb9047a6e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:12.953155 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50dcfd5-d4ec-4f58-a846-2ec829cc2108 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:12.991548 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47cb099-d5de-4c66-912b-a4c3011d548d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:12.992400 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47cb099-d5de-4c66-912b-a4c3011d548d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:12.992783 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47cb099-d5de-4c66-912b-a4c3011d548d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:12.993159 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47cb099-d5de-4c66-912b-a4c3011d548d None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:12.994016 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47cb099-d5de-4c66-912b-a4c3011d548d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:12.994426 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47cb099-d5de-4c66-912b-a4c3011d548d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:12.996075 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47cb099-d5de-4c66-912b-a4c3011d548d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:13.018509 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 309/596] 10.222.0.81 () {56 vars in 1139 bytes} [Tue Sep 6 21:03:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:13.019638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47cb099-d5de-4c66-912b-a4c3011d548d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:13.077363 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8091ecd-fad4-44f8-840f-8cacb9047a6e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:13.121014 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:13.129879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f5816-6b1b-4d63-b677-fd23ee3c35a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:13.130882 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f5816-6b1b-4d63-b677-fd23ee3c35a7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:13.131594 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f5816-6b1b-4d63-b677-fd23ee3c35a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:13.132317 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446f5816-6b1b-4d63-b677-fd23ee3c35a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:13.134715 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47cb099-d5de-4c66-912b-a4c3011d548d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:13.145127 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f5816-6b1b-4d63-b677-fd23ee3c35a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:13.147340 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446f5816-6b1b-4d63-b677-fd23ee3c35a7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:13.148708 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:13.167630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-446f5816-6b1b-4d63-b677-fd23ee3c35a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:13.167630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:13.167630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:13.167630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:13.167630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:13.167630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:13.167630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:13.167630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:13.167630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:13.167630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:13.167630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:13.167630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:13.167630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:03:13.167630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:03:13.167630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:03:13.168628 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:03:13.168628 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:13.168628 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:13.168628 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:13.168628 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:13.168628 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:13.168628 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:13.168628 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:13.168628 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:13.168628 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:13.168628 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:13.168628 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:13.168628 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:13.168628 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:13.168628 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:13.168628 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:13.168628 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:13.169514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:03:13.169514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:03:13.169514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:03:13.169514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:03:13.169514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:03:13.169514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:03:13.169514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:13.169514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:13.172319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 288/597] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:03:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:13.173282 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f5816-6b1b-4d63-b677-fd23ee3c35a7 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:13.176831 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b2c67-31bf-47e7-8da4-28c21281e8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:13.178208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b2c67-31bf-47e7-8da4-28c21281e8f3 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:13.178208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b2c67-31bf-47e7-8da4-28c21281e8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:13.178208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b2c67-31bf-47e7-8da4-28c21281e8f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:13.186386 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b2c67-31bf-47e7-8da4-28c21281e8f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:13.188060 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b2c67-31bf-47e7-8da4-28c21281e8f3 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:13.202638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-4e5b2c67-31bf-47e7-8da4-28c21281e8f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:13.202638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:13.202638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:13.202638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:13.202638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:13.202638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:13.202638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:13.202638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:13.202638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:13.202638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:13.202638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:13.202638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:13.202638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:03:13.202638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:03:13.202638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:03:13.203656 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:03:13.203656 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:13.203656 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:13.203656 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:13.203656 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:13.203656 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:13.203656 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:13.203656 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:13.203656 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:13.203656 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:13.203656 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:13.203656 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:13.203656 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:13.203656 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:13.203656 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:13.203656 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:13.203656 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:13.204603 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:03:13.204603 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:03:13.204603 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:03:13.204603 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:03:13.204603 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:03:13.204603 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:03:13.204603 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:13.204603 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:13.208448 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 310/598] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:03:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:13.209599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b2c67-31bf-47e7-8da4-28c21281e8f3 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:13.295689 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446f5816-6b1b-4d63-b677-fd23ee3c35a7 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:13.327176 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b2c67-31bf-47e7-8da4-28c21281e8f3 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:13.334037 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb1065-60f5-4b67-a69a-7c0b87552bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:13.334598 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb1065-60f5-4b67-a69a-7c0b87552bdb None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:13.334881 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb1065-60f5-4b67-a69a-7c0b87552bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:13.335152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cb1065-60f5-4b67-a69a-7c0b87552bdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:13.346164 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb1065-60f5-4b67-a69a-7c0b87552bdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:13.347634 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cb1065-60f5-4b67-a69a-7c0b87552bdb None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:13.362007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-d4cb1065-60f5-4b67-a69a-7c0b87552bdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:13.362007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:13.362007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:13.362007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:13.362007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:13.362007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:13.362007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:13.362007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:13.362007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:13.362007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:13.362007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:13.362007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:13.362007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:13.362007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:13.362007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:13.362007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:13.362966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:13.362966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:13.362966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:13.362966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:13.362966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:13.362966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:13.362966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:13.362966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:13.362966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:13.362966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:13.362966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:13.362966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:13.362966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:13.362966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:13.362966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:13.362966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:13.362966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:13.363873 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:13.363873 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:13.363873 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:13.367342 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1aa8f-1d51-4236-9867-cd476ac5d9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:13.368061 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 289/599] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:13.368202 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1aa8f-1d51-4236-9867-cd476ac5d9c6 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:13.368473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1aa8f-1d51-4236-9867-cd476ac5d9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:13.368750 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1aa8f-1d51-4236-9867-cd476ac5d9c6 None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:13.368847 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb1065-60f5-4b67-a69a-7c0b87552bdb None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:13.369449 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1aa8f-1d51-4236-9867-cd476ac5d9c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:13.369760 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1aa8f-1d51-4236-9867-cd476ac5d9c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:13.371346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d1aa8f-1d51-4236-9867-cd476ac5d9c6 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:13.388238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 311/600] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:03:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:13.388238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb0ea1-3520-49c4-9620-41674344abab None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:13.388238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb0ea1-3520-49c4-9620-41674344abab None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:13.388238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb0ea1-3520-49c4-9620-41674344abab None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:13.388238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 312/601] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:13.388238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb0ea1-3520-49c4-9620-41674344abab None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:13.422223 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:13.423797 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:13.485688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cb1065-60f5-4b67-a69a-7c0b87552bdb None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:13.498595 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb0ea1-3520-49c4-9620-41674344abab None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:13.526854 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af16e7e-f9d8-4449-8c0f-f12d9606135e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:13.527615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af16e7e-f9d8-4449-8c0f-f12d9606135e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:13.527996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af16e7e-f9d8-4449-8c0f-f12d9606135e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:13.528403 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af16e7e-f9d8-4449-8c0f-f12d9606135e None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:13.529115 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af16e7e-f9d8-4449-8c0f-f12d9606135e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:13.529508 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af16e7e-f9d8-4449-8c0f-f12d9606135e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:13.530962 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af16e7e-f9d8-4449-8c0f-f12d9606135e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:13.535236 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d3b85-2e3c-4fc4-9af6-de46aa95cd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:13.535911 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d3b85-2e3c-4fc4-9af6-de46aa95cd84 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:13.536288 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d3b85-2e3c-4fc4-9af6-de46aa95cd84 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:13.536623 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d3b85-2e3c-4fc4-9af6-de46aa95cd84 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:13.537322 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d3b85-2e3c-4fc4-9af6-de46aa95cd84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:13.537689 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d3b85-2e3c-4fc4-9af6-de46aa95cd84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:13.539391 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d3b85-2e3c-4fc4-9af6-de46aa95cd84 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:13.554152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 290/602] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:03:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:13.554152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af16e7e-f9d8-4449-8c0f-f12d9606135e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:13.557639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 313/603] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:13.561488 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247067d-1fef-4f35-96bf-200d93834070 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:13.561488 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247067d-1fef-4f35-96bf-200d93834070 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:13.561488 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247067d-1fef-4f35-96bf-200d93834070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:13.578952 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-5247067d-1fef-4f35-96bf-200d93834070 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:13.580158 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5247067d-1fef-4f35-96bf-200d93834070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:13.652137 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 314/604] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:03:13.653181 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247067d-1fef-4f35-96bf-200d93834070 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:13.672232 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af16e7e-f9d8-4449-8c0f-f12d9606135e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:13.673753 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:13.688852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:13.718686 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da146b-1153-46d3-b754-a00eef2fbcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:13.719585 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da146b-1153-46d3-b754-a00eef2fbcc3 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:13.720283 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da146b-1153-46d3-b754-a00eef2fbcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:13.721117 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da146b-1153-46d3-b754-a00eef2fbcc3 None admin] PATH_INFO: `/v3/projects/002e09339d4e49ce98434571d3b64248/users/c2ba30d9c40641bf8abb580a219b5352/roles/747c70d4cefb4a82816c17da1259b90f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:13.740864 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da146b-1153-46d3-b754-a00eef2fbcc3 None admin] RBAC: Authorizing `identity:create_grant(project_id=002e09339d4e49ce98434571d3b64248, user_id=c2ba30d9c40641bf8abb580a219b5352, role_id=747c70d4cefb4a82816c17da1259b90f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:13.743673 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da146b-1153-46d3-b754-a00eef2fbcc3 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:13.770287 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247067d-1fef-4f35-96bf-200d93834070 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:13.807736 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4808b-1459-4b6d-883c-92c7eb7c8073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:13.808870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4808b-1459-4b6d-883c-92c7eb7c8073 None admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:13.809264 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4808b-1459-4b6d-883c-92c7eb7c8073 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:13.809661 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4808b-1459-4b6d-883c-92c7eb7c8073 None admin] PATH_INFO: `/v3/projects/002e09339d4e49ce98434571d3b64248/users/af9589aaba334db494ed0b036e94062f/roles/747c70d4cefb4a82816c17da1259b90f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:13.821529 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 291/605] 10.222.0.81 () {58 vars in 1439 bytes} [Tue Sep 6 21:03:13 2022] PUT /identity/v3/projects/002e09339d4e49ce98434571d3b64248/users/c2ba30d9c40641bf8abb580a219b5352/roles/747c70d4cefb4a82816c17da1259b90f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:03:13.822806 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da146b-1153-46d3-b754-a00eef2fbcc3 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:13.833834 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4808b-1459-4b6d-883c-92c7eb7c8073 None admin] RBAC: Authorizing `identity:create_grant(project_id=002e09339d4e49ce98434571d3b64248, user_id=af9589aaba334db494ed0b036e94062f, role_id=747c70d4cefb4a82816c17da1259b90f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:13.839271 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab4808b-1459-4b6d-883c-92c7eb7c8073 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:13.921894 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 315/606] 10.222.0.81 () {58 vars in 1439 bytes} [Tue Sep 6 21:03:13 2022] PUT /identity/v3/projects/002e09339d4e49ce98434571d3b64248/users/af9589aaba334db494ed0b036e94062f/roles/747c70d4cefb4a82816c17da1259b90f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:03:13.962779 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4808b-1459-4b6d-883c-92c7eb7c8073 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:13.964532 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da146b-1153-46d3-b754-a00eef2fbcc3 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:14.006504 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4d646-2e2a-4011-8752-1651b6a9e141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:14.007423 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4d646-2e2a-4011-8752-1651b6a9e141 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:14.007817 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4d646-2e2a-4011-8752-1651b6a9e141 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:14.008251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4d646-2e2a-4011-8752-1651b6a9e141 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:14.016849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4d646-2e2a-4011-8752-1651b6a9e141 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:14.018487 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4d646-2e2a-4011-8752-1651b6a9e141 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:14.036949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-50e4d646-2e2a-4011-8752-1651b6a9e141 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:14.036949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:14.036949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:14.036949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:14.036949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:14.036949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:14.036949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:14.036949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:14.036949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:14.036949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:14.036949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:14.036949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:14.036949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:03:14.036949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:03:14.036949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:03:14.038007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:03:14.038007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:14.038007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:14.038007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:14.038007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:14.038007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:14.038007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:14.038007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:14.038007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:14.038007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:14.038007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:14.038007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:14.038007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:14.038007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:14.038007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:14.038007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:14.038007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:14.040019 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:03:14.040019 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:03:14.040019 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:03:14.040019 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:03:14.040019 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:03:14.040019 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:03:14.040019 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:14.040019 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:14.040019 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 292/607] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:03:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:14.045172 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4d646-2e2a-4011-8752-1651b6a9e141 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:14.060385 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:14.109396 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:14.161155 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab4808b-1459-4b6d-883c-92c7eb7c8073 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:14.198318 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4d646-2e2a-4011-8752-1651b6a9e141 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:14.211482 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263af462-0c90-4c8f-b935-03c89df6cf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:14.216403 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263af462-0c90-4c8f-b935-03c89df6cf18 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:14.216403 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263af462-0c90-4c8f-b935-03c89df6cf18 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:14.216403 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263af462-0c90-4c8f-b935-03c89df6cf18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:14.240853 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263af462-0c90-4c8f-b935-03c89df6cf18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:03:14.246673 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-263af462-0c90-4c8f-b935-03c89df6cf18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:14.246673 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:14.246673 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:14.246673 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:14.246673 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:14.246673 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:14.246673 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:14.246673 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:14.246673 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:14.246673 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:14.246673 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:14.246673 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:14.246673 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:03:14.246673 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:03:14.246673 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:03:14.246673 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:03:14.251059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:03:14.251059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:03:14.251059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:03:14.251059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:03:14.251059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:14.251059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:14.251059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:14.251059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:14.251059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:14.251059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:14.251059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:14.251059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:14.251059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:14.251059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:14.251059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:14.251059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:14.252009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:14.252009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:14.252009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:14.252009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:14.252009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:03:14.252009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:03:14.252009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:03:14.252009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:03:14.252009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:03:14.252009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:03:14.252009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:14.252009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:14.252735 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b906e5a-997a-4d3d-8134-1967c61c74fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:14.252735 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b906e5a-997a-4d3d-8134-1967c61c74fc None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:14.252735 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b906e5a-997a-4d3d-8134-1967c61c74fc None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:14.252735 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b906e5a-997a-4d3d-8134-1967c61c74fc None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:14.253066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b906e5a-997a-4d3d-8134-1967c61c74fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:14.253066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b906e5a-997a-4d3d-8134-1967c61c74fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:14.253066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b906e5a-997a-4d3d-8134-1967c61c74fc None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:14.255811 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 316/608] 10.222.0.81 () {56 vars in 1102 bytes} [Tue Sep 6 21:03:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:03:14.262450 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263af462-0c90-4c8f-b935-03c89df6cf18 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:14.281670 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 293/609] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:03:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:03:14.288665 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b906e5a-997a-4d3d-8134-1967c61c74fc None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:14.411718 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263af462-0c90-4c8f-b935-03c89df6cf18 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:14.444533 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:14.457036 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29317c6a-6434-4641-8ccc-a5bcd5bc75da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:14.457036 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29317c6a-6434-4641-8ccc-a5bcd5bc75da None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:14.457036 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29317c6a-6434-4641-8ccc-a5bcd5bc75da None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:14.457036 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29317c6a-6434-4641-8ccc-a5bcd5bc75da None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:14.457497 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29317c6a-6434-4641-8ccc-a5bcd5bc75da None admin] RBAC: Adding query filter params (name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:14.457497 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29317c6a-6434-4641-8ccc-a5bcd5bc75da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:14.457497 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29317c6a-6434-4641-8ccc-a5bcd5bc75da None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:14.464303 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:14.473261 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 317/610] 10.222.0.81 () {56 vars in 1103 bytes} [Tue Sep 6 21:03:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:03:14.475133 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0caff-86ec-4c79-8381-ae546a5d3d00 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:14.475858 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0caff-86ec-4c79-8381-ae546a5d3d00 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:14.476864 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa0caff-86ec-4c79-8381-ae546a5d3d00 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:14.478785 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 318/611] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:14.480129 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0caff-86ec-4c79-8381-ae546a5d3d00 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:14.502893 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b906e5a-997a-4d3d-8134-1967c61c74fc None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:14.547677 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bc0b0c-fbab-4209-9810-bcf58198af59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:14.548684 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc0b0c-fbab-4209-9810-bcf58198af59 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:14.549071 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc0b0c-fbab-4209-9810-bcf58198af59 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:14.549451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bc0b0c-fbab-4209-9810-bcf58198af59 None admin] PATH_INFO: `/v3/projects/002e09339d4e49ce98434571d3b64248/users/c9aebd6c7ef24f42949918c99a72722d/roles/747c70d4cefb4a82816c17da1259b90f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:14.571519 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc0b0c-fbab-4209-9810-bcf58198af59 None admin] RBAC: Authorizing `identity:create_grant(project_id=002e09339d4e49ce98434571d3b64248, user_id=c9aebd6c7ef24f42949918c99a72722d, role_id=747c70d4cefb4a82816c17da1259b90f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:14.573548 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bc0b0c-fbab-4209-9810-bcf58198af59 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:14.627476 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa0caff-86ec-4c79-8381-ae546a5d3d00 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:14.652529 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 294/612] 10.222.0.81 () {58 vars in 1439 bytes} [Tue Sep 6 21:03:14 2022] PUT /identity/v3/projects/002e09339d4e49ce98434571d3b64248/users/c9aebd6c7ef24f42949918c99a72722d/roles/747c70d4cefb4a82816c17da1259b90f => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:03:14.654963 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2dbb6-5497-4edd-8519-d61f68295637 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:14.655469 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2dbb6-5497-4edd-8519-d61f68295637 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:14.655954 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2dbb6-5497-4edd-8519-d61f68295637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:14.683570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff8154-11b8-482a-ae29-951aae588a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:14.683570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff8154-11b8-482a-ae29-951aae588a0b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:14.683570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff8154-11b8-482a-ae29-951aae588a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:14.683570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ff8154-11b8-482a-ae29-951aae588a0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:14.698608 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff8154-11b8-482a-ae29-951aae588a0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:14.699078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ecf2dbb6-5497-4edd-8519-d61f68295637 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:14.701988 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ff8154-11b8-482a-ae29-951aae588a0b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:14.702705 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ecf2dbb6-5497-4edd-8519-d61f68295637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:14.735226 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-65ff8154-11b8-482a-ae29-951aae588a0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:14.735226 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:14.735226 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:14.735226 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:14.735226 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:14.735226 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:14.735226 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:14.735226 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:14.735226 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:14.735226 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:14.735226 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:14.735226 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:14.735226 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:14.735226 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:14.735226 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:14.735226 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:14.736256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:14.736256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:14.736256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:14.736256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:14.736256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:14.736256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:14.736256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:14.736256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:14.736256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:14.736256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:14.736256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:14.736256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:14.736256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:14.736256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:14.736256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:14.736256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:14.736256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:14.737898 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:14.737898 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:14.737898 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:14.737898 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 319/613] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:14.743155 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff8154-11b8-482a-ae29-951aae588a0b None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:14.828283 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:14.830949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 295/614] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:03:14.902824 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ff8154-11b8-482a-ae29-951aae588a0b None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:14.941486 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a1e73-8aef-4825-9430-e0ab281c7dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:14.942193 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a1e73-8aef-4825-9430-e0ab281c7dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:14.942533 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a1e73-8aef-4825-9430-e0ab281c7dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:14.942872 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a1e73-8aef-4825-9430-e0ab281c7dd4 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:14.943570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a1e73-8aef-4825-9430-e0ab281c7dd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:14.943937 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a1e73-8aef-4825-9430-e0ab281c7dd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:14.945456 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a1e73-8aef-4825-9430-e0ab281c7dd4 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:14.959054 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 320/615] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:14.964817 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2dbb6-5497-4edd-8519-d61f68295637 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:15.027294 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:15.088352 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf2dbb6-5497-4edd-8519-d61f68295637 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:15.130607 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db569f-a0fb-42c7-ad85-787c0d4cb90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:15.131246 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db569f-a0fb-42c7-ad85-787c0d4cb90b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:15.131531 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db569f-a0fb-42c7-ad85-787c0d4cb90b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:15.131805 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db569f-a0fb-42c7-ad85-787c0d4cb90b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:15.142916 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db569f-a0fb-42c7-ad85-787c0d4cb90b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:15.144383 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db569f-a0fb-42c7-ad85-787c0d4cb90b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:15.155252 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a1e73-8aef-4825-9430-e0ab281c7dd4 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:15.159997 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-50db569f-a0fb-42c7-ad85-787c0d4cb90b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 21:03:15.159997 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:15.159997 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:15.159997 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:15.159997 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:15.159997 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:15.159997 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:15.159997 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:15.159997 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:15.159997 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:15.159997 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:15.159997 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:15.159997 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:03:15.159997 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:03:15.159997 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:03:15.159997 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:03:15.161022 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:15.161022 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:15.161022 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:03:15.161022 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:15.161022 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:03:15.161022 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:15.161022 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:15.161022 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:15.161022 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:15.161022 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:15.161022 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:15.161022 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:15.161022 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:15.161022 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:15.161022 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:15.161022 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:15.161022 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:15.161022 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:15.162483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:15.162483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:15.162483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:03:15.162483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:03:15.162483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:03:15.162483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:03:15.162483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:03:15.162483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:03:15.162483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 21:03:15.162483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:15.162483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 296/616] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:03:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:15.167693 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db569f-a0fb-42c7-ad85-787c0d4cb90b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:15.335319 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a1e73-8aef-4825-9430-e0ab281c7dd4 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:15.352473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:15.355195 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db569f-a0fb-42c7-ad85-787c0d4cb90b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:15.374070 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:15.389374 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e51de-8c6e-4026-a293-6c6c5c585847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:15.390402 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e51de-8c6e-4026-a293-6c6c5c585847 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:15.390911 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e51de-8c6e-4026-a293-6c6c5c585847 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:15.391405 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e51de-8c6e-4026-a293-6c6c5c585847 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:15.402343 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e51de-8c6e-4026-a293-6c6c5c585847 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:03:15.407790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-9f8e51de-8c6e-4026-a293-6c6c5c585847 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:15.407790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:15.407790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:15.407790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:15.407790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:15.407790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:15.407790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:15.407790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:15.407790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:15.407790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:15.407790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:15.407790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:15.407790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:03:15.407790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:03:15.407790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:03:15.407790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:03:15.408765 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:03:15.408765 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:03:15.408765 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:03:15.408765 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:03:15.408765 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:15.408765 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:15.408765 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:15.408765 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:15.408765 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:15.408765 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:15.408765 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:15.408765 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:15.408765 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:15.408765 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:15.408765 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:15.408765 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:15.409634 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:15.409634 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:15.409634 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:15.409634 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:15.409634 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:03:15.409634 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:03:15.409634 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:03:15.409634 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:03:15.409634 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:03:15.409634 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:03:15.409634 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:15.409634 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:15.412435 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 321/617] 10.222.0.81 () {56 vars in 1102 bytes} [Tue Sep 6 21:03:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:15.419005 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e51de-8c6e-4026-a293-6c6c5c585847 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:15.425045 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c387eef-484e-4a93-a437-323c6dbae66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:15.425679 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c387eef-484e-4a93-a437-323c6dbae66e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:15.425961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c387eef-484e-4a93-a437-323c6dbae66e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:15.426256 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c387eef-484e-4a93-a437-323c6dbae66e None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:15.426980 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c387eef-484e-4a93-a437-323c6dbae66e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:15.427292 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c387eef-484e-4a93-a437-323c6dbae66e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:15.428823 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c387eef-484e-4a93-a437-323c6dbae66e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:15.464509 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 297/618] 10.222.0.81 () {56 vars in 1135 bytes} [Tue Sep 6 21:03:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:03:15.470509 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c387eef-484e-4a93-a437-323c6dbae66e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:15.532841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e51de-8c6e-4026-a293-6c6c5c585847 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:15.569554 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f658a6-be62-4d0b-843d-a672937dfb60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:15.570626 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f658a6-be62-4d0b-843d-a672937dfb60 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:15.571128 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f658a6-be62-4d0b-843d-a672937dfb60 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:15.571726 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f658a6-be62-4d0b-843d-a672937dfb60 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:15.572634 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f658a6-be62-4d0b-843d-a672937dfb60 None admin] RBAC: Adding query filter params (name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:15.573178 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f658a6-be62-4d0b-843d-a672937dfb60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:15.574783 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f658a6-be62-4d0b-843d-a672937dfb60 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:15.584044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 322/619] 10.222.0.81 () {56 vars in 1103 bytes} [Tue Sep 6 21:03:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:15.590046 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f658a6-be62-4d0b-843d-a672937dfb60 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:15.628524 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:15.682054 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c387eef-484e-4a93-a437-323c6dbae66e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:15.747508 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fbd77-2a97-45b9-9ad4-7a0934078383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:15.748157 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fbd77-2a97-45b9-9ad4-7a0934078383 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:15.748437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fbd77-2a97-45b9-9ad4-7a0934078383 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:15.748713 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734fbd77-2a97-45b9-9ad4-7a0934078383 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:15.750944 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f658a6-be62-4d0b-843d-a672937dfb60 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:15.773585 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734fbd77-2a97-45b9-9ad4-7a0934078383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:15.774903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734fbd77-2a97-45b9-9ad4-7a0934078383 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:15.801315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-734fbd77-2a97-45b9-9ad4-7a0934078383 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:15.801315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:15.801315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:15.801315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:15.801315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:15.801315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:15.801315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:15.801315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:15.801315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:15.801315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:15.801315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:15.801315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:15.801315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:15.801315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:15.801315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:15.801315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:15.802351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:15.802351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:15.802351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:15.802351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:15.802351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:15.802351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:15.802351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:15.802351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:15.802351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:15.802351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:15.802351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:15.802351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:15.802351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:15.802351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:15.802351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:15.802351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:15.802351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:15.803250 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:15.803250 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:15.803250 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:15.803857 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 298/620] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:15.812696 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fbd77-2a97-45b9-9ad4-7a0934078383 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:15.828572 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50c2de-3014-4105-b8c8-4a9945ac06b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:15.828572 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50c2de-3014-4105-b8c8-4a9945ac06b7 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:15.828881 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50c2de-3014-4105-b8c8-4a9945ac06b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:15.828970 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50c2de-3014-4105-b8c8-4a9945ac06b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:15.846656 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50c2de-3014-4105-b8c8-4a9945ac06b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:15.848069 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe50c2de-3014-4105-b8c8-4a9945ac06b7 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:15.868290 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:15.877130 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-fe50c2de-3014-4105-b8c8-4a9945ac06b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:15.877130 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:15.877130 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:15.877130 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:15.877130 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:15.877130 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:15.877130 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:15.877130 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:15.877130 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:15.877130 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:15.877130 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:15.877130 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:15.877130 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:15.877130 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:15.877130 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:15.877130 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:15.878150 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:15.878150 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:15.878150 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:15.878150 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:15.878150 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:15.878150 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:15.878150 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:15.878150 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:15.878150 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:15.878150 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:15.878150 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:15.878150 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:15.878150 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:15.878150 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:15.878150 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:15.878150 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:15.878150 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:15.879063 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:15.879063 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:15.879063 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:15.885357 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 323/621] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:03:15.886283 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50c2de-3014-4105-b8c8-4a9945ac06b7 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:16.003141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734fbd77-2a97-45b9-9ad4-7a0934078383 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:16.047391 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fd326-10d7-45e6-a6f8-eaf6a1b3e2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:16.048008 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fd326-10d7-45e6-a6f8-eaf6a1b3e2e4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:16.048312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fd326-10d7-45e6-a6f8-eaf6a1b3e2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:16.048582 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6fd326-10d7-45e6-a6f8-eaf6a1b3e2e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:16.049231 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fd326-10d7-45e6-a6f8-eaf6a1b3e2e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:16.049532 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fd326-10d7-45e6-a6f8-eaf6a1b3e2e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:16.057550 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6fd326-10d7-45e6-a6f8-eaf6a1b3e2e4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:16.066464 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:16.073963 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 299/622] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:16.082308 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fd326-10d7-45e6-a6f8-eaf6a1b3e2e4 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:16.108197 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe50c2de-3014-4105-b8c8-4a9945ac06b7 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:16.159466 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85496939-3739-41a1-a0bb-1a438959adef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:16.160083 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85496939-3739-41a1-a0bb-1a438959adef None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:16.160387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85496939-3739-41a1-a0bb-1a438959adef None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:16.160662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85496939-3739-41a1-a0bb-1a438959adef None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:16.161428 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85496939-3739-41a1-a0bb-1a438959adef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:16.161785 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85496939-3739-41a1-a0bb-1a438959adef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:16.163486 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85496939-3739-41a1-a0bb-1a438959adef None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:16.176699 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 324/623] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:16.183221 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85496939-3739-41a1-a0bb-1a438959adef None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:16.263159 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:16.306258 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6fd326-10d7-45e6-a6f8-eaf6a1b3e2e4 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:16.342646 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85496939-3739-41a1-a0bb-1a438959adef None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:16.381033 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bb39c-7c9a-45d6-88ff-a40d1592b141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:16.381753 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bb39c-7c9a-45d6-88ff-a40d1592b141 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:16.382885 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bb39c-7c9a-45d6-88ff-a40d1592b141 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:16.383156 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62bb39c-7c9a-45d6-88ff-a40d1592b141 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:16.391157 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bb39c-7c9a-45d6-88ff-a40d1592b141 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:16.392744 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62bb39c-7c9a-45d6-88ff-a40d1592b141 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:16.394802 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:16.405026 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca15de1-d194-4c2c-aaf2-2a9251c8e6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:16.409651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca15de1-d194-4c2c-aaf2-2a9251c8e6d3 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:16.409651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca15de1-d194-4c2c-aaf2-2a9251c8e6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:16.409651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca15de1-d194-4c2c-aaf2-2a9251c8e6d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:16.409899 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-d62bb39c-7c9a-45d6-88ff-a40d1592b141 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 21:03:16.409899 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:16.409899 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:16.409899 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:16.409899 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:16.409899 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:16.409899 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:16.409899 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:16.409899 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:16.409899 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:16.409899 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:16.409899 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:16.409899 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:03:16.409899 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:03:16.409899 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:03:16.409899 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:03:16.410812 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:16.410812 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:16.410812 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:03:16.410812 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:16.410812 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:03:16.410812 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:16.410812 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:16.410812 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:16.410812 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:16.410812 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:16.410812 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:16.410812 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:16.410812 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:16.410812 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:16.410812 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:16.410812 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:16.410812 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:16.410812 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:16.411795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:16.411795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:16.411795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:03:16.411795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:03:16.411795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:03:16.411795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:03:16.411795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:03:16.411795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:03:16.411795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 21:03:16.411795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:16.411795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 325/624] 10.222.0.81 () {56 vars in 1093 bytes} [Tue Sep 6 21:03:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:16.419787 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bb39c-7c9a-45d6-88ff-a40d1592b141 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:16.434463 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca15de1-d194-4c2c-aaf2-2a9251c8e6d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:16.436822 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca15de1-d194-4c2c-aaf2-2a9251c8e6d3 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:16.464912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-bca15de1-d194-4c2c-aaf2-2a9251c8e6d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:16.464912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:16.464912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:16.464912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:16.464912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:16.464912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:16.464912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:16.464912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:16.464912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:16.464912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:16.464912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:16.464912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:16.464912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:03:16.464912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:03:16.464912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:03:16.465913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:03:16.465913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:16.465913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:16.465913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:16.465913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:16.465913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:16.465913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:16.465913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:16.465913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:16.465913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:16.465913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:16.465913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:16.465913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:16.465913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:16.465913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:16.465913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:16.465913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:16.466854 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:03:16.466854 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:03:16.466854 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:03:16.466854 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:03:16.466854 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:03:16.466854 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:03:16.466854 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:16.466854 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:16.470630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 300/625] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:03:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:16.476468 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca15de1-d194-4c2c-aaf2-2a9251c8e6d3 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:16.559670 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62bb39c-7c9a-45d6-88ff-a40d1592b141 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:16.594700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ed868-ac19-4169-a15b-9c0220374fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:16.595705 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ed868-ac19-4169-a15b-9c0220374fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:16.596178 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ed868-ac19-4169-a15b-9c0220374fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:16.596525 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ed868-ac19-4169-a15b-9c0220374fe4 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:16.597254 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ed868-ac19-4169-a15b-9c0220374fe4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:16.597563 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ed868-ac19-4169-a15b-9c0220374fe4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:16.599018 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ed868-ac19-4169-a15b-9c0220374fe4 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:16.618371 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 326/626] 10.222.0.81 () {56 vars in 1133 bytes} [Tue Sep 6 21:03:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:16.619511 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06a8d5-0264-4b72-8ff5-9106201eac08 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:16.619800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06a8d5-0264-4b72-8ff5-9106201eac08 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:16.620078 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c06a8d5-0264-4b72-8ff5-9106201eac08 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:16.624169 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 327/627] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:16.624169 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46c49f-1821-4693-aac9-05f6a233ce4a None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:16.624169 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46c49f-1821-4693-aac9-05f6a233ce4a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:16.624169 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc46c49f-1821-4693-aac9-05f6a233ce4a None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:16.624516 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 328/628] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:16.625359 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46c49f-1821-4693-aac9-05f6a233ce4a None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:16.634307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca15de1-d194-4c2c-aaf2-2a9251c8e6d3 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:16.668576 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa508ec-32ea-4652-b4bc-2e9be4d0864f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:16.669173 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa508ec-32ea-4652-b4bc-2e9be4d0864f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:16.669450 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa508ec-32ea-4652-b4bc-2e9be4d0864f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:16.669721 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa508ec-32ea-4652-b4bc-2e9be4d0864f None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:16.670408 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa508ec-32ea-4652-b4bc-2e9be4d0864f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:16.670718 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa508ec-32ea-4652-b4bc-2e9be4d0864f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:16.672156 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa508ec-32ea-4652-b4bc-2e9be4d0864f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:16.684825 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 301/629] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:03:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:03:16.686136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92a022-0bff-4494-9225-33dfb022ad06 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:16.686424 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92a022-0bff-4494-9225-33dfb022ad06 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:16.686698 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a92a022-0bff-4494-9225-33dfb022ad06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:16.692900 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:16.693884 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:16.706283 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-3a92a022-0bff-4494-9225-33dfb022ad06 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:16.707474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3a92a022-0bff-4494-9225-33dfb022ad06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:16.738717 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc46c49f-1821-4693-aac9-05f6a233ce4a None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:16.775148 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaeb377-ed79-4f30-a3cb-990182e0c0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:16.776173 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaeb377-ed79-4f30-a3cb-990182e0c0ca None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:16.776700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaeb377-ed79-4f30-a3cb-990182e0c0ca None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:16.776993 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaeb377-ed79-4f30-a3cb-990182e0c0ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:16.783091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 302/630] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:03:16.784741 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff879881-a41a-4e70-874f-2ee97332974e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:16.785165 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff879881-a41a-4e70-874f-2ee97332974e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:16.786006 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff879881-a41a-4e70-874f-2ee97332974e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:16.809440 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ff879881-a41a-4e70-874f-2ee97332974e None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:16.810723 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ff879881-a41a-4e70-874f-2ee97332974e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:16.857962 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaeb377-ed79-4f30-a3cb-990182e0c0ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:16.859998 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaeb377-ed79-4f30-a3cb-990182e0c0ca None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:16.888331 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 303/631] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:03:16.889384 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff879881-a41a-4e70-874f-2ee97332974e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:16.947535 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:17.005660 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:17.030122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 329/632] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:03:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 21:03:17.036121 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaeb377-ed79-4f30-a3cb-990182e0c0ca None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:17.057816 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff879881-a41a-4e70-874f-2ee97332974e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:17.099446 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3fa00-bde6-4827-8719-d2cf52fb1b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:17.100137 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3fa00-bde6-4827-8719-d2cf52fb1b20 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:17.100436 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3fa00-bde6-4827-8719-d2cf52fb1b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:17.100971 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3fa00-bde6-4827-8719-d2cf52fb1b20 None admin] PATH_INFO: `/v3/projects/002e09339d4e49ce98434571d3b64248/users/cf0aac45d8b549afafae0a3f623bce46/roles/747c70d4cefb4a82816c17da1259b90f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:17.120353 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3fa00-bde6-4827-8719-d2cf52fb1b20 None admin] RBAC: Authorizing `identity:create_grant(project_id=002e09339d4e49ce98434571d3b64248, user_id=cf0aac45d8b549afafae0a3f623bce46, role_id=747c70d4cefb4a82816c17da1259b90f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:17.121933 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3fa00-bde6-4827-8719-d2cf52fb1b20 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:17.176985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaeb377-ed79-4f30-a3cb-990182e0c0ca None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:17.196475 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 304/633] 10.222.0.81 () {58 vars in 1439 bytes} [Tue Sep 6 21:03:16 2022] PUT /identity/v3/projects/002e09339d4e49ce98434571d3b64248/users/cf0aac45d8b549afafae0a3f623bce46/roles/747c70d4cefb4a82816c17da1259b90f => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:03:17.198367 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3fa00-bde6-4827-8719-d2cf52fb1b20 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:17.234931 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1fe75-bbf6-4934-8ef0-b9c114444d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:17.235695 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1fe75-bbf6-4934-8ef0-b9c114444d7b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:17.235985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1fe75-bbf6-4934-8ef0-b9c114444d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:17.236287 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1fe75-bbf6-4934-8ef0-b9c114444d7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:17.255700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1fe75-bbf6-4934-8ef0-b9c114444d7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:17.257032 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1fe75-bbf6-4934-8ef0-b9c114444d7b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:17.277593 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-cda1fe75-bbf6-4934-8ef0-b9c114444d7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:17.277593 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:17.277593 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:17.277593 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:17.277593 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:17.277593 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:17.277593 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:17.277593 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:17.277593 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:17.277593 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:17.277593 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:17.277593 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:17.277593 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:17.277593 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:17.277593 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:17.277593 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:17.278882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:17.278882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:17.278882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:17.278882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:17.278882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:17.278882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:17.278882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:17.278882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:17.278882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:17.278882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:17.278882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:17.278882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:17.278882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:17.278882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:17.278882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:17.278882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:17.278882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:17.280704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:17.280704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:17.280704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:17.280704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 330/634] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:03:17.280704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1fe75-bbf6-4934-8ef0-b9c114444d7b None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:17.295994 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:17.333761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3fa00-bde6-4827-8719-d2cf52fb1b20 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:17.350005 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:17.373366 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f4c1c-8208-4ab2-8cdb-8731ad68e043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:17.374001 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f4c1c-8208-4ab2-8cdb-8731ad68e043 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:17.374280 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f4c1c-8208-4ab2-8cdb-8731ad68e043 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:17.374548 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f4c1c-8208-4ab2-8cdb-8731ad68e043 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:17.390304 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f4c1c-8208-4ab2-8cdb-8731ad68e043 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:03:17.395214 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-303f4c1c-8208-4ab2-8cdb-8731ad68e043 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:17.395214 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:17.395214 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:17.395214 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:17.395214 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:17.395214 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:17.395214 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:17.395214 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:17.395214 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:17.395214 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:17.395214 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:17.395214 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:17.395214 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:03:17.395214 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:03:17.395214 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:03:17.395214 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:03:17.396257 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:03:17.396257 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:03:17.396257 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:03:17.396257 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:03:17.396257 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:17.396257 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:17.396257 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:17.396257 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:17.396257 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:17.396257 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:17.396257 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:17.396257 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:17.396257 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:17.396257 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:17.396257 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:17.396257 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:17.397490 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:17.397490 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:17.397490 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:17.397490 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:17.397490 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:03:17.397490 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:03:17.397490 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:03:17.397490 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:03:17.397490 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:03:17.397490 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:03:17.397490 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:17.397490 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:17.397490 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 305/635] 10.222.0.81 () {56 vars in 1102 bytes} [Tue Sep 6 21:03:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:17.399017 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc38f6c-4e9c-41b5-8e37-6a31475f182a None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:17.399017 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc38f6c-4e9c-41b5-8e37-6a31475f182a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:17.399275 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc38f6c-4e9c-41b5-8e37-6a31475f182a None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:17.401527 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 306/636] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:17.401648 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1fe75-bbf6-4934-8ef0-b9c114444d7b None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:17.402129 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc38f6c-4e9c-41b5-8e37-6a31475f182a None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:17.441518 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9604875-2d0a-4ad9-a3ce-c5f12cd4ee26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:17.442427 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9604875-2d0a-4ad9-a3ce-c5f12cd4ee26 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:17.442708 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9604875-2d0a-4ad9-a3ce-c5f12cd4ee26 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:17.446351 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9604875-2d0a-4ad9-a3ce-c5f12cd4ee26 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:17.456882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9604875-2d0a-4ad9-a3ce-c5f12cd4ee26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:03:17.462781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-c9604875-2d0a-4ad9-a3ce-c5f12cd4ee26 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:17.462781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:17.462781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:17.462781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:17.462781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:17.462781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:17.462781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:17.462781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:17.462781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:17.462781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:17.462781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:17.462781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:17.462781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:03:17.462781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:03:17.462781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:03:17.462781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:03:17.463722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:03:17.463722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:03:17.463722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:03:17.463722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:03:17.463722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:17.463722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:17.463722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:17.463722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:17.463722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:17.463722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:17.463722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:17.463722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:17.463722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:17.463722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:17.463722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:17.463722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:17.464938 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:17.464938 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:17.464938 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:17.464938 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:17.464938 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:03:17.464938 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:03:17.464938 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:03:17.464938 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:03:17.464938 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:03:17.464938 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:03:17.464938 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:17.464938 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:17.464938 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 331/637] 10.222.0.81 () {56 vars in 1102 bytes} [Tue Sep 6 21:03:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:17.464938 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9604875-2d0a-4ad9-a3ce-c5f12cd4ee26 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:17.547551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc38f6c-4e9c-41b5-8e37-6a31475f182a None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:17.558165 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:17.592538 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c7b2b-cad8-4ce4-8234-0a9baade012c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:17.593169 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c7b2b-cad8-4ce4-8234-0a9baade012c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:17.593461 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c7b2b-cad8-4ce4-8234-0a9baade012c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:17.593725 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c7b2b-cad8-4ce4-8234-0a9baade012c None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:17.594374 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c7b2b-cad8-4ce4-8234-0a9baade012c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:17.594680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c7b2b-cad8-4ce4-8234-0a9baade012c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:17.596205 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c7b2b-cad8-4ce4-8234-0a9baade012c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:17.598322 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9604875-2d0a-4ad9-a3ce-c5f12cd4ee26 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:17.615851 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 307/638] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:17.615851 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4ee78-981b-4ee7-b2d6-b876fb860c05 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:17.615851 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4ee78-981b-4ee7-b2d6-b876fb860c05 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:17.615851 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4ee78-981b-4ee7-b2d6-b876fb860c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:17.633372 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-53b4ee78-981b-4ee7-b2d6-b876fb860c05 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:17.635158 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-53b4ee78-981b-4ee7-b2d6-b876fb860c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:17.644746 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f34fec-32fe-4306-9411-7ea5a257cb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:17.645461 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f34fec-32fe-4306-9411-7ea5a257cb52 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:17.645809 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f34fec-32fe-4306-9411-7ea5a257cb52 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:17.646156 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f34fec-32fe-4306-9411-7ea5a257cb52 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:17.646908 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f34fec-32fe-4306-9411-7ea5a257cb52 None admin] RBAC: Adding query filter params (name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:17.647287 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f34fec-32fe-4306-9411-7ea5a257cb52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:17.649320 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f34fec-32fe-4306-9411-7ea5a257cb52 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:17.659712 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 332/639] 10.222.0.81 () {56 vars in 1103 bytes} [Tue Sep 6 21:03:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:17.660472 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f34fec-32fe-4306-9411-7ea5a257cb52 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:17.674462 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:17.725863 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 308/640] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:03:17.726529 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4ee78-981b-4ee7-b2d6-b876fb860c05 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:17.806476 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f34fec-32fe-4306-9411-7ea5a257cb52 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:17.848306 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:17.855274 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4ee78-981b-4ee7-b2d6-b876fb860c05 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:17.855681 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52cf02-32d6-48ce-9090-fe3d6ca1768b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:17.856408 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52cf02-32d6-48ce-9090-fe3d6ca1768b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:17.856758 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52cf02-32d6-48ce-9090-fe3d6ca1768b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:17.857121 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52cf02-32d6-48ce-9090-fe3d6ca1768b None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:17.857859 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb52cf02-32d6-48ce-9090-fe3d6ca1768b None admin] RBAC: Adding query filter params (name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:17.858179 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb52cf02-32d6-48ce-9090-fe3d6ca1768b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:17.859884 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb52cf02-32d6-48ce-9090-fe3d6ca1768b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:17.873432 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 333/641] 10.222.0.81 () {56 vars in 1103 bytes} [Tue Sep 6 21:03:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:17.874460 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52cf02-32d6-48ce-9090-fe3d6ca1768b None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:17.903001 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc354343-c8fb-429e-bffb-427898b7de6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:17.904315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc354343-c8fb-429e-bffb-427898b7de6f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:17.904665 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc354343-c8fb-429e-bffb-427898b7de6f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:17.905060 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc354343-c8fb-429e-bffb-427898b7de6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:17.915033 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc354343-c8fb-429e-bffb-427898b7de6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:17.917662 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc354343-c8fb-429e-bffb-427898b7de6f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:17.934734 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-dc354343-c8fb-429e-bffb-427898b7de6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:17.934734 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:17.934734 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:17.934734 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:17.934734 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:17.934734 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:17.934734 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:17.934734 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:17.934734 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:17.934734 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:17.934734 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:17.934734 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:17.934734 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:03:17.934734 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:03:17.934734 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:03:17.935874 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:03:17.935874 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:17.935874 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:17.935874 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:17.935874 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:17.935874 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:17.935874 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:17.935874 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:17.935874 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:17.935874 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:17.935874 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:17.935874 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:17.935874 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:17.935874 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:17.935874 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:17.935874 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:17.935874 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:17.936848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:03:17.936848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:03:17.936848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:03:17.936848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:03:17.936848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:03:17.936848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:03:17.936848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:17.936848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:17.940258 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 309/642] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:03:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:17.941329 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc354343-c8fb-429e-bffb-427898b7de6f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:17.973541 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:17.994260 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52cf02-32d6-48ce-9090-fe3d6ca1768b None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:18.033724 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba0896-44f6-42b4-bc78-4b8f6bba96dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:18.034377 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba0896-44f6-42b4-bc78-4b8f6bba96dd None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:18.034660 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba0896-44f6-42b4-bc78-4b8f6bba96dd None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:18.035003 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba0896-44f6-42b4-bc78-4b8f6bba96dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:18.046692 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba0896-44f6-42b4-bc78-4b8f6bba96dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:18.048259 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba0896-44f6-42b4-bc78-4b8f6bba96dd None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:18.058797 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc354343-c8fb-429e-bffb-427898b7de6f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:18.064054 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-4aba0896-44f6-42b4-bc78-4b8f6bba96dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:18.064054 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:18.064054 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:18.064054 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:18.064054 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:18.064054 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:18.064054 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:18.064054 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:18.064054 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:18.064054 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:18.064054 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:18.064054 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:18.064054 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:18.064054 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:18.064054 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:18.064054 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:18.065394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:18.065394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:18.065394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:18.065394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:18.065394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:18.065394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:18.065394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:18.065394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:18.065394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:18.065394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:18.065394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:18.065394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:18.065394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:18.065394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:18.065394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:18.065394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:18.065394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:18.066378 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:18.066378 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:18.066378 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:18.066378 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 334/643] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:18.066618 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba0896-44f6-42b4-bc78-4b8f6bba96dd None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:18.108418 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfad7e-cdb2-4185-8b28-cd658bd4bfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:18.109518 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfad7e-cdb2-4185-8b28-cd658bd4bfc8 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:18.110020 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfad7e-cdb2-4185-8b28-cd658bd4bfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:18.110513 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfad7e-cdb2-4185-8b28-cd658bd4bfc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:18.118789 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:18.126141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedfad7e-cdb2-4185-8b28-cd658bd4bfc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:18.127592 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedfad7e-cdb2-4185-8b28-cd658bd4bfc8 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:18.144263 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-bedfad7e-cdb2-4185-8b28-cd658bd4bfc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:18.144263 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:18.144263 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:18.144263 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:18.144263 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:18.144263 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:18.144263 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:18.144263 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:18.144263 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:18.144263 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:18.144263 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:18.144263 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:18.144263 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:18.144263 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:18.144263 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:18.144263 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:18.145503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:18.145503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:18.145503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:18.145503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:18.145503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:18.145503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:18.145503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:18.145503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:18.145503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:18.145503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:18.145503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:18.145503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:18.145503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:18.145503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:18.145503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:18.145503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:18.145503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:18.146802 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:18.146802 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:18.146802 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:18.152527 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 310/644] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:18.152527 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfad7e-cdb2-4185-8b28-cd658bd4bfc8 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:18.184996 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba0896-44f6-42b4-bc78-4b8f6bba96dd None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:18.222366 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02407152-84a8-4c27-acb4-24bb83e56ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:18.223066 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02407152-84a8-4c27-acb4-24bb83e56ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:18.223341 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02407152-84a8-4c27-acb4-24bb83e56ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:18.223651 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02407152-84a8-4c27-acb4-24bb83e56ab3 None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:18.224645 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02407152-84a8-4c27-acb4-24bb83e56ab3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:18.224960 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02407152-84a8-4c27-acb4-24bb83e56ab3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:18.226569 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02407152-84a8-4c27-acb4-24bb83e56ab3 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:18.230466 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:18.240695 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 335/645] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:03:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:18.241613 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02407152-84a8-4c27-acb4-24bb83e56ab3 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:18.261365 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfad7e-cdb2-4185-8b28-cd658bd4bfc8 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:18.297697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49457d7-3d5b-46ce-a8e7-39022a847510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:18.298640 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49457d7-3d5b-46ce-a8e7-39022a847510 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:18.299154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49457d7-3d5b-46ce-a8e7-39022a847510 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:18.299617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49457d7-3d5b-46ce-a8e7-39022a847510 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:18.311384 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49457d7-3d5b-46ce-a8e7-39022a847510 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:03:18.317535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-d49457d7-3d5b-46ce-a8e7-39022a847510 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:18.317535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:18.317535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:18.317535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:18.317535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:18.317535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:18.317535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:18.317535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:18.317535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:18.317535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:18.317535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:18.317535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:18.317535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:03:18.317535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:03:18.317535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:03:18.317535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:03:18.318708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:03:18.318708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:03:18.318708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:03:18.318708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:03:18.318708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:18.318708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:18.318708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:18.318708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:18.318708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:18.318708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:18.318708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:18.318708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:18.318708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:18.318708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:18.318708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:18.318708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:18.319681 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:18.319681 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:18.319681 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:18.319681 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:18.319681 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:03:18.319681 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:03:18.319681 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:03:18.319681 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:03:18.319681 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:03:18.319681 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:03:18.319681 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:18.319681 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:18.322533 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 311/646] 10.222.0.81 () {56 vars in 1102 bytes} [Tue Sep 6 21:03:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:18.323350 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49457d7-3d5b-46ce-a8e7-39022a847510 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:18.362605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02407152-84a8-4c27-acb4-24bb83e56ab3 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:18.365189 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:18.400793 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004bb04e-929b-446f-ba1d-a5cdc8e10a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:18.401413 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bb04e-929b-446f-ba1d-a5cdc8e10a10 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:18.401953 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bb04e-929b-446f-ba1d-a5cdc8e10a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:18.403126 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bb04e-929b-446f-ba1d-a5cdc8e10a10 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:18.404833 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004bb04e-929b-446f-ba1d-a5cdc8e10a10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:18.405487 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004bb04e-929b-446f-ba1d-a5cdc8e10a10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:18.407240 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004bb04e-929b-446f-ba1d-a5cdc8e10a10 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:18.420440 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 336/647] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:18.421067 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004bb04e-929b-446f-ba1d-a5cdc8e10a10 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:18.434669 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49457d7-3d5b-46ce-a8e7-39022a847510 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:18.471146 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c9ca3-6805-4c6b-9349-12ac1bb64f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:18.471761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c9ca3-6805-4c6b-9349-12ac1bb64f76 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:18.472040 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c9ca3-6805-4c6b-9349-12ac1bb64f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:18.472390 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c9ca3-6805-4c6b-9349-12ac1bb64f76 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:18.473300 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c9ca3-6805-4c6b-9349-12ac1bb64f76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:18.473503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c9ca3-6805-4c6b-9349-12ac1bb64f76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:18.474905 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c9ca3-6805-4c6b-9349-12ac1bb64f76 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:18.477046 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:18.489196 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 312/648] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:18.490464 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c9ca3-6805-4c6b-9349-12ac1bb64f76 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:18.538627 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004bb04e-929b-446f-ba1d-a5cdc8e10a10 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:18.575562 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97870d96-2ccd-4d32-b840-dd49258f2bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:18.576207 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97870d96-2ccd-4d32-b840-dd49258f2bde None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:18.576537 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97870d96-2ccd-4d32-b840-dd49258f2bde None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:18.576772 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97870d96-2ccd-4d32-b840-dd49258f2bde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:18.577502 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97870d96-2ccd-4d32-b840-dd49258f2bde None admin] RBAC: Adding query filter params (role.id=747c70d4cefb4a82816c17da1259b90f, scope.project.id=002e09339d4e49ce98434571d3b64248, user.id=4441d8fea57f401a96fb8cbd2b501059) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:18.577813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97870d96-2ccd-4d32-b840-dd49258f2bde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:18.579250 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97870d96-2ccd-4d32-b840-dd49258f2bde None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:18.588142 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 337/649] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:03:18 2022] GET /identity/v3/role_assignments?user.id=4441d8fea57f401a96fb8cbd2b501059&scope.project.id=002e09339d4e49ce98434571d3b64248&role.id=747c70d4cefb4a82816c17da1259b90f => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:18.588142 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97870d96-2ccd-4d32-b840-dd49258f2bde None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:18.621044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:18.621441 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c9ca3-6805-4c6b-9349-12ac1bb64f76 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:18.673149 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f508490-c905-4634-a997-939d37ce4ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:18.674027 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f508490-c905-4634-a997-939d37ce4ad0 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:18.674560 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f508490-c905-4634-a997-939d37ce4ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:18.674977 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f508490-c905-4634-a997-939d37ce4ad0 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:18.676553 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f508490-c905-4634-a997-939d37ce4ad0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:18.677064 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f508490-c905-4634-a997-939d37ce4ad0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:18.679220 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f508490-c905-4634-a997-939d37ce4ad0 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:18.689492 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 313/650] 10.222.0.81 () {56 vars in 1103 bytes} [Tue Sep 6 21:03:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:18.690574 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f508490-c905-4634-a997-939d37ce4ad0 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:18.712456 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97870d96-2ccd-4d32-b840-dd49258f2bde None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:18.754036 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e1645-530a-4574-a308-6e97365984fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:18.754795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e1645-530a-4574-a308-6e97365984fe None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:18.755175 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e1645-530a-4574-a308-6e97365984fe None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:18.755553 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e1645-530a-4574-a308-6e97365984fe None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:18.764512 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e1645-530a-4574-a308-6e97365984fe None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:18.766385 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e1645-530a-4574-a308-6e97365984fe None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:18.767609 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:18.782934 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-965e1645-530a-4574-a308-6e97365984fe None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 21:03:18.782934 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:18.782934 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:18.782934 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:18.782934 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:18.782934 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:18.782934 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:18.782934 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:18.782934 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:18.782934 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:18.782934 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:18.782934 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:18.782934 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:03:18.782934 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:03:18.782934 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:03:18.782934 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:03:18.783947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:18.783947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:18.783947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:03:18.783947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:18.783947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:03:18.783947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:18.783947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:18.783947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:18.783947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:18.783947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:18.783947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:18.783947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:18.783947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:18.783947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:18.783947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:18.783947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:18.783947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:18.783947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:18.784991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:18.784991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:18.784991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:03:18.784991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:03:18.784991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:03:18.784991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:03:18.784991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:03:18.784991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:03:18.784991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 21:03:18.784991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:18.787496 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 338/651] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:03:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:18.790744 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e1645-530a-4574-a308-6e97365984fe None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:18.826786 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f508490-c905-4634-a997-939d37ce4ad0 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:18.876877 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0231c6-cfd6-466a-80a2-5fb0bebdadaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:18.877164 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0231c6-cfd6-466a-80a2-5fb0bebdadaa None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:18.877444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0231c6-cfd6-466a-80a2-5fb0bebdadaa None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:18.877717 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0231c6-cfd6-466a-80a2-5fb0bebdadaa None admin] PATH_INFO: `/v3/users/glance` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:18.891157 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0231c6-cfd6-466a-80a2-5fb0bebdadaa None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:18.892407 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0231c6-cfd6-466a-80a2-5fb0bebdadaa None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:18.895907 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:18.906061 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-ea0231c6-cfd6-466a-80a2-5fb0bebdadaa None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 06 21:03:18.906061 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:18.906061 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:18.906061 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:18.906061 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:18.906061 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:18.906061 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:18.906061 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:18.906061 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:18.906061 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:18.906061 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:18.906061 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:18.906061 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:03:18.906061 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:03:18.906061 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:03:18.906061 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:03:18.907617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:18.907617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:18.907617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:03:18.907617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:18.907617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:03:18.907617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:18.907617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:18.907617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:18.907617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:18.907617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:18.907617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:18.907617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:18.907617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:18.907617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:18.907617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:18.907617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:18.907617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:18.907617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:18.914840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:18.914840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:18.914840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:03:18.914840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:03:18.914840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:03:18.914840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:03:18.914840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:03:18.914840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:03:18.914840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 06 21:03:18.914840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:18.914840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 314/652] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:03:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:18.914840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0231c6-cfd6-466a-80a2-5fb0bebdadaa None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:18.920411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e1645-530a-4574-a308-6e97365984fe None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:18.970958 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c12f03-9f4f-4bf5-b751-00c97ca1dc2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:18.971972 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c12f03-9f4f-4bf5-b751-00c97ca1dc2d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:18.972350 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c12f03-9f4f-4bf5-b751-00c97ca1dc2d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:18.973197 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c12f03-9f4f-4bf5-b751-00c97ca1dc2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:18.987567 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c12f03-9f4f-4bf5-b751-00c97ca1dc2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:18.989682 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c12f03-9f4f-4bf5-b751-00c97ca1dc2d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:19.013503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-72c12f03-9f4f-4bf5-b751-00c97ca1dc2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:19.013503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:19.013503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:19.013503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:19.013503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:19.013503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:19.013503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:19.013503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:19.013503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:19.013503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:19.013503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:19.013503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:19.013503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:19.013503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:19.013503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:19.013503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:19.014763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:19.014763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:19.014763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:19.014763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:19.014763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:19.014763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:19.014763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:19.014763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:19.014763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:19.014763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:19.014763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:19.014763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:19.014763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:19.014763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:19.014763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:19.014763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:19.014763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:19.015869 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:19.015869 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:19.015869 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:19.017143 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 339/653] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:19.018109 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c12f03-9f4f-4bf5-b751-00c97ca1dc2d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:19.041416 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0231c6-cfd6-466a-80a2-5fb0bebdadaa None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:19.060943 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:19.081163 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b836de9-fb81-4a66-91ac-afadb009a7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:19.082146 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b836de9-fb81-4a66-91ac-afadb009a7ab None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:19.082595 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b836de9-fb81-4a66-91ac-afadb009a7ab None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:19.083070 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b836de9-fb81-4a66-91ac-afadb009a7ab None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:19.084032 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b836de9-fb81-4a66-91ac-afadb009a7ab None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:19.084503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b836de9-fb81-4a66-91ac-afadb009a7ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:19.086391 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b836de9-fb81-4a66-91ac-afadb009a7ab None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:19.110090 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 315/654] 10.222.0.81 () {56 vars in 1137 bytes} [Tue Sep 6 21:03:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:19.112425 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b836de9-fb81-4a66-91ac-afadb009a7ab None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:19.151987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c12f03-9f4f-4bf5-b751-00c97ca1dc2d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:19.192533 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6703f-365b-461d-8f01-02b7a67844bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:19.193581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6703f-365b-461d-8f01-02b7a67844bd None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:19.193963 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6703f-365b-461d-8f01-02b7a67844bd None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:19.194335 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c6703f-365b-461d-8f01-02b7a67844bd None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:19.195472 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6703f-365b-461d-8f01-02b7a67844bd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:19.196313 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6703f-365b-461d-8f01-02b7a67844bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:19.198145 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c6703f-365b-461d-8f01-02b7a67844bd None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:19.211852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:19.223424 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 340/655] 10.222.0.81 () {56 vars in 1137 bytes} [Tue Sep 6 21:03:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:19.224932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6703f-365b-461d-8f01-02b7a67844bd None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:19.250982 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b836de9-fb81-4a66-91ac-afadb009a7ab None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:19.298511 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e7d2e-aa7f-439a-9b1d-4f13a4375196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:19.299923 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e7d2e-aa7f-439a-9b1d-4f13a4375196 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:19.300404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e7d2e-aa7f-439a-9b1d-4f13a4375196 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:19.300855 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6e7d2e-aa7f-439a-9b1d-4f13a4375196 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:19.301812 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e7d2e-aa7f-439a-9b1d-4f13a4375196 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:19.302272 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e7d2e-aa7f-439a-9b1d-4f13a4375196 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:19.304215 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6e7d2e-aa7f-439a-9b1d-4f13a4375196 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:19.319529 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 316/656] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:19.320827 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e7d2e-aa7f-439a-9b1d-4f13a4375196 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:19.368658 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:19.377855 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c6703f-365b-461d-8f01-02b7a67844bd None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:19.423280 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f3064-cad1-4ec4-a334-198662faa4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:19.424913 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f3064-cad1-4ec4-a334-198662faa4cf None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:19.425421 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f3064-cad1-4ec4-a334-198662faa4cf None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:19.426345 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f3064-cad1-4ec4-a334-198662faa4cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:19.446712 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6e7d2e-aa7f-439a-9b1d-4f13a4375196 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:19.484042 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86214a40-d442-4582-a361-1d65f2b2c145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:19.484800 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86214a40-d442-4582-a361-1d65f2b2c145 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:19.485142 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86214a40-d442-4582-a361-1d65f2b2c145 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:19.485481 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86214a40-d442-4582-a361-1d65f2b2c145 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:19.508237 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:19.511959 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f3064-cad1-4ec4-a334-198662faa4cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:19.513728 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f3064-cad1-4ec4-a334-198662faa4cf None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:19.558676 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86214a40-d442-4582-a361-1d65f2b2c145 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:19.560043 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86214a40-d442-4582-a361-1d65f2b2c145 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:19.594060 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:19.627472 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 341/657] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:03:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 21:03:19.628682 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f3064-cad1-4ec4-a334-198662faa4cf None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:19.670837 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 317/658] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:03:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 21:03:19.672839 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03985e4a-f6ae-47cf-96ca-35c3b65169c9 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:19.673335 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03985e4a-f6ae-47cf-96ca-35c3b65169c9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:19.673856 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03985e4a-f6ae-47cf-96ca-35c3b65169c9 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:19.679432 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 318/659] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:19.680421 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03985e4a-f6ae-47cf-96ca-35c3b65169c9 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:19.736911 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:19.741160 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f3064-cad1-4ec4-a334-198662faa4cf None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:19.777670 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470ec14-c4d3-4ef6-a23f-8b51cd8324d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:19.778342 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470ec14-c4d3-4ef6-a23f-8b51cd8324d9 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:19.778599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470ec14-c4d3-4ef6-a23f-8b51cd8324d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:19.778883 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470ec14-c4d3-4ef6-a23f-8b51cd8324d9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:19.786830 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470ec14-c4d3-4ef6-a23f-8b51cd8324d9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:19.789098 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470ec14-c4d3-4ef6-a23f-8b51cd8324d9 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:19.790147 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03985e4a-f6ae-47cf-96ca-35c3b65169c9 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:19.802809 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-a470ec14-c4d3-4ef6-a23f-8b51cd8324d9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 21:03:19.802809 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:19.802809 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:19.802809 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:19.802809 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:19.802809 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:19.802809 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:19.802809 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:19.802809 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:19.802809 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:19.802809 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:19.802809 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:19.802809 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:03:19.802809 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:03:19.802809 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:03:19.802809 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:03:19.804011 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:19.804011 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:19.804011 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:03:19.804011 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:19.804011 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:03:19.804011 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:19.804011 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:19.804011 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:19.804011 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:19.804011 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:19.804011 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:19.804011 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:19.804011 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:19.804011 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:19.804011 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:19.804011 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:19.804011 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:19.804011 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:19.805445 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:19.805445 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:19.805445 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:03:19.805445 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:03:19.805445 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:03:19.805445 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:03:19.805445 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:03:19.805445 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:03:19.805445 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 06 21:03:19.805445 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:19.808230 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 342/660] 10.222.0.81 () {56 vars in 1102 bytes} [Tue Sep 6 21:03:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:19.809265 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470ec14-c4d3-4ef6-a23f-8b51cd8324d9 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:19.827962 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c2b171-baab-4198-9d85-10d2dc4e03ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:19.828746 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2b171-baab-4198-9d85-10d2dc4e03ea None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:19.829132 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2b171-baab-4198-9d85-10d2dc4e03ea None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:19.829513 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c2b171-baab-4198-9d85-10d2dc4e03ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:19.831632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:19.841838 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2b171-baab-4198-9d85-10d2dc4e03ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:19.843394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c2b171-baab-4198-9d85-10d2dc4e03ea None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:19.862831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-22c2b171-baab-4198-9d85-10d2dc4e03ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:19.862831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:19.862831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:19.862831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:19.862831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:19.862831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:19.862831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:19.862831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:19.862831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:19.862831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:19.862831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:19.862831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:19.862831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:19.862831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:19.862831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:19.862831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:19.863993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:19.863993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:19.863993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:19.863993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:19.863993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:19.863993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:19.863993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:19.863993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:19.863993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:19.863993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:19.863993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:19.863993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:19.863993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:19.863993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:19.863993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:19.863993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:19.863993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:19.864993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:19.864993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:19.864993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:19.864993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 319/661] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:19.868589 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03693c72-3970-4275-955f-b69a67329e6a None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:19.868882 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03693c72-3970-4275-955f-b69a67329e6a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:19.869159 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03693c72-3970-4275-955f-b69a67329e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:19.891142 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-03693c72-3970-4275-955f-b69a67329e6a None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:19.892475 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-03693c72-3970-4275-955f-b69a67329e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:19.923441 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470ec14-c4d3-4ef6-a23f-8b51cd8324d9 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:19.959426 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ae41d-5c49-4ad6-b933-094abb584649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:19.960061 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ae41d-5c49-4ad6-b933-094abb584649 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:19.961045 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ae41d-5c49-4ad6-b933-094abb584649 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:19.961328 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ae41d-5c49-4ad6-b933-094abb584649 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:19.972760 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 320/662] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:03:19.972760 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03693c72-3970-4275-955f-b69a67329e6a None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:19.978140 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ae41d-5c49-4ad6-b933-094abb584649 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:19.980420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ae41d-5c49-4ad6-b933-094abb584649 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:20.001446 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-311ae41d-5c49-4ad6-b933-094abb584649 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:20.001446 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:20.001446 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:20.001446 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:20.001446 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:20.001446 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:20.001446 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:20.001446 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:20.001446 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:20.001446 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:20.001446 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:20.001446 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:20.001446 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:20.001446 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:20.001446 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:20.001446 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:20.002517 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:20.002517 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:20.002517 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:20.002517 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:20.002517 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:20.002517 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:20.002517 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:20.002517 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:20.002517 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:20.002517 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:20.002517 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:20.002517 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:20.002517 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:20.002517 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:20.002517 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:20.002517 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:20.002517 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:20.003418 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:20.003418 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:20.003418 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:20.005824 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 343/663] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:20.007125 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ae41d-5c49-4ad6-b933-094abb584649 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:20.026272 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:20.096453 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03693c72-3970-4275-955f-b69a67329e6a None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:20.115111 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:20.134124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3f58b-9d12-4960-9fd3-dfdf60edc3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:20.134870 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3f58b-9d12-4960-9fd3-dfdf60edc3cd None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:20.135267 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3f58b-9d12-4960-9fd3-dfdf60edc3cd None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:20.135637 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c3f58b-9d12-4960-9fd3-dfdf60edc3cd None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:20.136525 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3f58b-9d12-4960-9fd3-dfdf60edc3cd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:20.136925 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3f58b-9d12-4960-9fd3-dfdf60edc3cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:20.137637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ae41d-5c49-4ad6-b933-094abb584649 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:20.138529 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c3f58b-9d12-4960-9fd3-dfdf60edc3cd None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:20.167479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 321/664] 10.222.0.81 () {56 vars in 1139 bytes} [Tue Sep 6 21:03:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:20.167479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3f58b-9d12-4960-9fd3-dfdf60edc3cd None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:20.193947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5608b7-a713-4c72-9f4b-34b0d1d5d354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:20.195545 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5608b7-a713-4c72-9f4b-34b0d1d5d354 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:20.196464 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5608b7-a713-4c72-9f4b-34b0d1d5d354 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:20.197062 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5608b7-a713-4c72-9f4b-34b0d1d5d354 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:20.197991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5608b7-a713-4c72-9f4b-34b0d1d5d354 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:20.198704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5608b7-a713-4c72-9f4b-34b0d1d5d354 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:20.200956 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5608b7-a713-4c72-9f4b-34b0d1d5d354 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:20.222521 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 344/665] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:20.224233 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5608b7-a713-4c72-9f4b-34b0d1d5d354 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:20.287621 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c3f58b-9d12-4960-9fd3-dfdf60edc3cd None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:20.312808 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:20.328053 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e98616-d308-468f-a3da-3c8f4e51e8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:20.328693 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e98616-d308-468f-a3da-3c8f4e51e8d6 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:20.328972 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e98616-d308-468f-a3da-3c8f4e51e8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:20.329244 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e98616-d308-468f-a3da-3c8f4e51e8d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:20.329918 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e98616-d308-468f-a3da-3c8f4e51e8d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:20.330215 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e98616-d308-468f-a3da-3c8f4e51e8d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:20.331574 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e98616-d308-468f-a3da-3c8f4e51e8d6 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:20.343706 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 322/666] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:20.344559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e98616-d308-468f-a3da-3c8f4e51e8d6 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:20.352941 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5608b7-a713-4c72-9f4b-34b0d1d5d354 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:20.382080 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:20.389521 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae24f2-64fb-4ee7-8c47-301181f8a748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:20.390139 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae24f2-64fb-4ee7-8c47-301181f8a748 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:20.390438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae24f2-64fb-4ee7-8c47-301181f8a748 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:20.390744 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae24f2-64fb-4ee7-8c47-301181f8a748 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:20.457553 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e98616-d308-468f-a3da-3c8f4e51e8d6 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:20.470312 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae24f2-64fb-4ee7-8c47-301181f8a748 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:20.472011 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae24f2-64fb-4ee7-8c47-301181f8a748 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:20.496735 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af4a76-4412-4601-a756-8beeacd90197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:20.497380 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af4a76-4412-4601-a756-8beeacd90197 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:20.497657 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af4a76-4412-4601-a756-8beeacd90197 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:20.497942 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af4a76-4412-4601-a756-8beeacd90197 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:20.505374 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af4a76-4412-4601-a756-8beeacd90197 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:20.506831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78af4a76-4412-4601-a756-8beeacd90197 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:20.518912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-78af4a76-4412-4601-a756-8beeacd90197 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:20.518912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:20.518912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:20.518912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:20.518912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:20.518912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:20.518912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:20.518912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:20.518912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:20.518912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:20.518912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:20.518912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:20.518912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:03:20.518912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:03:20.518912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:03:20.520069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:03:20.520069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:20.520069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:20.520069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:20.520069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:20.520069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:20.520069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:20.520069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:20.520069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:20.520069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:20.520069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:20.520069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:20.520069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:20.520069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:20.520069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:20.520069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:20.520069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:20.521133 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:03:20.521133 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:03:20.521133 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:03:20.521133 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:03:20.521133 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:03:20.521133 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:03:20.521133 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:20.521133 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:20.524697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 323/667] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:03:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:20.525512 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af4a76-4412-4601-a756-8beeacd90197 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:20.552130 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:20.593030 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 345/668] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:03:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 21:03:20.595150 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae24f2-64fb-4ee7-8c47-301181f8a748 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:20.630199 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:20.638524 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af4a76-4412-4601-a756-8beeacd90197 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:20.680244 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de1512-f907-44e5-98e2-64ff98236f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:20.683235 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de1512-f907-44e5-98e2-64ff98236f7c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:20.683235 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de1512-f907-44e5-98e2-64ff98236f7c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:20.683235 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de1512-f907-44e5-98e2-64ff98236f7c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:20.694990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de1512-f907-44e5-98e2-64ff98236f7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:03:20.700079 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-a8de1512-f907-44e5-98e2-64ff98236f7c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:20.700079 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:20.700079 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:20.700079 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:20.700079 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:20.700079 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:20.700079 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:20.700079 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:20.700079 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:20.700079 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:20.700079 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:20.700079 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:20.700079 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:03:20.700079 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:03:20.700079 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:03:20.700079 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:03:20.701251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:03:20.701251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:03:20.701251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:03:20.701251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:03:20.701251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:20.701251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:20.701251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:20.701251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:20.701251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:20.701251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:20.701251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:20.701251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:20.701251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:20.701251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:20.701251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:20.701251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:20.702278 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:20.702278 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:20.702278 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:20.702278 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:20.702278 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:03:20.702278 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:03:20.702278 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:03:20.702278 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:03:20.702278 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:03:20.702278 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:03:20.702278 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:20.702278 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:20.704664 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 324/669] 10.222.0.81 () {56 vars in 1102 bytes} [Tue Sep 6 21:03:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:20.705636 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de1512-f907-44e5-98e2-64ff98236f7c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:20.735697 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae24f2-64fb-4ee7-8c47-301181f8a748 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:20.782619 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee162076-1039-47b8-91a0-ea22008434a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:20.783545 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee162076-1039-47b8-91a0-ea22008434a1 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:20.783992 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee162076-1039-47b8-91a0-ea22008434a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:20.784520 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee162076-1039-47b8-91a0-ea22008434a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:20.792690 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee162076-1039-47b8-91a0-ea22008434a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:20.794573 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee162076-1039-47b8-91a0-ea22008434a1 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:20.807605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-ee162076-1039-47b8-91a0-ea22008434a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:20.807605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:20.807605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:20.807605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:20.807605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:20.807605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:20.807605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:20.807605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:20.807605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:20.807605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:20.807605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:20.807605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:20.807605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:03:20.807605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:03:20.807605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:03:20.808737 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:03:20.808737 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:20.808737 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:20.808737 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:20.808737 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:20.808737 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:20.808737 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:20.808737 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:20.808737 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:20.808737 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:20.808737 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:20.808737 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:20.808737 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:20.808737 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:20.808737 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:20.808737 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:20.808737 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:20.814386 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:03:20.814386 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:03:20.814386 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:03:20.814386 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:03:20.814386 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:03:20.814386 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:03:20.814386 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:20.814386 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:20.814386 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 346/670] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:03:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:20.814386 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee162076-1039-47b8-91a0-ea22008434a1 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:20.823568 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de1512-f907-44e5-98e2-64ff98236f7c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:20.847421 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:20.869618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8f474-442b-4400-ab5c-1523e2d7206a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:20.870241 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8f474-442b-4400-ab5c-1523e2d7206a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:20.870515 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8f474-442b-4400-ab5c-1523e2d7206a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:20.870781 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8f474-442b-4400-ab5c-1523e2d7206a None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:20.871481 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8f474-442b-4400-ab5c-1523e2d7206a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:20.871783 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8f474-442b-4400-ab5c-1523e2d7206a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:20.876299 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8f474-442b-4400-ab5c-1523e2d7206a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:20.893531 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 325/671] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:03:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:20.893531 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8f474-442b-4400-ab5c-1523e2d7206a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:20.917719 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:20.947051 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee162076-1039-47b8-91a0-ea22008434a1 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:20.985926 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece1cdf-ea01-4890-8af6-6a3dc0fd7706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:20.986588 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece1cdf-ea01-4890-8af6-6a3dc0fd7706 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:20.986874 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece1cdf-ea01-4890-8af6-6a3dc0fd7706 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:20.987217 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece1cdf-ea01-4890-8af6-6a3dc0fd7706 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:20.998404 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece1cdf-ea01-4890-8af6-6a3dc0fd7706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:20.999856 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece1cdf-ea01-4890-8af6-6a3dc0fd7706 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:21.013060 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8f474-442b-4400-ab5c-1523e2d7206a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:21.014983 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-4ece1cdf-ea01-4890-8af6-6a3dc0fd7706 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:21.014983 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:21.014983 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:21.014983 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:21.014983 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:21.014983 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:21.014983 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:21.014983 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:21.014983 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:21.014983 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:21.014983 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:21.014983 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:21.014983 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:21.014983 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:21.014983 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:21.014983 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:21.016234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:21.016234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:21.016234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:21.016234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:21.016234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:21.016234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:21.016234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:21.016234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:21.016234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:21.016234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:21.016234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:21.016234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:21.016234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:21.016234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:21.016234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:21.016234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:21.016234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:21.017143 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:21.017143 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:21.017143 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:21.017143 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 347/672] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:21.017143 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece1cdf-ea01-4890-8af6-6a3dc0fd7706 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:21.049236 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306f216-91cc-4ee5-ab48-7b9482b383fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:21.049849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306f216-91cc-4ee5-ab48-7b9482b383fa None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:21.050127 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306f216-91cc-4ee5-ab48-7b9482b383fa None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:21.050402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306f216-91cc-4ee5-ab48-7b9482b383fa None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:21.051068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306f216-91cc-4ee5-ab48-7b9482b383fa None admin] RBAC: Adding query filter params (name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:21.051374 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306f216-91cc-4ee5-ab48-7b9482b383fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:21.052782 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306f216-91cc-4ee5-ab48-7b9482b383fa None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:21.061591 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 326/673] 10.222.0.81 () {56 vars in 1103 bytes} [Tue Sep 6 21:03:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:21.062426 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306f216-91cc-4ee5-ab48-7b9482b383fa None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:21.114547 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:21.136878 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece1cdf-ea01-4890-8af6-6a3dc0fd7706 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:21.145173 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:21.173562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306f216-91cc-4ee5-ab48-7b9482b383fa None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:21.179116 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c2fcb-123a-42e0-813a-560ed5b39133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:21.179763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c2fcb-123a-42e0-813a-560ed5b39133 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:21.180042 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c2fcb-123a-42e0-813a-560ed5b39133 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:21.180340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c2fcb-123a-42e0-813a-560ed5b39133 None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:21.181082 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c2fcb-123a-42e0-813a-560ed5b39133 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:21.181386 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c2fcb-123a-42e0-813a-560ed5b39133 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:21.182818 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c2fcb-123a-42e0-813a-560ed5b39133 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:21.194678 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 348/674] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:03:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:21.196211 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a872c66-b321-4bb9-a466-9719cdefdb7e None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:21.196497 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a872c66-b321-4bb9-a466-9719cdefdb7e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:21.196777 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a872c66-b321-4bb9-a466-9719cdefdb7e None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:21.198050 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 349/675] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:21.198762 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a872c66-b321-4bb9-a466-9719cdefdb7e None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:21.220790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6388c11-cc3b-4328-9ac6-c8acaacbddcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:21.221796 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6388c11-cc3b-4328-9ac6-c8acaacbddcc None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:21.221796 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6388c11-cc3b-4328-9ac6-c8acaacbddcc None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:21.221977 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6388c11-cc3b-4328-9ac6-c8acaacbddcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:21.222889 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6388c11-cc3b-4328-9ac6-c8acaacbddcc None admin] RBAC: Adding query filter params (role.id=747c70d4cefb4a82816c17da1259b90f, scope.project.id=002e09339d4e49ce98434571d3b64248, user.id=af9589aaba334db494ed0b036e94062f) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:21.223007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6388c11-cc3b-4328-9ac6-c8acaacbddcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:21.224479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6388c11-cc3b-4328-9ac6-c8acaacbddcc None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:21.231487 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 327/676] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:03:21 2022] GET /identity/v3/role_assignments?user.id=af9589aaba334db494ed0b036e94062f&scope.project.id=002e09339d4e49ce98434571d3b64248&role.id=747c70d4cefb4a82816c17da1259b90f => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:21.232464 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6388c11-cc3b-4328-9ac6-c8acaacbddcc None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:21.339152 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a872c66-b321-4bb9-a466-9719cdefdb7e None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:21.365528 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6388c11-cc3b-4328-9ac6-c8acaacbddcc None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:21.381551 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f634b6-d9a7-43d3-ba98-3aa329fdc936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:21.382339 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f634b6-d9a7-43d3-ba98-3aa329fdc936 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:21.383217 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f634b6-d9a7-43d3-ba98-3aa329fdc936 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:21.383217 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f634b6-d9a7-43d3-ba98-3aa329fdc936 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:21.383671 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f634b6-d9a7-43d3-ba98-3aa329fdc936 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:21.384084 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f634b6-d9a7-43d3-ba98-3aa329fdc936 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:21.385453 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f634b6-d9a7-43d3-ba98-3aa329fdc936 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:21.407371 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 350/677] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:21.407371 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f634b6-d9a7-43d3-ba98-3aa329fdc936 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:21.407371 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:21.416230 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6fba1-32aa-4de5-a10d-c77c6f2a188a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:21.417267 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6fba1-32aa-4de5-a10d-c77c6f2a188a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:21.418720 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6fba1-32aa-4de5-a10d-c77c6f2a188a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:21.418720 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6fba1-32aa-4de5-a10d-c77c6f2a188a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:21.427953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:21.430783 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6fba1-32aa-4de5-a10d-c77c6f2a188a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:21.433081 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c6fba1-32aa-4de5-a10d-c77c6f2a188a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:21.451181 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-73c6fba1-32aa-4de5-a10d-c77c6f2a188a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:21.451181 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:21.451181 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:21.451181 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:21.451181 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:21.451181 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:21.451181 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:21.451181 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:21.451181 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:21.451181 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:21.451181 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:21.451181 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:21.451181 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:21.451181 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:21.451181 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:21.451181 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:21.457304 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:21.457304 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:21.457304 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:21.457304 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:21.457304 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:21.457304 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:21.457304 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:21.457304 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:21.457304 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:21.457304 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:21.457304 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:21.457304 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:21.457304 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:21.457304 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:21.457304 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:21.457304 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:21.457304 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:21.458408 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:21.458408 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:21.458408 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:21.458408 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 328/678] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:21.458408 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa627a71-85e7-497a-973a-64f90cc929e8 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:21.458408 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa627a71-85e7-497a-973a-64f90cc929e8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:21.458408 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa627a71-85e7-497a-973a-64f90cc929e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:21.475464 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-aa627a71-85e7-497a-973a-64f90cc929e8 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:21.476816 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-aa627a71-85e7-497a-973a-64f90cc929e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:21.540940 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f634b6-d9a7-43d3-ba98-3aa329fdc936 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:21.564381 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 329/679] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:03:21.564381 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa627a71-85e7-497a-973a-64f90cc929e8 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:21.588741 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60503aca-af3b-4323-8e74-6aa44cd91bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:21.589621 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60503aca-af3b-4323-8e74-6aa44cd91bfc None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:21.590052 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60503aca-af3b-4323-8e74-6aa44cd91bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:21.590486 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60503aca-af3b-4323-8e74-6aa44cd91bfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:21.591220 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60503aca-af3b-4323-8e74-6aa44cd91bfc None admin] RBAC: Adding query filter params (role.id=747c70d4cefb4a82816c17da1259b90f, scope.project.id=002e09339d4e49ce98434571d3b64248, user.id=c2ba30d9c40641bf8abb580a219b5352) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:21.591531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60503aca-af3b-4323-8e74-6aa44cd91bfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:21.593091 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60503aca-af3b-4323-8e74-6aa44cd91bfc None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:21.608741 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 351/680] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:03:21 2022] GET /identity/v3/role_assignments?user.id=c2ba30d9c40641bf8abb580a219b5352&scope.project.id=002e09339d4e49ce98434571d3b64248&role.id=747c70d4cefb4a82816c17da1259b90f => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:21.610055 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60503aca-af3b-4323-8e74-6aa44cd91bfc None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:21.730238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:21.768320 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa627a71-85e7-497a-973a-64f90cc929e8 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:21.772741 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60503aca-af3b-4323-8e74-6aa44cd91bfc None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:21.801494 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:21.814586 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7db71-8156-41df-b73a-5f0047511a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:21.815391 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7db71-8156-41df-b73a-5f0047511a43 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:21.816984 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2378520-753d-45f6-a795-640a8504a499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:21.817113 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7db71-8156-41df-b73a-5f0047511a43 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:21.817113 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f7db71-8156-41df-b73a-5f0047511a43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:21.817251 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2378520-753d-45f6-a795-640a8504a499 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:21.817251 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2378520-753d-45f6-a795-640a8504a499 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:21.817825 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2378520-753d-45f6-a795-640a8504a499 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:21.818717 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2378520-753d-45f6-a795-640a8504a499 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:21.819238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2378520-753d-45f6-a795-640a8504a499 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:21.821499 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2378520-753d-45f6-a795-640a8504a499 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:21.830030 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7db71-8156-41df-b73a-5f0047511a43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:21.839299 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f7db71-8156-41df-b73a-5f0047511a43 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:21.846077 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 352/681] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:21.853194 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2378520-753d-45f6-a795-640a8504a499 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:21.860886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-55f7db71-8156-41df-b73a-5f0047511a43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:21.860886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:21.860886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:21.860886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:21.860886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:21.860886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:21.860886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:21.860886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:21.860886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:21.860886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:21.860886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:21.860886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:21.860886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:03:21.860886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:03:21.860886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:03:21.861879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:03:21.861879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:21.861879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:21.861879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:21.861879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:21.861879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:21.861879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:21.861879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:21.861879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:21.861879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:21.861879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:21.861879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:21.861879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:21.861879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:21.861879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:21.861879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:21.861879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:21.862791 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:03:21.862791 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:03:21.862791 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:03:21.862791 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:03:21.862791 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:03:21.862791 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:03:21.862791 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:21.862791 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:21.871420 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 330/682] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:03:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:21.880879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7db71-8156-41df-b73a-5f0047511a43 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:21.996290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2378520-753d-45f6-a795-640a8504a499 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:22.024802 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:22.034901 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58e101-59f3-4b95-bd0c-db08cc5d690a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:22.035556 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58e101-59f3-4b95-bd0c-db08cc5d690a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:22.035835 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58e101-59f3-4b95-bd0c-db08cc5d690a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:22.036132 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58e101-59f3-4b95-bd0c-db08cc5d690a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:22.041020 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f7db71-8156-41df-b73a-5f0047511a43 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:22.045078 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58e101-59f3-4b95-bd0c-db08cc5d690a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:22.046567 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58e101-59f3-4b95-bd0c-db08cc5d690a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:22.062780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-be58e101-59f3-4b95-bd0c-db08cc5d690a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 21:03:22.062780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:22.062780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:22.062780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:22.062780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:22.062780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:22.062780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:22.062780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:22.062780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:22.062780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:22.062780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:22.062780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:22.062780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:03:22.062780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:03:22.062780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:03:22.062780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:03:22.063810 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:22.063810 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:22.063810 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:03:22.063810 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:22.063810 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:03:22.063810 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:22.063810 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:22.063810 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:22.063810 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:22.063810 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:22.063810 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:22.063810 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:22.063810 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:22.063810 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:22.063810 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:22.063810 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:22.063810 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:22.063810 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:22.064795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:22.064795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:22.064795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:03:22.064795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:03:22.064795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:03:22.064795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:03:22.064795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:03:22.064795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:03:22.064795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 21:03:22.064795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:22.064795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 353/683] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:03:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:22.066014 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58e101-59f3-4b95-bd0c-db08cc5d690a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:22.082896 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6ca12-a34d-4623-84e6-c1dff31e0686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:22.083563 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6ca12-a34d-4623-84e6-c1dff31e0686 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:22.083913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6ca12-a34d-4623-84e6-c1dff31e0686 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:22.084292 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6ca12-a34d-4623-84e6-c1dff31e0686 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:22.085099 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6ca12-a34d-4623-84e6-c1dff31e0686 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:22.085902 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6ca12-a34d-4623-84e6-c1dff31e0686 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:22.087333 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6ca12-a34d-4623-84e6-c1dff31e0686 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:22.102162 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 331/684] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:03:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:22.103031 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6ca12-a34d-4623-84e6-c1dff31e0686 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:22.151364 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:22.178169 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58e101-59f3-4b95-bd0c-db08cc5d690a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:22.215089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6ca12-a34d-4623-84e6-c1dff31e0686 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:22.217229 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0da432-80e8-4ea1-bd6c-1cc3478f3e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:22.218012 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0da432-80e8-4ea1-bd6c-1cc3478f3e2f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:22.218294 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0da432-80e8-4ea1-bd6c-1cc3478f3e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:22.218569 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0da432-80e8-4ea1-bd6c-1cc3478f3e2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:22.230159 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0da432-80e8-4ea1-bd6c-1cc3478f3e2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:03:22.236080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-ff0da432-80e8-4ea1-bd6c-1cc3478f3e2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:03:22.236080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:22.236080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:22.236080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:22.236080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:22.236080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:22.236080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:22.236080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:22.236080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:22.236080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:22.236080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:22.236080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:22.236080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:03:22.236080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:03:22.236080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:03:22.236080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:03:22.237455 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:03:22.237455 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:03:22.237455 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:03:22.237455 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:03:22.237455 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:22.237455 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:22.237455 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:22.237455 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:22.237455 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:22.237455 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:22.237455 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:22.237455 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:22.237455 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:22.237455 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:22.237455 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:22.237455 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:22.238549 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:22.238549 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:22.238549 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:22.238549 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:22.238549 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:03:22.238549 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:03:22.238549 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:03:22.238549 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:03:22.238549 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:03:22.238549 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:03:22.238549 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:03:22.238549 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:22.242578 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 354/685] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:03:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:22.249514 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0da432-80e8-4ea1-bd6c-1cc3478f3e2f None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:22.258046 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d0718-9acc-4a08-af53-61b77cb5782b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:22.258674 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d0718-9acc-4a08-af53-61b77cb5782b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:22.258954 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d0718-9acc-4a08-af53-61b77cb5782b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:22.259229 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d0718-9acc-4a08-af53-61b77cb5782b None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:22.260086 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d0718-9acc-4a08-af53-61b77cb5782b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:22.260426 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d0718-9acc-4a08-af53-61b77cb5782b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:22.262186 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d0718-9acc-4a08-af53-61b77cb5782b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:22.283499 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 332/686] 10.222.0.81 () {56 vars in 1135 bytes} [Tue Sep 6 21:03:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:22.284446 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d0718-9acc-4a08-af53-61b77cb5782b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:22.304043 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:22.366410 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0da432-80e8-4ea1-bd6c-1cc3478f3e2f None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:22.395883 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:22.399541 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d0718-9acc-4a08-af53-61b77cb5782b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:22.406439 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f69c3-3987-47f1-aaf9-c6a55b14ba38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:22.412456 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f69c3-3987-47f1-aaf9-c6a55b14ba38 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:22.412456 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f69c3-3987-47f1-aaf9-c6a55b14ba38 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:22.412456 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f69c3-3987-47f1-aaf9-c6a55b14ba38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:22.412456 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f69c3-3987-47f1-aaf9-c6a55b14ba38 None admin] RBAC: Adding query filter params (role.id=747c70d4cefb4a82816c17da1259b90f, scope.project.id=002e09339d4e49ce98434571d3b64248, user.id=c9aebd6c7ef24f42949918c99a72722d) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:22.412456 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f69c3-3987-47f1-aaf9-c6a55b14ba38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:22.412456 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f69c3-3987-47f1-aaf9-c6a55b14ba38 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:22.418101 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 355/687] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:03:22 2022] GET /identity/v3/role_assignments?user.id=c9aebd6c7ef24f42949918c99a72722d&scope.project.id=002e09339d4e49ce98434571d3b64248&role.id=747c70d4cefb4a82816c17da1259b90f => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:22.419093 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f69c3-3987-47f1-aaf9-c6a55b14ba38 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:22.442009 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617edb0-bf79-497a-bf3c-66865d2b4d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:22.442997 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617edb0-bf79-497a-bf3c-66865d2b4d5b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:22.443428 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617edb0-bf79-497a-bf3c-66865d2b4d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:22.443838 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617edb0-bf79-497a-bf3c-66865d2b4d5b None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:22.445283 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617edb0-bf79-497a-bf3c-66865d2b4d5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:22.445774 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617edb0-bf79-497a-bf3c-66865d2b4d5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:22.447590 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617edb0-bf79-497a-bf3c-66865d2b4d5b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:22.458156 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 333/688] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:03:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:22.471998 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617edb0-bf79-497a-bf3c-66865d2b4d5b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:22.625706 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f69c3-3987-47f1-aaf9-c6a55b14ba38 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:22.640822 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:22.672142 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929ec31-cba6-47b5-9333-9d3830eaf225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:22.673306 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929ec31-cba6-47b5-9333-9d3830eaf225 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:22.673802 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929ec31-cba6-47b5-9333-9d3830eaf225 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:22.674267 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929ec31-cba6-47b5-9333-9d3830eaf225 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:22.711362 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617edb0-bf79-497a-bf3c-66865d2b4d5b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:22.761376 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf0cdd-1ea0-4fb6-8381-63b5c9d58dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:22.762027 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf0cdd-1ea0-4fb6-8381-63b5c9d58dbd None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:22.762304 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf0cdd-1ea0-4fb6-8381-63b5c9d58dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:22.762573 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf0cdd-1ea0-4fb6-8381-63b5c9d58dbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:22.763931 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929ec31-cba6-47b5-9333-9d3830eaf225 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:22.766575 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929ec31-cba6-47b5-9333-9d3830eaf225 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:22.775696 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf0cdd-1ea0-4fb6-8381-63b5c9d58dbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:22.777185 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf0cdd-1ea0-4fb6-8381-63b5c9d58dbd None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:22.794551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-6aaf0cdd-1ea0-4fb6-8381-63b5c9d58dbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:22.794551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:22.794551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:22.794551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:22.794551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:22.794551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:22.794551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:22.794551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:22.794551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:22.794551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:22.794551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:22.794551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:22.794551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:22.794551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:22.794551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:22.794551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:22.795572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:22.795572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:22.795572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:22.795572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:22.795572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:22.795572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:22.795572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:22.795572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:22.795572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:22.795572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:22.795572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:22.795572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:22.795572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:22.795572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:22.795572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:22.795572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:22.795572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:22.796509 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:22.796509 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:22.796509 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:22.796509 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 334/689] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:22.801697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf0cdd-1ea0-4fb6-8381-63b5c9d58dbd None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:22.821226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:22.905931 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 356/690] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:03:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 21:03:22.911017 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929ec31-cba6-47b5-9333-9d3830eaf225 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:22.922567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf0cdd-1ea0-4fb6-8381-63b5c9d58dbd None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:22.926958 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:22.969268 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b410c-764a-48ed-80e7-df8e88cd1c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:22.970397 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b410c-764a-48ed-80e7-df8e88cd1c4d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:22.971016 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b410c-764a-48ed-80e7-df8e88cd1c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:22.971508 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b410c-764a-48ed-80e7-df8e88cd1c4d None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:22.972518 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b410c-764a-48ed-80e7-df8e88cd1c4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:22.973315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b410c-764a-48ed-80e7-df8e88cd1c4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:22.974996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b410c-764a-48ed-80e7-df8e88cd1c4d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:22.992969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 335/691] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:22.998611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b410c-764a-48ed-80e7-df8e88cd1c4d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:23.036989 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929ec31-cba6-47b5-9333-9d3830eaf225 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:23.101450 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:23.103406 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a65933-97f6-41cb-870d-108b1c5abad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:23.104311 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a65933-97f6-41cb-870d-108b1c5abad6 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:23.104798 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a65933-97f6-41cb-870d-108b1c5abad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:23.105290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a65933-97f6-41cb-870d-108b1c5abad6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:23.122578 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b410c-764a-48ed-80e7-df8e88cd1c4d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:23.125056 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a65933-97f6-41cb-870d-108b1c5abad6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:23.126728 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a65933-97f6-41cb-870d-108b1c5abad6 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:23.155563 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-f2a65933-97f6-41cb-870d-108b1c5abad6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:23.155563 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:23.155563 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:23.155563 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:23.155563 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:23.155563 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:23.155563 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:23.155563 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:23.155563 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:23.155563 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:23.155563 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:23.155563 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:23.155563 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:23.155563 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:23.155563 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:23.155563 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:23.156726 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:23.156726 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:23.156726 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:23.156726 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:23.156726 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:23.156726 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:23.156726 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:23.156726 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:23.156726 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:23.156726 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:23.156726 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:23.156726 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:23.156726 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:23.156726 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:23.156726 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:23.156726 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:23.156726 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:23.157621 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:23.157621 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:23.157621 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:23.163874 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 357/692] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:03:23.166020 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a65933-97f6-41cb-870d-108b1c5abad6 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:23.169751 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c63c0-02da-4bda-8060-8b44be769bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:23.171685 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c63c0-02da-4bda-8060-8b44be769bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:23.171964 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c63c0-02da-4bda-8060-8b44be769bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:23.172268 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c63c0-02da-4bda-8060-8b44be769bc4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:23.184996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c63c0-02da-4bda-8060-8b44be769bc4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:23.186872 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c63c0-02da-4bda-8060-8b44be769bc4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:23.214903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-219c63c0-02da-4bda-8060-8b44be769bc4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 21:03:23.214903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:23.214903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:23.214903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:23.214903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:23.214903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:23.214903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:23.214903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:23.214903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:23.214903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:23.214903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:23.214903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:23.214903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:03:23.214903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:03:23.214903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:03:23.214903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:03:23.215969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:23.215969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:23.215969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:03:23.215969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:23.215969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:03:23.215969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:23.215969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:23.215969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:23.215969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:23.215969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:23.215969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:23.215969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:23.215969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:23.215969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:23.215969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:23.215969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:23.215969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:23.215969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:23.216965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:23.216965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:23.216965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:03:23.216965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:03:23.216965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:03:23.216965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:03:23.216965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:03:23.216965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:03:23.216965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 21:03:23.216965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:23.226298 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 336/693] 10.222.0.81 () {56 vars in 1093 bytes} [Tue Sep 6 21:03:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:23.234429 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c63c0-02da-4bda-8060-8b44be769bc4 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:23.299893 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:23.375202 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a65933-97f6-41cb-870d-108b1c5abad6 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:23.390842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c63c0-02da-4bda-8060-8b44be769bc4 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:23.429796 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6680ffe-567c-41db-adf4-8f45664384be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:23.430320 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6680ffe-567c-41db-adf4-8f45664384be None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:23.430594 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6680ffe-567c-41db-adf4-8f45664384be None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:23.430859 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6680ffe-567c-41db-adf4-8f45664384be None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:23.431584 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6680ffe-567c-41db-adf4-8f45664384be None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:23.431883 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6680ffe-567c-41db-adf4-8f45664384be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:23.435054 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6680ffe-567c-41db-adf4-8f45664384be None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:23.438216 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:23.451169 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5194e-6a65-441e-b43e-c905e7fb3a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:23.451795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5194e-6a65-441e-b43e-c905e7fb3a55 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:23.452130 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5194e-6a65-441e-b43e-c905e7fb3a55 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:23.452416 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5194e-6a65-441e-b43e-c905e7fb3a55 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:23.453072 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5194e-6a65-441e-b43e-c905e7fb3a55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:23.453373 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5194e-6a65-441e-b43e-c905e7fb3a55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:23.454751 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5194e-6a65-441e-b43e-c905e7fb3a55 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:23.475772 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 337/694] 10.222.0.81 () {56 vars in 1133 bytes} [Tue Sep 6 21:03:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:23.482814 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6680ffe-567c-41db-adf4-8f45664384be None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:23.488985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 358/695] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:23.500861 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5194e-6a65-441e-b43e-c905e7fb3a55 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:23.679973 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5194e-6a65-441e-b43e-c905e7fb3a55 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:23.683396 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6680ffe-567c-41db-adf4-8f45664384be None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:23.707024 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:23.720182 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425aacef-3a25-456a-b9a9-f9b81ad86d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:23.723854 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425aacef-3a25-456a-b9a9-f9b81ad86d2a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:23.723854 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425aacef-3a25-456a-b9a9-f9b81ad86d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:23.723854 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425aacef-3a25-456a-b9a9-f9b81ad86d2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:23.724306 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423b6a2-1eec-4f15-b15c-18ece1785d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:23.724306 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423b6a2-1eec-4f15-b15c-18ece1785d95 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:23.724306 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423b6a2-1eec-4f15-b15c-18ece1785d95 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:23.724306 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423b6a2-1eec-4f15-b15c-18ece1785d95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:23.729585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425aacef-3a25-456a-b9a9-f9b81ad86d2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:23.731043 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425aacef-3a25-456a-b9a9-f9b81ad86d2a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:23.744438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-425aacef-3a25-456a-b9a9-f9b81ad86d2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:23.744438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:23.744438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:23.744438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:23.744438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:23.744438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:23.744438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:23.744438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:23.744438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:23.744438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:23.744438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:23.744438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:23.744438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:03:23.744438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:03:23.744438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:03:23.746628 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:03:23.746628 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:23.746628 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:23.746628 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:23.746628 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:23.746628 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:23.746628 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:23.746628 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:23.746628 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:23.746628 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:23.746628 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:23.746628 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:23.746628 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:23.746628 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:23.746628 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:23.746628 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:23.746628 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:23.748876 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:03:23.748876 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:03:23.748876 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:03:23.748876 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:03:23.748876 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:03:23.748876 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:03:23.748876 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:23.748876 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:23.748876 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 359/696] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:03:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:03:23.748876 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cae1d-6757-4aa6-a60e-c7d99161f0fd None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:23.755636 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cae1d-6757-4aa6-a60e-c7d99161f0fd None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:23.755636 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779cae1d-6757-4aa6-a60e-c7d99161f0fd None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:23.755636 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 360/697] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:23.756586 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cae1d-6757-4aa6-a60e-c7d99161f0fd None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:23.789846 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:23.804633 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423b6a2-1eec-4f15-b15c-18ece1785d95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:23.806239 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423b6a2-1eec-4f15-b15c-18ece1785d95 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:23.879364 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779cae1d-6757-4aa6-a60e-c7d99161f0fd None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:23.919879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 338/698] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:03:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 21:03:23.921229 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d186c-a079-45b1-9df2-3c58e2f1a63c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:23.921516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d186c-a079-45b1-9df2-3c58e2f1a63c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:23.921793 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d186c-a079-45b1-9df2-3c58e2f1a63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:23.925147 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade0cd5-7953-40b0-af7b-aa8f321d1414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:23.925783 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade0cd5-7953-40b0-af7b-aa8f321d1414 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:23.926067 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade0cd5-7953-40b0-af7b-aa8f321d1414 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:23.926336 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade0cd5-7953-40b0-af7b-aa8f321d1414 None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:23.927048 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade0cd5-7953-40b0-af7b-aa8f321d1414 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:23.927356 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade0cd5-7953-40b0-af7b-aa8f321d1414 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:23.929212 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade0cd5-7953-40b0-af7b-aa8f321d1414 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:23.941843 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-197d186c-a079-45b1-9df2-3c58e2f1a63c None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:23.942979 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-197d186c-a079-45b1-9df2-3c58e2f1a63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:23.947204 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 361/699] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:03:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:23.948230 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade0cd5-7953-40b0-af7b-aa8f321d1414 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:24.004067 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:24.024057 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 339/700] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:03:24.025040 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d186c-a079-45b1-9df2-3c58e2f1a63c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:24.060680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:24.074443 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade0cd5-7953-40b0-af7b-aa8f321d1414 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:24.120536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b5aaa-f30b-4cb4-80c6-266cbabb4135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:24.121216 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b5aaa-f30b-4cb4-80c6-266cbabb4135 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:24.121591 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b5aaa-f30b-4cb4-80c6-266cbabb4135 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:24.121868 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b5aaa-f30b-4cb4-80c6-266cbabb4135 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:24.133858 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b5aaa-f30b-4cb4-80c6-266cbabb4135 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:24.135437 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b5aaa-f30b-4cb4-80c6-266cbabb4135 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:24.153015 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-cf8b5aaa-f30b-4cb4-80c6-266cbabb4135 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:24.153015 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:24.153015 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:24.153015 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:24.153015 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:24.153015 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:24.153015 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:24.153015 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:24.153015 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:24.153015 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:24.153015 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:24.153015 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:24.153015 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:24.153015 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:24.153015 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:24.153015 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:24.155259 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:24.155259 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:24.155259 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:24.155259 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:24.155259 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:24.155259 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:24.155259 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:24.155259 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:24.155259 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:24.155259 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:24.155259 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:24.155259 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:24.155259 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:24.155259 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:24.155259 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:24.155259 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:24.155259 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:24.157574 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:24.157574 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:24.157574 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:24.157574 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 362/701] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:24.164135 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b5aaa-f30b-4cb4-80c6-266cbabb4135 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:24.200425 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d186c-a079-45b1-9df2-3c58e2f1a63c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:24.238269 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c6440-49f4-41ab-a6c5-d3429f30c90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:24.238941 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c6440-49f4-41ab-a6c5-d3429f30c90d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:24.239226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c6440-49f4-41ab-a6c5-d3429f30c90d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:24.239501 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c6440-49f4-41ab-a6c5-d3429f30c90d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:24.240315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c6440-49f4-41ab-a6c5-d3429f30c90d None admin] RBAC: Adding query filter params (role.id=747c70d4cefb4a82816c17da1259b90f, scope.project.id=002e09339d4e49ce98434571d3b64248, user.id=cf0aac45d8b549afafae0a3f623bce46) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:24.240624 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c6440-49f4-41ab-a6c5-d3429f30c90d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:24.246005 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c6440-49f4-41ab-a6c5-d3429f30c90d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:24.254971 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 340/702] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:03:24 2022] GET /identity/v3/role_assignments?user.id=cf0aac45d8b549afafae0a3f623bce46&scope.project.id=002e09339d4e49ce98434571d3b64248&role.id=747c70d4cefb4a82816c17da1259b90f => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:24.256265 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2cb2c-db24-4715-90e3-489069795eb4 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:24.256553 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2cb2c-db24-4715-90e3-489069795eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:24.256828 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a2cb2c-db24-4715-90e3-489069795eb4 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:24.258867 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 341/703] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:24.265966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8501a68-06c8-409d-b177-a0979e02ef70 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:24.265966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8501a68-06c8-409d-b177-a0979e02ef70 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:24.272802 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8501a68-06c8-409d-b177-a0979e02ef70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:24.290379 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:24.291538 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d8501a68-06c8-409d-b177-a0979e02ef70 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:24.293420 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d8501a68-06c8-409d-b177-a0979e02ef70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:24.308805 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b5aaa-f30b-4cb4-80c6-266cbabb4135 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:24.371948 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6101f1-7b5b-4ed9-8bbf-cf45de400321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:24.372749 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6101f1-7b5b-4ed9-8bbf-cf45de400321 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:24.373129 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6101f1-7b5b-4ed9-8bbf-cf45de400321 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:24.373506 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6101f1-7b5b-4ed9-8bbf-cf45de400321 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:24.374280 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6101f1-7b5b-4ed9-8bbf-cf45de400321 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:24.374719 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6101f1-7b5b-4ed9-8bbf-cf45de400321 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:24.376282 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6101f1-7b5b-4ed9-8bbf-cf45de400321 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:24.391126 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 363/704] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:03:24.398485 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6101f1-7b5b-4ed9-8bbf-cf45de400321 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:24.415089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 342/705] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:03:24.503635 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8501a68-06c8-409d-b177-a0979e02ef70 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:24.527616 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:24.529896 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6101f1-7b5b-4ed9-8bbf-cf45de400321 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:24.583349 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fadf4-f256-468a-b872-e76eaad9df5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:24.584899 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fadf4-f256-468a-b872-e76eaad9df5b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:24.585654 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fadf4-f256-468a-b872-e76eaad9df5b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:24.586108 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5fadf4-f256-468a-b872-e76eaad9df5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:24.596423 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5fadf4-f256-468a-b872-e76eaad9df5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:24.599121 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5fadf4-f256-468a-b872-e76eaad9df5b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:24.614838 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-4c5fadf4-f256-468a-b872-e76eaad9df5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:24.614838 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:24.614838 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:24.614838 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:24.614838 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:24.614838 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:24.614838 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:24.614838 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:24.614838 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:24.614838 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:24.614838 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:24.614838 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:24.614838 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:03:24.614838 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:03:24.614838 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:03:24.615763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:03:24.615763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:24.615763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:24.615763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:24.615763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:24.615763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:24.615763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:24.615763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:24.615763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:24.615763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:24.615763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:24.615763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:24.615763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:24.615763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:24.615763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:24.615763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:24.615763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:24.617266 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:03:24.617266 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:03:24.617266 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:03:24.617266 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:03:24.617266 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:03:24.617266 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:03:24.617266 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:24.617266 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:24.618268 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 364/706] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:03:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:03:24.625233 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fadf4-f256-468a-b872-e76eaad9df5b None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:24.643668 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8501a68-06c8-409d-b177-a0979e02ef70 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:24.648325 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:24.687271 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3c63f-5630-464c-ba7f-e8ee5ac42564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:24.687917 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3c63f-5630-464c-ba7f-e8ee5ac42564 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:24.688238 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3c63f-5630-464c-ba7f-e8ee5ac42564 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:24.689132 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3c63f-5630-464c-ba7f-e8ee5ac42564 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:24.689707 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc3c63f-5630-464c-ba7f-e8ee5ac42564 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:24.691128 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc3c63f-5630-464c-ba7f-e8ee5ac42564 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:24.702474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-9dc3c63f-5630-464c-ba7f-e8ee5ac42564 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 21:03:24.702474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:24.702474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 21:03:24.702474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 21:03:24.702474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 21:03:24.702474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 21:03:24.702474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 21:03:24.702474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:24.702474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 21:03:24.702474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:24.702474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 21:03:24.702474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:24.702474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:24.702474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:24.702474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:24.702474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:24.702474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:24.703516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:24.703516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:24.703516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:24.703516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:24.703516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:24.703516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:24.703516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 21:03:24.703516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 21:03:24.703516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 21:03:24.703516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 21:03:24.703516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:24.703516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:24.703516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:24.703516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:24.703516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:24.703516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:24.704394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:24.704394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:24.704394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:24.704394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:24.704394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:24.704394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:24.704394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:24.704394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:24.704394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:24.704394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:24.704394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 21:03:24.704394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:24.704394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 21:03:24.704394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:24.704394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 343/707] 10.222.0.81 () {56 vars in 1129 bytes} [Tue Sep 6 21:03:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:24.709939 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3c63f-5630-464c-ba7f-e8ee5ac42564 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:24.770527 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5fadf4-f256-468a-b872-e76eaad9df5b None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:24.814170 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed931501-c838-46d4-ae5b-2eddd1d6b725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:24.814983 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed931501-c838-46d4-ae5b-2eddd1d6b725 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:24.815411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed931501-c838-46d4-ae5b-2eddd1d6b725 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:24.815756 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed931501-c838-46d4-ae5b-2eddd1d6b725 None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:24.816548 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed931501-c838-46d4-ae5b-2eddd1d6b725 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:24.816957 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed931501-c838-46d4-ae5b-2eddd1d6b725 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:24.818511 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed931501-c838-46d4-ae5b-2eddd1d6b725 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:24.819325 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:24.832830 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 365/708] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:03:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:24.833774 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed931501-c838-46d4-ae5b-2eddd1d6b725 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:24.843497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3c63f-5630-464c-ba7f-e8ee5ac42564 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:24.883037 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae0eba-7532-4da9-b1d4-0e4786df3b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:24.883802 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae0eba-7532-4da9-b1d4-0e4786df3b4d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:24.884082 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae0eba-7532-4da9-b1d4-0e4786df3b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:24.884382 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae0eba-7532-4da9-b1d4-0e4786df3b4d None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:24.885119 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae0eba-7532-4da9-b1d4-0e4786df3b4d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:24.885429 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae0eba-7532-4da9-b1d4-0e4786df3b4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:24.886806 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae0eba-7532-4da9-b1d4-0e4786df3b4d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:24.896602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 344/709] 10.222.0.81 () {56 vars in 1124 bytes} [Tue Sep 6 21:03:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:24.897511 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae0eba-7532-4da9-b1d4-0e4786df3b4d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:24.918308 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:24.945434 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed931501-c838-46d4-ae5b-2eddd1d6b725 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:24.981364 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa896ca8-e401-4487-906c-aed861cda3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:24.982152 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa896ca8-e401-4487-906c-aed861cda3d1 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:24.982532 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa896ca8-e401-4487-906c-aed861cda3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:24.982900 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa896ca8-e401-4487-906c-aed861cda3d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:24.994132 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa896ca8-e401-4487-906c-aed861cda3d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:24.995785 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa896ca8-e401-4487-906c-aed861cda3d1 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:25.008273 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae0eba-7532-4da9-b1d4-0e4786df3b4d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:25.013135 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-fa896ca8-e401-4487-906c-aed861cda3d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:25.013135 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:25.013135 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:25.013135 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:25.013135 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:25.013135 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:25.013135 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:25.013135 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:25.013135 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:25.013135 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:25.013135 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:25.013135 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:25.013135 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:25.013135 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:25.013135 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:25.013135 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:25.014308 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:25.014308 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:25.014308 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:25.014308 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:25.014308 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:25.014308 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:25.014308 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:25.014308 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:25.014308 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:25.014308 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:25.014308 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:25.014308 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:25.014308 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:25.014308 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:25.014308 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:25.014308 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:25.014308 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:25.016323 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:25.016323 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:25.016323 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:25.016323 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 366/710] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:25.020200 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa896ca8-e401-4487-906c-aed861cda3d1 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:25.051015 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104641c5-b470-4868-a896-bc9a77e98569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:25.051725 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104641c5-b470-4868-a896-bc9a77e98569 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:25.052013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104641c5-b470-4868-a896-bc9a77e98569 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:25.052316 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104641c5-b470-4868-a896-bc9a77e98569 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:25.053109 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104641c5-b470-4868-a896-bc9a77e98569 None admin] RBAC: Adding query filter params (role.id=fe9661f095094dd0931e0b96a1d6ef74, scope.project.id=002e09339d4e49ce98434571d3b64248, user.id=4441d8fea57f401a96fb8cbd2b501059) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:25.053418 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104641c5-b470-4868-a896-bc9a77e98569 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:25.055087 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104641c5-b470-4868-a896-bc9a77e98569 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:25.061267 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 345/711] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:03:24 2022] GET /identity/v3/role_assignments?user.id=4441d8fea57f401a96fb8cbd2b501059&scope.project.id=002e09339d4e49ce98434571d3b64248&role.id=fe9661f095094dd0931e0b96a1d6ef74 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:25.062074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104641c5-b470-4868-a896-bc9a77e98569 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:25.096190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:25.207442 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104641c5-b470-4868-a896-bc9a77e98569 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:25.229629 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa896ca8-e401-4487-906c-aed861cda3d1 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:25.250223 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e23b4-409f-457d-ad89-06f7640c4386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:25.251266 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e23b4-409f-457d-ad89-06f7640c4386 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:25.251768 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e23b4-409f-457d-ad89-06f7640c4386 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:25.252354 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e23b4-409f-457d-ad89-06f7640c4386 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:25.253274 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e23b4-409f-457d-ad89-06f7640c4386 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:25.253866 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e23b4-409f-457d-ad89-06f7640c4386 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:25.255496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e23b4-409f-457d-ad89-06f7640c4386 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:25.285385 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 346/712] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:25.293508 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:25.294786 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e23b4-409f-457d-ad89-06f7640c4386 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:25.315921 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc862c7-0b08-4cea-943c-157e2f725346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:25.315921 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc862c7-0b08-4cea-943c-157e2f725346 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:25.315921 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc862c7-0b08-4cea-943c-157e2f725346 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:25.315921 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc862c7-0b08-4cea-943c-157e2f725346 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:25.316491 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc862c7-0b08-4cea-943c-157e2f725346 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:25.316491 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc862c7-0b08-4cea-943c-157e2f725346 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:25.316491 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc862c7-0b08-4cea-943c-157e2f725346 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:25.325607 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 367/713] 10.222.0.81 () {56 vars in 1124 bytes} [Tue Sep 6 21:03:25 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:25.380185 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:25.391603 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b210e-2689-4d08-bb76-77245935f95d None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:25.391901 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b210e-2689-4d08-bb76-77245935f95d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:25.392181 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b210e-2689-4d08-bb76-77245935f95d None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:25.393685 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 368/714] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:03:25.399658 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73fd4d-4bad-47be-81ae-fa1d0e305f0c None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:25.399966 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73fd4d-4bad-47be-81ae-fa1d0e305f0c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:25.400334 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73fd4d-4bad-47be-81ae-fa1d0e305f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:25.438158 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-7c73fd4d-4bad-47be-81ae-fa1d0e305f0c None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:25.439398 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7c73fd4d-4bad-47be-81ae-fa1d0e305f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:25.443931 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e23b4-409f-457d-ad89-06f7640c4386 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:25.516154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b3d1d-d65d-49a1-8709-c7f93f39c095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:25.516801 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b3d1d-d65d-49a1-8709-c7f93f39c095 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:25.517082 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b3d1d-d65d-49a1-8709-c7f93f39c095 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:25.517352 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541b3d1d-d65d-49a1-8709-c7f93f39c095 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:25.518036 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b3d1d-d65d-49a1-8709-c7f93f39c095 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:25.519544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541b3d1d-d65d-49a1-8709-c7f93f39c095 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:25.566564 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 369/715] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:03:25.627999 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 347/716] 10.222.0.81 () {60 vars in 1132 bytes} [Tue Sep 6 21:03:25 2022] POST /identity/v3/users => generated 254 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:03:25.948945 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73fd4d-4bad-47be-81ae-fa1d0e305f0c None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:26.062128 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73fd4d-4bad-47be-81ae-fa1d0e305f0c None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:26.083878 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:26.099016 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071df976-2817-4a55-9333-8f1f4d3a5309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:26.099684 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071df976-2817-4a55-9333-8f1f4d3a5309 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:26.099964 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071df976-2817-4a55-9333-8f1f4d3a5309 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:26.100272 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071df976-2817-4a55-9333-8f1f4d3a5309 None admin] PATH_INFO: `/v3/services/network` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:26.102182 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071df976-2817-4a55-9333-8f1f4d3a5309 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:26.103090 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071df976-2817-4a55-9333-8f1f4d3a5309 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:26.114977 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-071df976-2817-4a55-9333-8f1f4d3a5309 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 21:03:26.114977 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:26.114977 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 21:03:26.114977 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 21:03:26.114977 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 21:03:26.114977 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 21:03:26.114977 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 21:03:26.114977 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:26.114977 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 21:03:26.114977 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:26.114977 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 21:03:26.114977 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:26.114977 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:26.114977 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:26.114977 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:26.114977 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:26.114977 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:26.116044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:26.116044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:26.116044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:26.116044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:26.116044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:26.116044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:26.116044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 21:03:26.116044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 21:03:26.116044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 21:03:26.116044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 21:03:26.116044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:26.116044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:26.116044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:26.116044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:26.116044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:26.116044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:26.118164 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:26.118164 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:26.118164 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:26.118164 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:26.118164 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:26.118164 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:26.118164 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:26.118164 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:26.118164 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:26.118164 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:26.118164 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 21:03:26.118164 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:26.118164 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 21:03:26.118164 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:26.118164 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 370/717] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:03:25 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:26.122935 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b3d1d-d65d-49a1-8709-c7f93f39c095 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:26.228914 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541b3d1d-d65d-49a1-8709-c7f93f39c095 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:26.260500 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:26.280934 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbfdaf0-78c3-4e04-bea9-94f50ae0db4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:26.281709 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbfdaf0-78c3-4e04-bea9-94f50ae0db4f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:26.282016 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbfdaf0-78c3-4e04-bea9-94f50ae0db4f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:26.282367 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbfdaf0-78c3-4e04-bea9-94f50ae0db4f None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:26.283018 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbfdaf0-78c3-4e04-bea9-94f50ae0db4f None admin] RBAC: Adding query filter params (name=network) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:26.283319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbfdaf0-78c3-4e04-bea9-94f50ae0db4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:26.284715 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbfdaf0-78c3-4e04-bea9-94f50ae0db4f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:26.290321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 348/718] 10.222.0.81 () {56 vars in 1112 bytes} [Tue Sep 6 21:03:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:26.295804 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071df976-2817-4a55-9333-8f1f4d3a5309 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:26.403784 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071df976-2817-4a55-9333-8f1f4d3a5309 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:26.440732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb7564-ce12-4b59-8101-03e5302da126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:26.441355 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb7564-ce12-4b59-8101-03e5302da126 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:26.441632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb7564-ce12-4b59-8101-03e5302da126 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:26.441902 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb7564-ce12-4b59-8101-03e5302da126 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:26.442533 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb7564-ce12-4b59-8101-03e5302da126 None admin] RBAC: Adding query filter params (type=network) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:26.442833 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb7564-ce12-4b59-8101-03e5302da126 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:26.444245 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb7564-ce12-4b59-8101-03e5302da126 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:26.449420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 371/719] 10.222.0.81 () {56 vars in 1112 bytes} [Tue Sep 6 21:03:26 2022] GET /identity/v3/services?type=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:27.056985 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee2597-c26f-4df8-99f8-449d00b35a8f None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:27.057390 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee2597-c26f-4df8-99f8-449d00b35a8f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:27.057570 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee2597-c26f-4df8-99f8-449d00b35a8f None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:27.059116 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 349/720] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:27.074895 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48874fe-375e-44c8-a446-e09498bd2de2 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:27.075395 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48874fe-375e-44c8-a446-e09498bd2de2 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:27.075473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48874fe-375e-44c8-a446-e09498bd2de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:27.095396 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c48874fe-375e-44c8-a446-e09498bd2de2 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:27.096718 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c48874fe-375e-44c8-a446-e09498bd2de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:27.156376 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:27.184989 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 372/721] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:03:27.555511 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee2597-c26f-4df8-99f8-449d00b35a8f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:27.685030 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebc71d-7dca-45ee-953a-0ffc6460b7f6 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:27.685756 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebc71d-7dca-45ee-953a-0ffc6460b7f6 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:27.686370 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ebc71d-7dca-45ee-953a-0ffc6460b7f6 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:27.687744 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee2597-c26f-4df8-99f8-449d00b35a8f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:27.688639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 373/722] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:27.693532 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514cae4-bf71-443a-9038-6f1bb05ec80a None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:27.694072 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514cae4-bf71-443a-9038-6f1bb05ec80a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:27.694583 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8514cae4-bf71-443a-9038-6f1bb05ec80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:27.722831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90441a3a-77a1-437e-a280-a8a28cdc0394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:27.723469 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90441a3a-77a1-437e-a280-a8a28cdc0394 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:27.723752 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90441a3a-77a1-437e-a280-a8a28cdc0394 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:27.724029 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90441a3a-77a1-437e-a280-a8a28cdc0394 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:27.729039 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-8514cae4-bf71-443a-9038-6f1bb05ec80a None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:27.730455 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8514cae4-bf71-443a-9038-6f1bb05ec80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:27.735329 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90441a3a-77a1-437e-a280-a8a28cdc0394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:03:27.740820 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-90441a3a-77a1-437e-a280-a8a28cdc0394 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:03:27.740820 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:27.740820 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:27.740820 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:27.740820 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:27.740820 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:27.740820 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:27.740820 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:27.740820 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:27.740820 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:27.740820 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:27.740820 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:27.740820 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:03:27.740820 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:03:27.740820 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:03:27.740820 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:03:27.742331 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:03:27.742331 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:03:27.742331 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:03:27.742331 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:03:27.742331 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:27.742331 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:27.742331 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:27.742331 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:27.742331 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:27.742331 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:27.742331 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:27.742331 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:27.742331 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:27.742331 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:27.742331 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:27.742331 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:27.743197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:27.743197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:27.743197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:27.743197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:27.743197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:03:27.743197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:03:27.743197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:03:27.743197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:03:27.743197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:03:27.743197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:03:27.743197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:03:27.743197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:27.743197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 350/723] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:03:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:27.748617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90441a3a-77a1-437e-a280-a8a28cdc0394 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:27.834732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:27.883512 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 374/724] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:03:27.921255 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90441a3a-77a1-437e-a280-a8a28cdc0394 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:27.969000 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785abad0-827a-4103-b89a-3548de4a2698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:27.969609 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785abad0-827a-4103-b89a-3548de4a2698 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:27.969887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785abad0-827a-4103-b89a-3548de4a2698 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:27.970160 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785abad0-827a-4103-b89a-3548de4a2698 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:27.970843 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785abad0-827a-4103-b89a-3548de4a2698 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:27.971229 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785abad0-827a-4103-b89a-3548de4a2698 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:27.972662 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785abad0-827a-4103-b89a-3548de4a2698 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:27.986927 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 351/725] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:03:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:27.993974 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514cae4-bf71-443a-9038-6f1bb05ec80a None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:28.103685 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8514cae4-bf71-443a-9038-6f1bb05ec80a None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:28.113323 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:28.128829 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0b893-09e8-42b7-b7dd-4e635efb396b None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:28.129118 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0b893-09e8-42b7-b7dd-4e635efb396b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:28.129377 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc0b893-09e8-42b7-b7dd-4e635efb396b None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:28.131410 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 352/726] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:28.141243 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664c821-cfde-4ddb-a7bd-8fe2c5a85533 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:28.141796 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664c821-cfde-4ddb-a7bd-8fe2c5a85533 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:28.142191 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664c821-cfde-4ddb-a7bd-8fe2c5a85533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:28.146224 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2cf83-3e57-4b50-bb61-5eba8854fcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:28.147086 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2cf83-3e57-4b50-bb61-5eba8854fcf9 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:28.152480 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2cf83-3e57-4b50-bb61-5eba8854fcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:28.152757 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2cf83-3e57-4b50-bb61-5eba8854fcf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:28.174336 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2cf83-3e57-4b50-bb61-5eba8854fcf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:28.177247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2cf83-3e57-4b50-bb61-5eba8854fcf9 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:28.178429 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-1664c821-cfde-4ddb-a7bd-8fe2c5a85533 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:28.180191 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1664c821-cfde-4ddb-a7bd-8fe2c5a85533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:28.205065 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-81b2cf83-3e57-4b50-bb61-5eba8854fcf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:28.205065 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:28.205065 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:28.205065 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:28.205065 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:28.205065 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:28.205065 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:28.205065 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:28.205065 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:28.205065 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:28.205065 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:28.205065 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:28.205065 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:28.205065 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:28.205065 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:28.205065 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:28.206074 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:28.206074 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:28.206074 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:28.206074 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:28.206074 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:28.206074 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:28.206074 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:28.206074 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:28.206074 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:28.206074 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:28.206074 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:28.206074 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:28.206074 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:28.206074 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:28.206074 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:28.206074 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:28.206074 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:28.206968 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:28.206968 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:28.206968 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:28.209003 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 375/727] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:28.213382 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2cf83-3e57-4b50-bb61-5eba8854fcf9 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:28.289880 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 353/728] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:03:28.290734 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664c821-cfde-4ddb-a7bd-8fe2c5a85533 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:28.338173 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:28.361568 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2cf83-3e57-4b50-bb61-5eba8854fcf9 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:28.400749 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664c821-cfde-4ddb-a7bd-8fe2c5a85533 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:28.424194 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a024e44-52ed-4b17-a2a7-76538f1c1f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:28.424818 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a024e44-52ed-4b17-a2a7-76538f1c1f76 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:28.425102 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a024e44-52ed-4b17-a2a7-76538f1c1f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:28.425380 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a024e44-52ed-4b17-a2a7-76538f1c1f76 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:28.426029 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a024e44-52ed-4b17-a2a7-76538f1c1f76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:28.426455 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a024e44-52ed-4b17-a2a7-76538f1c1f76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:28.427942 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a024e44-52ed-4b17-a2a7-76538f1c1f76 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:28.439141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ef904-1d6b-4390-b91d-7b1f1a5bd297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:28.440072 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ef904-1d6b-4390-b91d-7b1f1a5bd297 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:28.440588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ef904-1d6b-4390-b91d-7b1f1a5bd297 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:28.441053 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ef904-1d6b-4390-b91d-7b1f1a5bd297 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:28.452041 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ef904-1d6b-4390-b91d-7b1f1a5bd297 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:03:28.455558 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 376/729] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:28.457386 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-a99ef904-1d6b-4390-b91d-7b1f1a5bd297 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:03:28.457386 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:28.457386 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:28.457386 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:28.457386 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:28.457386 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:28.457386 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:28.457386 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:28.457386 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:28.457386 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:28.457386 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:28.457386 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:28.457386 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:03:28.457386 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:03:28.457386 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:03:28.457386 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:03:28.458325 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:03:28.458325 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:03:28.458325 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:03:28.458325 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:03:28.458325 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:28.458325 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:28.458325 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:28.458325 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:28.458325 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:28.458325 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:28.458325 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:28.458325 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:28.458325 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:28.458325 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:28.458325 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:28.458325 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:28.459188 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:28.459188 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:28.459188 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:28.459188 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:28.459188 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:03:28.459188 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:03:28.459188 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:03:28.459188 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:03:28.459188 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:03:28.459188 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:03:28.459188 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:03:28.459188 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:28.460970 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a024e44-52ed-4b17-a2a7-76538f1c1f76 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:28.461985 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 354/730] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:03:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:28.467795 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ef904-1d6b-4390-b91d-7b1f1a5bd297 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:28.503721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:28.571807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:28.577757 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ef904-1d6b-4390-b91d-7b1f1a5bd297 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:28.649365 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094d109-2eb7-4590-8874-b471045b8ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:28.650331 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094d109-2eb7-4590-8874-b471045b8ece None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:28.650859 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094d109-2eb7-4590-8874-b471045b8ece None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:28.651335 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9094d109-2eb7-4590-8874-b471045b8ece None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:28.652291 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094d109-2eb7-4590-8874-b471045b8ece None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:28.652802 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094d109-2eb7-4590-8874-b471045b8ece None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:28.655283 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9094d109-2eb7-4590-8874-b471045b8ece None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:28.667446 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a024e44-52ed-4b17-a2a7-76538f1c1f76 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:28.669907 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 355/731] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:03:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:28.670938 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094d109-2eb7-4590-8874-b471045b8ece None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:28.711413 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac94c0a-d9de-445c-b6da-faa0a89035a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:28.712495 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac94c0a-d9de-445c-b6da-faa0a89035a1 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:28.713562 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac94c0a-d9de-445c-b6da-faa0a89035a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:28.714050 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac94c0a-d9de-445c-b6da-faa0a89035a1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:28.724707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac94c0a-d9de-445c-b6da-faa0a89035a1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:28.727841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac94c0a-d9de-445c-b6da-faa0a89035a1 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:28.744709 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-dac94c0a-d9de-445c-b6da-faa0a89035a1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 21:03:28.744709 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:28.744709 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:28.744709 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:28.744709 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:28.744709 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:28.744709 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:28.744709 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:28.744709 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:28.744709 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:28.744709 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:28.744709 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:28.744709 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:03:28.744709 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:03:28.744709 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:03:28.744709 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:03:28.745694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:28.745694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:28.745694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:03:28.745694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:28.745694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:03:28.745694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:28.745694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:28.745694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:28.745694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:28.745694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:28.745694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:28.745694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:28.745694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:28.745694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:28.745694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:28.745694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:28.745694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:28.745694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:28.746675 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:28.746675 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:28.746675 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:03:28.746675 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:03:28.746675 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:03:28.746675 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:03:28.746675 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:03:28.746675 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:03:28.746675 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 21:03:28.746675 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:28.749528 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 377/732] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:03:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:28.754414 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac94c0a-d9de-445c-b6da-faa0a89035a1 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:28.791489 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9094d109-2eb7-4590-8874-b471045b8ece None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:28.837713 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db940f4-bb73-4058-80a8-79e9c6ba0c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:28.838322 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db940f4-bb73-4058-80a8-79e9c6ba0c1f None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:28.838603 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db940f4-bb73-4058-80a8-79e9c6ba0c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:28.838873 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db940f4-bb73-4058-80a8-79e9c6ba0c1f None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:28.839519 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db940f4-bb73-4058-80a8-79e9c6ba0c1f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:28.841140 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db940f4-bb73-4058-80a8-79e9c6ba0c1f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:28.850403 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:28.873215 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac94c0a-d9de-445c-b6da-faa0a89035a1 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:28.911919 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc481e4-e02f-4be5-ae0c-56e31ecd6e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:28.912520 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc481e4-e02f-4be5-ae0c-56e31ecd6e06 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:28.912804 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc481e4-e02f-4be5-ae0c-56e31ecd6e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:28.913079 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc481e4-e02f-4be5-ae0c-56e31ecd6e06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:28.924896 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc481e4-e02f-4be5-ae0c-56e31ecd6e06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:28.926444 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc481e4-e02f-4be5-ae0c-56e31ecd6e06 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:28.940862 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-7bc481e4-e02f-4be5-ae0c-56e31ecd6e06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:28.940862 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:28.940862 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:28.940862 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:28.940862 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:28.940862 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:28.940862 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:28.940862 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:28.940862 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:28.940862 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:28.940862 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:28.940862 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:28.940862 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:28.940862 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:28.940862 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:28.940862 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:28.941864 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:28.941864 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:28.941864 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:28.941864 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:28.941864 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:28.941864 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:28.941864 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:28.941864 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:28.941864 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:28.941864 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:28.941864 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:28.941864 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:28.941864 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:28.941864 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:28.941864 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:28.941864 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:28.941864 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:28.942776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:28.942776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:28.942776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:28.942776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 378/733] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:28.943010 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc481e4-e02f-4be5-ae0c-56e31ecd6e06 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:28.963820 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 356/734] 10.222.0.81 () {60 vars in 1141 bytes} [Tue Sep 6 21:03:28 2022] POST /identity/v3/services => generated 251 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:03:28.965358 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95d9e0-ad53-4065-b06d-ee6edc0c4df4 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:28.965806 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95d9e0-ad53-4065-b06d-ee6edc0c4df4 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:28.966279 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db95d9e0-ad53-4065-b06d-ee6edc0c4df4 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:28.971940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 357/735] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:28.971940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95d9e0-ad53-4065-b06d-ee6edc0c4df4 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:29.002064 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:29.068416 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc481e4-e02f-4be5-ae0c-56e31ecd6e06 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:29.104209 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:29.105933 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db95d9e0-ad53-4065-b06d-ee6edc0c4df4 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:29.110187 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8374346-f39f-4b3a-9e7c-348313ec904c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:29.110819 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8374346-f39f-4b3a-9e7c-348313ec904c None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:29.111104 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8374346-f39f-4b3a-9e7c-348313ec904c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:29.111384 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8374346-f39f-4b3a-9e7c-348313ec904c None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:29.112156 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8374346-f39f-4b3a-9e7c-348313ec904c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:29.112568 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8374346-f39f-4b3a-9e7c-348313ec904c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:29.113942 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8374346-f39f-4b3a-9e7c-348313ec904c None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:29.134001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 379/736] 10.222.0.81 () {56 vars in 1135 bytes} [Tue Sep 6 21:03:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:29.135639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ee852-1046-42f5-af55-f54be3170204 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:29.135818 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ee852-1046-42f5-af55-f54be3170204 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:29.136213 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ee852-1046-42f5-af55-f54be3170204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:29.148894 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001c2e5-6c3e-42fa-9844-20f7d73f65dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:29.149519 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001c2e5-6c3e-42fa-9844-20f7d73f65dc None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:29.149805 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001c2e5-6c3e-42fa-9844-20f7d73f65dc None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:29.150084 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001c2e5-6c3e-42fa-9844-20f7d73f65dc None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:29.150737 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001c2e5-6c3e-42fa-9844-20f7d73f65dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:29.151050 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001c2e5-6c3e-42fa-9844-20f7d73f65dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:29.152453 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001c2e5-6c3e-42fa-9844-20f7d73f65dc None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:29.155219 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-5f6ee852-1046-42f5-af55-f54be3170204 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:29.156437 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5f6ee852-1046-42f5-af55-f54be3170204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:29.168049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 358/737] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:29.169279 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e54554-f674-43d4-825f-dea30de873c2 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:29.169569 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e54554-f674-43d4-825f-dea30de873c2 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:29.169842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e54554-f674-43d4-825f-dea30de873c2 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:29.171635 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 359/738] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:29.172000 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e54554-f674-43d4-825f-dea30de873c2 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:29.236546 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 380/739] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:29 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:03:29.237419 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ee852-1046-42f5-af55-f54be3170204 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:29.272485 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:29.303243 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e54554-f674-43d4-825f-dea30de873c2 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:29.352602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f37e8-c1c1-4882-a871-f4a680e4fdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:29.353228 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f37e8-c1c1-4882-a871-f4a680e4fdcc None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:29.353510 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f37e8-c1c1-4882-a871-f4a680e4fdcc None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:29.353790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f37e8-c1c1-4882-a871-f4a680e4fdcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:29.376314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ee852-1046-42f5-af55-f54be3170204 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:29.399191 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:29.416451 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a679b3-7d3c-4bd4-bbb1-49c7e7a351c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:29.417698 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a679b3-7d3c-4bd4-bbb1-49c7e7a351c8 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:29.418272 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a679b3-7d3c-4bd4-bbb1-49c7e7a351c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:29.418912 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a679b3-7d3c-4bd4-bbb1-49c7e7a351c8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:29.428497 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a679b3-7d3c-4bd4-bbb1-49c7e7a351c8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:29.430844 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a679b3-7d3c-4bd4-bbb1-49c7e7a351c8 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:29.447238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-61a679b3-7d3c-4bd4-bbb1-49c7e7a351c8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 21:03:29.447238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:29.447238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:29.447238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:29.447238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:29.447238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:29.447238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:29.447238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:29.447238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:29.447238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:29.447238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:29.447238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:29.447238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:03:29.447238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:03:29.447238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:03:29.447238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:03:29.448304 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:29.448304 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:29.448304 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:03:29.448304 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:29.448304 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:03:29.448304 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:29.448304 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:29.448304 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:29.448304 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:29.448304 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:29.448304 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:29.448304 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:29.448304 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:29.448304 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:29.448304 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:29.448304 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:29.448304 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:29.448304 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:29.449280 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:29.449280 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:29.449280 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:03:29.449280 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:03:29.449280 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:03:29.449280 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:03:29.449280 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:03:29.449280 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:03:29.449280 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 21:03:29.449280 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:29.449818 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f37e8-c1c1-4882-a871-f4a680e4fdcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:29.449818 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f37e8-c1c1-4882-a871-f4a680e4fdcc None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:29.456206 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 381/740] 10.222.0.81 () {56 vars in 1093 bytes} [Tue Sep 6 21:03:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:29.456206 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d6d5a-f508-4c09-a383-9c0b81b86f9a None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:29.456206 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d6d5a-f508-4c09-a383-9c0b81b86f9a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:29.456206 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d6d5a-f508-4c09-a383-9c0b81b86f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:29.484083 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f26d6d5a-f508-4c09-a383-9c0b81b86f9a None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:29.485472 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f26d6d5a-f508-4c09-a383-9c0b81b86f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:29.547127 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:29.568121 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 382/741] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:29 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 06 21:03:29.568121 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d6d5a-f508-4c09-a383-9c0b81b86f9a None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:29.581726 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 360/742] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:03:29 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 06 21:03:29.583483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f37e8-c1c1-4882-a871-f4a680e4fdcc None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:29.695859 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f37e8-c1c1-4882-a871-f4a680e4fdcc None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:29.709093 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d6d5a-f508-4c09-a383-9c0b81b86f9a None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:29.721096 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:29.739704 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88e040-926f-43e6-bd0b-0af07153e171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:29.740621 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88e040-926f-43e6-bd0b-0af07153e171 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:29.741072 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88e040-926f-43e6-bd0b-0af07153e171 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:29.741708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d88e040-926f-43e6-bd0b-0af07153e171 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:29.746380 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b89e1-c8f9-435b-95ab-8a5ea4f9e4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:29.747220 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b89e1-c8f9-435b-95ab-8a5ea4f9e4cb None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:29.747680 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b89e1-c8f9-435b-95ab-8a5ea4f9e4cb None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:29.748159 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b89e1-c8f9-435b-95ab-8a5ea4f9e4cb None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:29.749061 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b89e1-c8f9-435b-95ab-8a5ea4f9e4cb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:29.749557 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b89e1-c8f9-435b-95ab-8a5ea4f9e4cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:29.751175 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b89e1-c8f9-435b-95ab-8a5ea4f9e4cb None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:29.753808 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d88e040-926f-43e6-bd0b-0af07153e171 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:03:29.760591 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-8d88e040-926f-43e6-bd0b-0af07153e171 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:29.760591 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:29.760591 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:29.760591 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:29.760591 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:29.760591 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:29.760591 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:29.760591 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:29.760591 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:29.760591 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:29.760591 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:29.760591 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:29.760591 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:03:29.760591 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:03:29.760591 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:03:29.760591 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:03:29.761731 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:03:29.761731 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:03:29.761731 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:03:29.761731 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:03:29.761731 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:29.761731 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:29.761731 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:29.761731 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:29.761731 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:29.761731 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:29.761731 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:29.761731 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:29.761731 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:29.761731 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:29.761731 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:29.761731 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:29.762771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:29.762771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:29.762771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:29.762771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:29.762771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:03:29.762771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:03:29.762771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:03:29.762771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:03:29.762771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:03:29.762771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:03:29.762771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:29.762771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:29.767341 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 361/743] 10.222.0.81 () {56 vars in 1102 bytes} [Tue Sep 6 21:03:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:29.767341 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88e040-926f-43e6-bd0b-0af07153e171 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:29.780084 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 383/744] 10.222.0.81 () {56 vars in 1133 bytes} [Tue Sep 6 21:03:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:29.781145 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b89e1-c8f9-435b-95ab-8a5ea4f9e4cb None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:29.817121 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:29.887855 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d88e040-926f-43e6-bd0b-0af07153e171 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:29.901249 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b89e1-c8f9-435b-95ab-8a5ea4f9e4cb None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:29.929718 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0ce07-46a1-480d-ae30-8f63d81e3935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:29.930505 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0ce07-46a1-480d-ae30-8f63d81e3935 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:29.930914 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0ce07-46a1-480d-ae30-8f63d81e3935 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:29.931287 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0ce07-46a1-480d-ae30-8f63d81e3935 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:29.940754 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c26e9-58b1-42b3-9a00-f25be51d7cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:29.941590 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c26e9-58b1-42b3-9a00-f25be51d7cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:29.941870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c26e9-58b1-42b3-9a00-f25be51d7cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:29.942143 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c26e9-58b1-42b3-9a00-f25be51d7cb5 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:29.942814 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c26e9-58b1-42b3-9a00-f25be51d7cb5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:29.943106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c26e9-58b1-42b3-9a00-f25be51d7cb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:29.945018 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c26e9-58b1-42b3-9a00-f25be51d7cb5 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:29.945424 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0ce07-46a1-480d-ae30-8f63d81e3935 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:29.947056 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0ce07-46a1-480d-ae30-8f63d81e3935 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:29.958207 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 384/745] 10.222.0.81 () {56 vars in 1103 bytes} [Tue Sep 6 21:03:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:29.958207 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c26e9-58b1-42b3-9a00-f25be51d7cb5 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:29.967953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-1aa0ce07-46a1-480d-ae30-8f63d81e3935 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:29.967953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:29.967953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:29.967953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:29.967953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:29.967953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:29.967953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:29.967953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:29.967953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:29.967953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:29.967953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:29.967953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:29.967953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:29.967953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:29.967953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:29.967953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:29.969125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:29.969125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:29.969125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:29.969125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:29.969125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:29.969125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:29.969125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:29.969125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:29.969125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:29.969125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:29.969125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:29.969125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:29.969125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:29.969125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:29.969125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:29.969125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:29.969125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:29.970251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:29.970251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:29.970251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:29.970879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 362/746] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:29.971982 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0ce07-46a1-480d-ae30-8f63d81e3935 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:29.993929 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:30.066127 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c26e9-58b1-42b3-9a00-f25be51d7cb5 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:30.069044 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:30.084578 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0ce07-46a1-480d-ae30-8f63d81e3935 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:30.103077 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf96ffd-d079-4b36-8bf8-98f63f408618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:30.103718 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf96ffd-d079-4b36-8bf8-98f63f408618 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:30.104002 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf96ffd-d079-4b36-8bf8-98f63f408618 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:30.104307 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf96ffd-d079-4b36-8bf8-98f63f408618 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:30.114906 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf96ffd-d079-4b36-8bf8-98f63f408618 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:30.117004 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf96ffd-d079-4b36-8bf8-98f63f408618 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:30.126589 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2146983-ca79-49c0-9c9d-dd3a14c8c9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:30.127813 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2146983-ca79-49c0-9c9d-dd3a14c8c9b0 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:30.127813 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2146983-ca79-49c0-9c9d-dd3a14c8c9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:30.128058 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2146983-ca79-49c0-9c9d-dd3a14c8c9b0 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:30.128792 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2146983-ca79-49c0-9c9d-dd3a14c8c9b0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:30.130231 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2146983-ca79-49c0-9c9d-dd3a14c8c9b0 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:30.132635 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-3cf96ffd-d079-4b36-8bf8-98f63f408618 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:30.132635 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:30.132635 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:30.132635 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:30.132635 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:30.132635 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:30.132635 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:30.132635 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:30.132635 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:30.132635 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:30.132635 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:30.132635 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:30.132635 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:30.132635 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:30.132635 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:30.132635 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:30.133786 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:30.133786 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:30.133786 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:30.133786 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:30.133786 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:30.133786 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:30.133786 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:30.133786 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:30.133786 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:30.133786 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:30.133786 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:30.133786 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:30.133786 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:30.133786 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:30.133786 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:30.133786 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:30.133786 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:30.134893 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:30.134893 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:30.134893 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:30.136415 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 385/747] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:30.138010 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf96ffd-d079-4b36-8bf8-98f63f408618 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:30.205751 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 363/748] 10.222.0.81 () {60 vars in 1141 bytes} [Tue Sep 6 21:03:29 2022] POST /identity/v3/services => generated 240 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:03:30.206620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2146983-ca79-49c0-9c9d-dd3a14c8c9b0 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:30.229323 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:30.257794 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf96ffd-d079-4b36-8bf8-98f63f408618 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:30.311351 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d18543-53a7-4eb5-bfc8-210421d5b6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:30.312129 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d18543-53a7-4eb5-bfc8-210421d5b6f0 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:30.312525 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d18543-53a7-4eb5-bfc8-210421d5b6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:30.312925 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d18543-53a7-4eb5-bfc8-210421d5b6f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:30.325693 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d18543-53a7-4eb5-bfc8-210421d5b6f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:30.327348 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d18543-53a7-4eb5-bfc8-210421d5b6f0 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:30.344541 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-80d18543-53a7-4eb5-bfc8-210421d5b6f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:30.344541 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:30.344541 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:30.344541 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:30.344541 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:30.344541 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:30.344541 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:30.344541 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:30.344541 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:30.344541 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:30.344541 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:30.344541 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:30.344541 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:30.344541 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:30.344541 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:30.344541 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:30.345598 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:30.345598 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:30.345598 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:30.345598 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:30.345598 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:30.345598 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:30.345598 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:30.345598 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:30.345598 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:30.345598 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:30.345598 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:30.345598 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:30.345598 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:30.345598 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:30.345598 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:30.345598 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:30.345598 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:30.346556 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:30.346556 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:30.346556 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:30.346556 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 386/749] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:30.347007 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d18543-53a7-4eb5-bfc8-210421d5b6f0 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:30.383008 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2146983-ca79-49c0-9c9d-dd3a14c8c9b0 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:30.429765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6e847-3b24-4494-8a6e-285829e20345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:30.431136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6e847-3b24-4494-8a6e-285829e20345 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:30.431136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6e847-3b24-4494-8a6e-285829e20345 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:30.431136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6e847-3b24-4494-8a6e-285829e20345 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:30.432146 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6e847-3b24-4494-8a6e-285829e20345 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:30.432146 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6e847-3b24-4494-8a6e-285829e20345 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:30.433174 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6e847-3b24-4494-8a6e-285829e20345 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:30.447871 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 364/750] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:30.448666 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6e847-3b24-4494-8a6e-285829e20345 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:30.461226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:30.471246 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d18543-53a7-4eb5-bfc8-210421d5b6f0 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:30.504638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:30.511790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658b185-07a6-4cf8-bd6f-bb74a3a3a6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:30.512987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658b185-07a6-4cf8-bd6f-bb74a3a3a6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:30.513696 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658b185-07a6-4cf8-bd6f-bb74a3a3a6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:30.514123 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658b185-07a6-4cf8-bd6f-bb74a3a3a6e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:30.515136 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658b185-07a6-4cf8-bd6f-bb74a3a3a6e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:30.515874 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658b185-07a6-4cf8-bd6f-bb74a3a3a6e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:30.517699 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658b185-07a6-4cf8-bd6f-bb74a3a3a6e0 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:30.533212 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 387/751] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:30.534736 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658b185-07a6-4cf8-bd6f-bb74a3a3a6e0 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:30.571995 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6e847-3b24-4494-8a6e-285829e20345 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:30.621239 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2a296-77b8-4976-b5cd-509cfbdef569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:30.621922 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2a296-77b8-4976-b5cd-509cfbdef569 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:30.622124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2a296-77b8-4976-b5cd-509cfbdef569 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:30.622402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2a296-77b8-4976-b5cd-509cfbdef569 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:30.623332 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a2a296-77b8-4976-b5cd-509cfbdef569 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:30.623638 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a2a296-77b8-4976-b5cd-509cfbdef569 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:30.625840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a2a296-77b8-4976-b5cd-509cfbdef569 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:30.641257 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 365/752] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:30.642376 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2a296-77b8-4976-b5cd-509cfbdef569 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:30.667829 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658b185-07a6-4cf8-bd6f-bb74a3a3a6e0 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:30.715093 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124cdc1-685a-46a1-88e6-fae086f61ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:30.715978 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124cdc1-685a-46a1-88e6-fae086f61ffd None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:30.716377 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124cdc1-685a-46a1-88e6-fae086f61ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:30.716774 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a124cdc1-685a-46a1-88e6-fae086f61ffd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:30.724516 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a124cdc1-685a-46a1-88e6-fae086f61ffd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:30.726613 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a124cdc1-685a-46a1-88e6-fae086f61ffd None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:30.731993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:30.740056 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-a124cdc1-685a-46a1-88e6-fae086f61ffd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:30.740056 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:30.740056 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:30.740056 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:30.740056 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:30.740056 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:30.740056 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:30.740056 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:30.740056 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:30.740056 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:30.740056 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:30.740056 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:30.740056 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:03:30.740056 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:03:30.740056 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:03:30.741882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:03:30.741882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:30.741882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:30.741882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:30.741882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:30.741882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:30.741882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:30.741882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:30.741882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:30.741882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:30.741882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:30.741882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:30.741882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:30.741882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:30.741882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:30.741882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:30.741882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:30.743016 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:03:30.743016 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:03:30.743016 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:03:30.743016 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:03:30.743016 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:03:30.743016 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:03:30.743016 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:30.743016 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:30.743016 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 388/753] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:03:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:30.743672 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124cdc1-685a-46a1-88e6-fae086f61ffd None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:30.768769 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a2a296-77b8-4976-b5cd-509cfbdef569 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:30.800596 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:30.806169 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696410fc-48da-4193-b2e0-c61fb8d4a5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:30.806818 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696410fc-48da-4193-b2e0-c61fb8d4a5c4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:30.807099 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696410fc-48da-4193-b2e0-c61fb8d4a5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:30.807372 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696410fc-48da-4193-b2e0-c61fb8d4a5c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:30.814838 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696410fc-48da-4193-b2e0-c61fb8d4a5c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:30.816375 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696410fc-48da-4193-b2e0-c61fb8d4a5c4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:30.828562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-696410fc-48da-4193-b2e0-c61fb8d4a5c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:30.828562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:30.828562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:30.828562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:30.828562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:30.828562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:30.828562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:30.828562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:30.828562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:30.828562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:30.828562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:30.828562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:30.828562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:03:30.828562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:03:30.828562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:03:30.829688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:03:30.829688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:30.829688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:30.829688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:30.829688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:30.829688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:30.829688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:30.829688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:30.829688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:30.829688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:30.829688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:30.829688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:30.829688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:30.829688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:30.829688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:30.829688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:30.829688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:30.830782 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:03:30.830782 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:03:30.830782 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:03:30.830782 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:03:30.830782 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:03:30.830782 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:03:30.830782 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:30.830782 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:30.834456 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 366/754] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:03:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:30.835900 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696410fc-48da-4193-b2e0-c61fb8d4a5c4 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:30.864554 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a124cdc1-685a-46a1-88e6-fae086f61ffd None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:30.905352 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e7983-8ee1-482e-8eff-920062a3bf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:30.906305 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e7983-8ee1-482e-8eff-920062a3bf5e None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:30.906837 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e7983-8ee1-482e-8eff-920062a3bf5e None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:30.907261 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e7983-8ee1-482e-8eff-920062a3bf5e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:30.921955 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e7983-8ee1-482e-8eff-920062a3bf5e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:30.924387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e7983-8ee1-482e-8eff-920062a3bf5e None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:30.940773 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-376e7983-8ee1-482e-8eff-920062a3bf5e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 21:03:30.940773 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:30.940773 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:30.940773 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:30.940773 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:30.940773 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:30.940773 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:30.940773 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:30.940773 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:30.940773 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:30.940773 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:30.940773 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:30.940773 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:03:30.940773 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:03:30.940773 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:03:30.940773 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:03:30.942044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:30.942044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:30.942044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:03:30.942044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:30.942044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:03:30.942044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:30.942044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:30.942044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:30.942044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:30.942044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:30.942044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:30.942044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:30.942044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:30.942044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:30.942044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:30.942044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:30.942044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:30.942044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:30.943227 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:30.943227 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:30.943227 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:03:30.943227 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:03:30.943227 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:03:30.943227 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:03:30.943227 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:03:30.943227 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:03:30.943227 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 21:03:30.943227 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:30.946271 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 389/755] 10.222.0.81 () {56 vars in 1117 bytes} [Tue Sep 6 21:03:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:30.947234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e7983-8ee1-482e-8eff-920062a3bf5e None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:30.950025 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696410fc-48da-4193-b2e0-c61fb8d4a5c4 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:30.990642 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:31.002016 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd90ba-72c9-407e-868e-d7a920f61aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:31.005374 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd90ba-72c9-407e-868e-d7a920f61aaf None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:31.005374 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd90ba-72c9-407e-868e-d7a920f61aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:31.005374 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd90ba-72c9-407e-868e-d7a920f61aaf None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:31.005374 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd90ba-72c9-407e-868e-d7a920f61aaf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:31.005830 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd90ba-72c9-407e-868e-d7a920f61aaf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:31.008410 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd90ba-72c9-407e-868e-d7a920f61aaf None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:31.032479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 367/756] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:03:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:31.033897 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd90ba-72c9-407e-868e-d7a920f61aaf None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:31.075383 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e7983-8ee1-482e-8eff-920062a3bf5e None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:31.088650 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:31.128825 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac86f22-859a-48d5-a766-b42c14ea4f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:31.130393 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac86f22-859a-48d5-a766-b42c14ea4f6b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:31.131721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac86f22-859a-48d5-a766-b42c14ea4f6b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:31.132208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac86f22-859a-48d5-a766-b42c14ea4f6b None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:31.133087 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac86f22-859a-48d5-a766-b42c14ea4f6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:31.133562 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac86f22-859a-48d5-a766-b42c14ea4f6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:31.135162 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac86f22-859a-48d5-a766-b42c14ea4f6b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:31.153205 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 390/757] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:03:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:31.154266 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac86f22-859a-48d5-a766-b42c14ea4f6b None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:31.169101 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd90ba-72c9-407e-868e-d7a920f61aaf None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:31.280023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac86f22-859a-48d5-a766-b42c14ea4f6b None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:31.317971 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff334ef2-90d6-4b40-9a6e-6a96a94598b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:31.318580 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff334ef2-90d6-4b40-9a6e-6a96a94598b0 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:31.318862 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff334ef2-90d6-4b40-9a6e-6a96a94598b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:31.319251 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff334ef2-90d6-4b40-9a6e-6a96a94598b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:31.320525 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff334ef2-90d6-4b40-9a6e-6a96a94598b0 None admin] RBAC: Adding query filter params (role.id=fe9661f095094dd0931e0b96a1d6ef74, scope.project.id=002e09339d4e49ce98434571d3b64248, user.id=cf0aac45d8b549afafae0a3f623bce46) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:31.322311 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff334ef2-90d6-4b40-9a6e-6a96a94598b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:31.322311 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff334ef2-90d6-4b40-9a6e-6a96a94598b0 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:31.327667 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 391/758] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:03:31 2022] GET /identity/v3/role_assignments?user.id=cf0aac45d8b549afafae0a3f623bce46&scope.project.id=002e09339d4e49ce98434571d3b64248&role.id=fe9661f095094dd0931e0b96a1d6ef74 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:31.328455 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff334ef2-90d6-4b40-9a6e-6a96a94598b0 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:31.356289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd682310-e190-48f1-bc4e-378301972e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:31.357302 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd682310-e190-48f1-bc4e-378301972e2c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:31.357830 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd682310-e190-48f1-bc4e-378301972e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:31.358399 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd682310-e190-48f1-bc4e-378301972e2c None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:31.359458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd682310-e190-48f1-bc4e-378301972e2c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:31.359951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd682310-e190-48f1-bc4e-378301972e2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:31.361697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd682310-e190-48f1-bc4e-378301972e2c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:31.378709 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:31.384798 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 368/759] 10.222.0.81 () {56 vars in 1149 bytes} [Tue Sep 6 21:03:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:31.386416 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ba9b1-353c-4242-a8ed-16eff637b44b None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:31.386889 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ba9b1-353c-4242-a8ed-16eff637b44b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:31.387392 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ba9b1-353c-4242-a8ed-16eff637b44b None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:31.393344 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 369/760] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:31.402672 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ba9b1-353c-4242-a8ed-16eff637b44b None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:31.453869 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:31.480218 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff334ef2-90d6-4b40-9a6e-6a96a94598b0 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:31.523157 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebcd93b-c265-426a-9886-bd0c15716da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:31.523762 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcd93b-c265-426a-9886-bd0c15716da1 None admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:31.524039 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcd93b-c265-426a-9886-bd0c15716da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:31.524344 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebcd93b-c265-426a-9886-bd0c15716da1 None admin] PATH_INFO: `/v3/projects/002e09339d4e49ce98434571d3b64248/users/4441d8fea57f401a96fb8cbd2b501059/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:31.527243 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebcd93b-c265-426a-9886-bd0c15716da1 None admin] RBAC: Authorizing `identity:create_grant(project_id=002e09339d4e49ce98434571d3b64248, user_id=4441d8fea57f401a96fb8cbd2b501059, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:31.528243 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ba9b1-353c-4242-a8ed-16eff637b44b None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:31.528806 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebcd93b-c265-426a-9886-bd0c15716da1 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:31.566893 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea806049-8acd-4f71-97c8-7ae61e0f4ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:31.567844 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea806049-8acd-4f71-97c8-7ae61e0f4ae2 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:31.568336 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea806049-8acd-4f71-97c8-7ae61e0f4ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:31.568808 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea806049-8acd-4f71-97c8-7ae61e0f4ae2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:31.603315 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 392/761] 10.222.0.81 () {58 vars in 1439 bytes} [Tue Sep 6 21:03:31 2022] PUT /identity/v3/projects/002e09339d4e49ce98434571d3b64248/users/4441d8fea57f401a96fb8cbd2b501059/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:03:31.605246 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f39b1-7b68-4819-9bef-a6781dc2381e None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:31.605608 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f39b1-7b68-4819-9bef-a6781dc2381e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:31.605999 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f39b1-7b68-4819-9bef-a6781dc2381e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:31.642761 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-3b8f39b1-7b68-4819-9bef-a6781dc2381e None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:31.645676 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-3b8f39b1-7b68-4819-9bef-a6781dc2381e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:31.695890 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea806049-8acd-4f71-97c8-7ae61e0f4ae2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:31.698593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea806049-8acd-4f71-97c8-7ae61e0f4ae2 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:31.783275 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:31.815164 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 393/762] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:03:31.851585 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 370/763] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:03:31 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 21:03:31.860122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f39b1-7b68-4819-9bef-a6781dc2381e None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:31.900235 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:32.014513 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f39b1-7b68-4819-9bef-a6781dc2381e None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:32.051142 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a4336-9e8a-4f7b-8ee8-eaa95341ff80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:32.052016 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a4336-9e8a-4f7b-8ee8-eaa95341ff80 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:32.052473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a4336-9e8a-4f7b-8ee8-eaa95341ff80 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:32.052897 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a4336-9e8a-4f7b-8ee8-eaa95341ff80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:32.064645 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a4336-9e8a-4f7b-8ee8-eaa95341ff80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:32.066336 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a4336-9e8a-4f7b-8ee8-eaa95341ff80 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:32.081800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-8e9a4336-9e8a-4f7b-8ee8-eaa95341ff80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:32.081800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:32.081800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:32.081800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:32.081800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:32.081800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:32.081800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:32.081800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:32.081800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:32.081800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:32.081800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:32.081800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:32.081800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:32.081800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:32.081800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:32.081800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:32.082997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:32.082997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:32.082997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:32.082997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:32.082997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:32.082997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:32.082997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:32.082997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:32.082997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:32.082997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:32.082997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:32.082997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:32.082997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:32.082997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:32.082997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:32.082997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:32.082997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:32.084113 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:32.084113 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:32.084113 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:32.085993 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 394/764] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:32.095413 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea806049-8acd-4f71-97c8-7ae61e0f4ae2 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:32.144027 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a4336-9e8a-4f7b-8ee8-eaa95341ff80 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:32.281933 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:32.282431 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea806049-8acd-4f71-97c8-7ae61e0f4ae2 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:32.308284 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a4336-9e8a-4f7b-8ee8-eaa95341ff80 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:32.349613 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b2c7a-aa38-446a-9217-99bca8409824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:32.351479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b2c7a-aa38-446a-9217-99bca8409824 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:32.353924 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b2c7a-aa38-446a-9217-99bca8409824 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:32.354382 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b2c7a-aa38-446a-9217-99bca8409824 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:32.355440 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b2c7a-aa38-446a-9217-99bca8409824 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:32.359385 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b2c7a-aa38-446a-9217-99bca8409824 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:32.365693 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49aa559-0557-4fff-9444-4aac4292ba76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:32.368233 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49aa559-0557-4fff-9444-4aac4292ba76 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:32.369027 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49aa559-0557-4fff-9444-4aac4292ba76 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:32.369811 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49aa559-0557-4fff-9444-4aac4292ba76 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:32.375151 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-038b2c7a-aa38-446a-9217-99bca8409824 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 21:03:32.375151 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:32.375151 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 21:03:32.375151 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 21:03:32.375151 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 21:03:32.375151 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 21:03:32.375151 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 21:03:32.375151 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:32.375151 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 21:03:32.375151 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:32.375151 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 21:03:32.375151 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:32.375151 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:32.375151 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:32.375151 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:32.375151 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:32.375151 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:32.376465 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:32.376465 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:32.376465 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:32.376465 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:32.376465 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:32.376465 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:32.376465 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 21:03:32.376465 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 21:03:32.376465 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 21:03:32.376465 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 21:03:32.376465 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:32.376465 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:32.376465 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:32.376465 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:32.376465 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:32.376465 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:32.377516 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:32.377516 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:32.377516 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:32.377516 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:32.377516 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:32.377516 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:32.377516 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:32.377516 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:32.377516 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:32.377516 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:32.377516 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 21:03:32.377516 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:32.377516 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 21:03:32.377516 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:32.379413 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49aa559-0557-4fff-9444-4aac4292ba76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:32.379878 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49aa559-0557-4fff-9444-4aac4292ba76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:32.381468 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49aa559-0557-4fff-9444-4aac4292ba76 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:32.389919 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 395/765] 10.222.0.81 () {56 vars in 1129 bytes} [Tue Sep 6 21:03:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:03:32.395562 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b2c7a-aa38-446a-9217-99bca8409824 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:32.395809 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 371/766] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:32.405149 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49aa559-0557-4fff-9444-4aac4292ba76 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:32.427758 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:32.539758 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b2c7a-aa38-446a-9217-99bca8409824 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:32.576868 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d655e4-b4c6-4612-8bca-8586a9029501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:32.577417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d655e4-b4c6-4612-8bca-8586a9029501 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:32.577705 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d655e4-b4c6-4612-8bca-8586a9029501 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:32.577988 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d655e4-b4c6-4612-8bca-8586a9029501 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:32.579476 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d655e4-b4c6-4612-8bca-8586a9029501 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:32.579835 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d655e4-b4c6-4612-8bca-8586a9029501 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:32.581392 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d655e4-b4c6-4612-8bca-8586a9029501 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:32.587462 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 396/767] 10.222.0.81 () {56 vars in 1124 bytes} [Tue Sep 6 21:03:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:03:32.592692 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d655e4-b4c6-4612-8bca-8586a9029501 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:32.604267 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:32.662313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49aa559-0557-4fff-9444-4aac4292ba76 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:32.702820 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8247f942-bbb2-4bde-8c65-c7d93c68d36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:32.703578 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247f942-bbb2-4bde-8c65-c7d93c68d36a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:32.704032 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247f942-bbb2-4bde-8c65-c7d93c68d36a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:32.704439 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8247f942-bbb2-4bde-8c65-c7d93c68d36a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:32.717611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8247f942-bbb2-4bde-8c65-c7d93c68d36a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:32.721143 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8247f942-bbb2-4bde-8c65-c7d93c68d36a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:32.734195 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-8247f942-bbb2-4bde-8c65-c7d93c68d36a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:32.734195 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:32.734195 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:32.734195 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:32.734195 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:32.734195 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:32.734195 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:32.734195 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:32.734195 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:32.734195 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:32.734195 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:32.734195 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:32.734195 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:03:32.734195 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:03:32.734195 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:03:32.735097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:03:32.735097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:32.735097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:32.735097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:32.735097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:32.735097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:32.735097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:32.735097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:32.735097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:32.735097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:32.735097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:32.735097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:32.735097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:32.735097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:32.735097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:32.735097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:32.735097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:32.735995 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:03:32.735995 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:03:32.735995 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:03:32.735995 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:03:32.735995 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:03:32.735995 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:03:32.735995 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:32.735995 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:32.738523 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 372/768] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:03:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:32.739991 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279b537-57e1-4e52-9052-52d9d10180b1 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:32.740515 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279b537-57e1-4e52-9052-52d9d10180b1 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:32.740998 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279b537-57e1-4e52-9052-52d9d10180b1 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:32.746970 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 373/769] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:32.747499 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279b537-57e1-4e52-9052-52d9d10180b1 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:32.763001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d655e4-b4c6-4612-8bca-8586a9029501 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:32.808911 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3090db6-473b-4694-a9d5-8bd809e59e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:32.809935 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3090db6-473b-4694-a9d5-8bd809e59e36 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:32.810416 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3090db6-473b-4694-a9d5-8bd809e59e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:32.811330 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3090db6-473b-4694-a9d5-8bd809e59e36 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:32.812346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3090db6-473b-4694-a9d5-8bd809e59e36 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:32.812953 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3090db6-473b-4694-a9d5-8bd809e59e36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:32.815215 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3090db6-473b-4694-a9d5-8bd809e59e36 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:32.827960 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 397/770] 10.222.0.81 () {56 vars in 1124 bytes} [Tue Sep 6 21:03:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:03:32.829129 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:32.830817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529d5df-61f3-4062-9b5e-563bdc9a57e8 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:32.831326 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529d5df-61f3-4062-9b5e-563bdc9a57e8 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:32.832048 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529d5df-61f3-4062-9b5e-563bdc9a57e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:32.856261 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-4529d5df-61f3-4062-9b5e-563bdc9a57e8 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:32.858254 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4529d5df-61f3-4062-9b5e-563bdc9a57e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:32.870093 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279b537-57e1-4e52-9052-52d9d10180b1 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:32.907168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53784f7-9864-49a6-a7b2-f52a79c60721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:32.908131 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53784f7-9864-49a6-a7b2-f52a79c60721 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:32.908611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53784f7-9864-49a6-a7b2-f52a79c60721 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:32.909140 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53784f7-9864-49a6-a7b2-f52a79c60721 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:32.910048 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53784f7-9864-49a6-a7b2-f52a79c60721 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:32.910577 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53784f7-9864-49a6-a7b2-f52a79c60721 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:32.912276 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53784f7-9864-49a6-a7b2-f52a79c60721 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:32.926427 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 374/771] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:03:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:32.927564 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53784f7-9864-49a6-a7b2-f52a79c60721 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:32.934303 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:32.940552 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 398/772] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:03:32.948871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529d5df-61f3-4062-9b5e-563bdc9a57e8 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:33.072545 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53784f7-9864-49a6-a7b2-f52a79c60721 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:33.130915 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:33.141207 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529d5df-61f3-4062-9b5e-563bdc9a57e8 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:33.146491 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c515175-328a-4bfd-8306-e86863a3e4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:33.147109 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c515175-328a-4bfd-8306-e86863a3e4a7 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:33.148083 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c515175-328a-4bfd-8306-e86863a3e4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:33.148271 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c515175-328a-4bfd-8306-e86863a3e4a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:33.148987 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c515175-328a-4bfd-8306-e86863a3e4a7 None admin] RBAC: Adding query filter params (interface=public, service_id=8b3bea06667146f889aff8b68f8f7f93, region_id=RegionOne) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:33.149425 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c515175-328a-4bfd-8306-e86863a3e4a7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:33.156373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c515175-328a-4bfd-8306-e86863a3e4a7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:33.166702 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 375/773] 10.222.0.81 () {56 vars in 1251 bytes} [Tue Sep 6 21:03:32 2022] GET /identity/v3/endpoints?service_id=8b3bea06667146f889aff8b68f8f7f93&interface=public®ion_id=RegionOne => generated 194 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:33.174725 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c515175-328a-4bfd-8306-e86863a3e4a7 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:33.213533 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7fc35-b760-42b4-ab08-9e0aa4daec0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:33.215983 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7fc35-b760-42b4-ab08-9e0aa4daec0f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:33.217001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7fc35-b760-42b4-ab08-9e0aa4daec0f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:33.217472 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c7fc35-b760-42b4-ab08-9e0aa4daec0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:33.218864 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c7fc35-b760-42b4-ab08-9e0aa4daec0f None admin] RBAC: Adding query filter params (role.id=747c70d4cefb4a82816c17da1259b90f, scope.project.id=002e09339d4e49ce98434571d3b64248, user.id=0ba7376671a24d35a920e0ec3290472b) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:33.220241 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c7fc35-b760-42b4-ab08-9e0aa4daec0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:33.222427 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c7fc35-b760-42b4-ab08-9e0aa4daec0f None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:33.233793 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 399/774] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:03:32 2022] GET /identity/v3/role_assignments?user.id=0ba7376671a24d35a920e0ec3290472b&scope.project.id=002e09339d4e49ce98434571d3b64248&role.id=747c70d4cefb4a82816c17da1259b90f => generated 259 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:33.254144 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7fc35-b760-42b4-ab08-9e0aa4daec0f None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:33.407713 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c515175-328a-4bfd-8306-e86863a3e4a7 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:33.447651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcec2f3-dbb1-4e5b-a0c0-0160a92fbaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:33.448561 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcec2f3-dbb1-4e5b-a0c0-0160a92fbaca None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:33.448987 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcec2f3-dbb1-4e5b-a0c0-0160a92fbaca None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:33.449430 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcec2f3-dbb1-4e5b-a0c0-0160a92fbaca None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:33.450202 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcec2f3-dbb1-4e5b-a0c0-0160a92fbaca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:33.451739 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcec2f3-dbb1-4e5b-a0c0-0160a92fbaca None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:33.458437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 376/775] 10.222.0.81 () {56 vars in 1087 bytes} [Tue Sep 6 21:03:33 2022] GET /identity/v3/services => generated 772 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:03:33.522061 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:33.567741 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c7fc35-b760-42b4-ab08-9e0aa4daec0f None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:33.610466 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b78f0-7c32-434c-aa60-75de3f694a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:33.611131 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b78f0-7c32-434c-aa60-75de3f694a0e None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:33.611414 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b78f0-7c32-434c-aa60-75de3f694a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:33.611686 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b78f0-7c32-434c-aa60-75de3f694a0e None admin] PATH_INFO: `/v3/services/network` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:33.612307 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b78f0-7c32-434c-aa60-75de3f694a0e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:33.613782 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b78f0-7c32-434c-aa60-75de3f694a0e None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:33.630061 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-245b78f0-7c32-434c-aa60-75de3f694a0e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 21:03:33.630061 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:33.630061 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 21:03:33.630061 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 21:03:33.630061 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 21:03:33.630061 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 21:03:33.630061 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 21:03:33.630061 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:33.630061 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 21:03:33.630061 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:33.630061 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 21:03:33.630061 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:33.630061 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:33.630061 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:33.630061 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:33.630061 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:33.630061 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:33.631134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:33.631134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:33.631134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:33.631134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:33.631134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:33.631134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:33.631134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 21:03:33.631134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 21:03:33.631134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 21:03:33.631134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 21:03:33.631134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:33.631134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:33.631134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:33.631134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:33.631134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:33.631134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:33.632059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:33.632059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:33.632059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:33.632059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:33.632059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:33.632059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:33.632059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:33.632059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:33.632059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:33.632059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:33.632059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 21:03:33.632059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:33.632059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 21:03:33.632059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:33.636339 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 400/776] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:03:33 2022] GET /identity/v3/services/network => generated 88 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:03:33.637779 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcec2f3-dbb1-4e5b-a0c0-0160a92fbaca None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:33.716952 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:33.763026 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcec2f3-dbb1-4e5b-a0c0-0160a92fbaca None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:33.790989 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c324cb-b6aa-43d4-b4a5-bd122b4121c9 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:33.791276 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c324cb-b6aa-43d4-b4a5-bd122b4121c9 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:33.791551 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c324cb-b6aa-43d4-b4a5-bd122b4121c9 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:33.795678 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 401/777] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:03:33.800479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5acc99-aba1-433e-ba33-91617cf93edb None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:33.800764 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5acc99-aba1-433e-ba33-91617cf93edb None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:33.800870 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9c4c5-288e-4b1d-bf93-4fbfcbf6d2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:33.801070 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5acc99-aba1-433e-ba33-91617cf93edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:33.801482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9c4c5-288e-4b1d-bf93-4fbfcbf6d2e4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:33.801875 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9c4c5-288e-4b1d-bf93-4fbfcbf6d2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:33.802152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9c4c5-288e-4b1d-bf93-4fbfcbf6d2e4 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:33.802775 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9c4c5-288e-4b1d-bf93-4fbfcbf6d2e4 None admin] RBAC: Adding query filter params (name=network) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:33.803075 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9c4c5-288e-4b1d-bf93-4fbfcbf6d2e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:33.805037 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9c4c5-288e-4b1d-bf93-4fbfcbf6d2e4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:33.811524 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 377/778] 10.222.0.81 () {56 vars in 1112 bytes} [Tue Sep 6 21:03:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:33.816979 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9c4c5-288e-4b1d-bf93-4fbfcbf6d2e4 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:33.827676 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-ea5acc99-aba1-433e-ba33-91617cf93edb None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:33.828989 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ea5acc99-aba1-433e-ba33-91617cf93edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:33.940374 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9c4c5-288e-4b1d-bf93-4fbfcbf6d2e4 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:33.949482 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 402/779] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:03:33.978427 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:33.993316 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35354ed4-6b65-4fb9-a302-9b7e6628be87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:33.994177 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35354ed4-6b65-4fb9-a302-9b7e6628be87 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:33.994627 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35354ed4-6b65-4fb9-a302-9b7e6628be87 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:33.995041 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35354ed4-6b65-4fb9-a302-9b7e6628be87 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:33.996231 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35354ed4-6b65-4fb9-a302-9b7e6628be87 None admin] RBAC: Adding query filter params (type=network) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:33.996980 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35354ed4-6b65-4fb9-a302-9b7e6628be87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:33.999395 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35354ed4-6b65-4fb9-a302-9b7e6628be87 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:34.008174 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 378/780] 10.222.0.81 () {56 vars in 1112 bytes} [Tue Sep 6 21:03:33 2022] GET /identity/v3/services?type=network => generated 350 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:03:34.013782 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5acc99-aba1-433e-ba33-91617cf93edb None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:34.091273 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:34.136587 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5acc99-aba1-433e-ba33-91617cf93edb None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:34.174941 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a7580-d093-494d-9dbf-011c620431d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:34.175557 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a7580-d093-494d-9dbf-011c620431d5 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:34.175835 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a7580-d093-494d-9dbf-011c620431d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:34.176125 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a7580-d093-494d-9dbf-011c620431d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:34.176839 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a7580-d093-494d-9dbf-011c620431d5 None admin] RBAC: Adding query filter params (interface=public, service_id=12b1e01a08234f8bbf7268478be41f67, region_id=RegionOne) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:34.177142 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a7580-d093-494d-9dbf-011c620431d5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:34.178502 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83a7580-d093-494d-9dbf-011c620431d5 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:34.187913 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 403/781] 10.222.0.81 () {56 vars in 1251 bytes} [Tue Sep 6 21:03:34 2022] GET /identity/v3/endpoints?service_id=12b1e01a08234f8bbf7268478be41f67&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:34.193683 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35354ed4-6b65-4fb9-a302-9b7e6628be87 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:34.305361 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350514a5-4761-4d16-8e1a-0ca74bb0aa1d None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:34.306311 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350514a5-4761-4d16-8e1a-0ca74bb0aa1d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:34.306806 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350514a5-4761-4d16-8e1a-0ca74bb0aa1d None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:34.308602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 404/782] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:34.314254 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25819a5e-09d8-43e1-b396-5e0cb0e0d61a None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:34.314987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25819a5e-09d8-43e1-b396-5e0cb0e0d61a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:34.315572 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25819a5e-09d8-43e1-b396-5e0cb0e0d61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:34.332147 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35354ed4-6b65-4fb9-a302-9b7e6628be87 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:34.354736 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-25819a5e-09d8-43e1-b396-5e0cb0e0d61a None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:34.356459 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-25819a5e-09d8-43e1-b396-5e0cb0e0d61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:34.367962 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c527eba-def8-40b4-a972-ebdf9360592f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:34.368609 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c527eba-def8-40b4-a972-ebdf9360592f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:34.368888 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c527eba-def8-40b4-a972-ebdf9360592f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:34.369158 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c527eba-def8-40b4-a972-ebdf9360592f None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:34.370004 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c527eba-def8-40b4-a972-ebdf9360592f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:34.371258 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c527eba-def8-40b4-a972-ebdf9360592f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:34.377289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 379/783] 10.222.0.81 () {56 vars in 1087 bytes} [Tue Sep 6 21:03:34 2022] GET /identity/v3/services => generated 772 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:34.385291 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c527eba-def8-40b4-a972-ebdf9360592f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:34.488490 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 405/784] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 21:03:34.502356 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:34.578064 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c527eba-def8-40b4-a972-ebdf9360592f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:34.618993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40be8a-e8a8-4c9f-8e35-fe3ddf2dc92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:34.620011 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40be8a-e8a8-4c9f-8e35-fe3ddf2dc92f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:34.620536 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40be8a-e8a8-4c9f-8e35-fe3ddf2dc92f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:34.621083 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40be8a-e8a8-4c9f-8e35-fe3ddf2dc92f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:34.633785 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40be8a-e8a8-4c9f-8e35-fe3ddf2dc92f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:03:34.639529 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-ef40be8a-e8a8-4c9f-8e35-fe3ddf2dc92f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:03:34.639529 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:34.639529 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:34.639529 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:34.639529 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:34.639529 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:34.639529 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:34.639529 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:34.639529 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:34.639529 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:34.639529 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:34.639529 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:34.639529 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:03:34.639529 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:03:34.639529 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:03:34.639529 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:03:34.640477 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:03:34.640477 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:03:34.640477 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:03:34.640477 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:03:34.640477 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:34.640477 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:34.640477 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:34.640477 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:34.640477 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:34.640477 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:34.640477 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:34.640477 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:34.640477 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:34.640477 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:34.640477 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:34.640477 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:34.641337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:34.641337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:34.641337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:34.641337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:34.641337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:03:34.641337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:03:34.641337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:03:34.641337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:03:34.641337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:03:34.641337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:03:34.641337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:03:34.641337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:34.644046 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 380/785] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:03:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:34.650011 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25819a5e-09d8-43e1-b396-5e0cb0e0d61a None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:34.713000 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:34.763069 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25819a5e-09d8-43e1-b396-5e0cb0e0d61a None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:34.798547 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff6f2e-6225-4d30-b1bf-d6c55e038d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:34.799314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff6f2e-6225-4d30-b1bf-d6c55e038d5f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:34.799597 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff6f2e-6225-4d30-b1bf-d6c55e038d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:34.799870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ff6f2e-6225-4d30-b1bf-d6c55e038d5f None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:34.800624 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff6f2e-6225-4d30-b1bf-d6c55e038d5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:34.800927 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff6f2e-6225-4d30-b1bf-d6c55e038d5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:34.802417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ff6f2e-6225-4d30-b1bf-d6c55e038d5f None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:34.812688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 406/786] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:03:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:34.818979 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40be8a-e8a8-4c9f-8e35-fe3ddf2dc92f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:34.867568 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff6f2e-6225-4d30-b1bf-d6c55e038d5f None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:34.992126 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ff6f2e-6225-4d30-b1bf-d6c55e038d5f None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:35.001987 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40be8a-e8a8-4c9f-8e35-fe3ddf2dc92f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:35.005796 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:35.018211 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:35.030206 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37380f8a-e692-4d74-b9e9-952dde2b7c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:35.031150 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37380f8a-e692-4d74-b9e9-952dde2b7c1a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:35.031953 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37380f8a-e692-4d74-b9e9-952dde2b7c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:35.033011 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37380f8a-e692-4d74-b9e9-952dde2b7c1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:35.044169 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37380f8a-e692-4d74-b9e9-952dde2b7c1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:03:35.050585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-37380f8a-e692-4d74-b9e9-952dde2b7c1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:03:35.050585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:35.050585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:35.050585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:35.050585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:35.050585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:35.050585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:35.050585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:35.050585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:35.050585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:35.050585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:35.050585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:35.050585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:03:35.050585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:03:35.050585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:03:35.050585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:03:35.051558 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:03:35.051558 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:03:35.051558 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:03:35.051558 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:03:35.051558 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:35.051558 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:35.051558 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:35.051558 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:35.051558 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:35.051558 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:35.051558 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:35.051558 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:35.051558 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:35.051558 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:35.051558 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:35.051558 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:35.052473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:35.052473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:35.052473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:35.052473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:35.052473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:03:35.052473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:03:35.052473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:03:35.052473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:03:35.052473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:03:35.052473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:03:35.052473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:03:35.052473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:35.055171 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 407/787] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:03:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:35.063192 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37380f8a-e692-4d74-b9e9-952dde2b7c1a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:35.073318 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b55bd-157c-43da-801c-e9f4c6140fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:35.074040 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b55bd-157c-43da-801c-e9f4c6140fdf None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:35.074391 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b55bd-157c-43da-801c-e9f4c6140fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:35.074729 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7b55bd-157c-43da-801c-e9f4c6140fdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:35.088699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b55bd-157c-43da-801c-e9f4c6140fdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:35.090385 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7b55bd-157c-43da-801c-e9f4c6140fdf None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:35.105319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-4e7b55bd-157c-43da-801c-e9f4c6140fdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:35.105319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:35.105319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:35.105319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:35.105319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:35.105319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:35.105319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:35.105319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:35.105319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:35.105319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:35.105319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:35.105319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:35.105319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:35.105319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:35.105319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:35.105319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:35.106321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:35.106321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:35.106321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:35.106321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:35.106321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:35.106321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:35.106321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:35.106321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:35.106321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:35.106321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:35.106321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:35.106321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:35.106321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:35.106321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:35.106321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:35.106321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:35.106321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:35.107551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:35.107551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:35.107551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:35.107551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 381/788] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:35.112672 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b55bd-157c-43da-801c-e9f4c6140fdf None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:35.223801 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7b55bd-157c-43da-801c-e9f4c6140fdf None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:35.269621 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3cc44-f05e-4c9c-b807-9988d060380b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:35.269760 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3cc44-f05e-4c9c-b807-9988d060380b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:35.269998 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3cc44-f05e-4c9c-b807-9988d060380b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:35.272130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3cc44-f05e-4c9c-b807-9988d060380b None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:35.272130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3cc44-f05e-4c9c-b807-9988d060380b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:35.272130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3cc44-f05e-4c9c-b807-9988d060380b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:35.273198 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3cc44-f05e-4c9c-b807-9988d060380b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:35.302929 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 382/789] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:35.307698 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3cc44-f05e-4c9c-b807-9988d060380b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:35.323492 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37380f8a-e692-4d74-b9e9-952dde2b7c1a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:35.348385 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:35.399809 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338fd71-2286-4e18-8811-2b921d80eb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:35.400456 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338fd71-2286-4e18-8811-2b921d80eb0e None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:35.400734 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338fd71-2286-4e18-8811-2b921d80eb0e None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:35.401005 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338fd71-2286-4e18-8811-2b921d80eb0e None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:35.401669 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338fd71-2286-4e18-8811-2b921d80eb0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:35.402047 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338fd71-2286-4e18-8811-2b921d80eb0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:35.403422 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338fd71-2286-4e18-8811-2b921d80eb0e None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:35.421965 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 408/790] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:03:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:35.429340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338fd71-2286-4e18-8811-2b921d80eb0e None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:35.452867 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3cc44-f05e-4c9c-b807-9988d060380b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:35.489069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d86645-9ba2-4423-a256-680443f58e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:35.489627 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d86645-9ba2-4423-a256-680443f58e96 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:35.489907 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d86645-9ba2-4423-a256-680443f58e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:35.490181 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d86645-9ba2-4423-a256-680443f58e96 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:35.492166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:35.497967 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d86645-9ba2-4423-a256-680443f58e96 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:35.499401 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d86645-9ba2-4423-a256-680443f58e96 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:35.511943 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-16d86645-9ba2-4423-a256-680443f58e96 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 21:03:35.511943 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:35.511943 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:35.511943 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:35.511943 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:35.511943 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:35.511943 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:35.511943 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:35.511943 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:35.511943 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:35.511943 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:35.511943 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:35.511943 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:03:35.511943 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:03:35.511943 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:03:35.511943 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:03:35.514252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:35.514252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:35.514252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:03:35.514252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:35.514252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:03:35.514252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:35.514252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:35.514252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:35.514252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:35.514252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:35.514252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:35.514252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:35.514252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:35.514252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:35.514252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:35.514252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:35.514252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:35.514252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:35.516657 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:35.516657 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:35.516657 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:03:35.516657 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:03:35.516657 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:03:35.516657 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:03:35.516657 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:03:35.516657 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:03:35.516657 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 21:03:35.516657 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:35.516657 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 383/791] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:03:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:35.524583 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d86645-9ba2-4423-a256-680443f58e96 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:35.638650 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:35.652820 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d86645-9ba2-4423-a256-680443f58e96 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:35.682150 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338fd71-2286-4e18-8811-2b921d80eb0e None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:35.697873 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3db7f1-a3ba-4a4a-82c6-c7c8bdd213b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:35.698506 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3db7f1-a3ba-4a4a-82c6-c7c8bdd213b0 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:35.698812 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3db7f1-a3ba-4a4a-82c6-c7c8bdd213b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:35.704150 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3db7f1-a3ba-4a4a-82c6-c7c8bdd213b0 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:35.704150 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3db7f1-a3ba-4a4a-82c6-c7c8bdd213b0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:35.704150 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3db7f1-a3ba-4a4a-82c6-c7c8bdd213b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:35.704150 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3db7f1-a3ba-4a4a-82c6-c7c8bdd213b0 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:35.725642 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 384/792] 10.222.0.81 () {56 vars in 1135 bytes} [Tue Sep 6 21:03:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:35.731178 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3db7f1-a3ba-4a4a-82c6-c7c8bdd213b0 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:35.789675 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abf253-57f5-439e-9eb3-a85059d69d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:35.790714 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abf253-57f5-439e-9eb3-a85059d69d7d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:35.791220 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abf253-57f5-439e-9eb3-a85059d69d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:35.791711 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abf253-57f5-439e-9eb3-a85059d69d7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:35.816594 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9abf253-57f5-439e-9eb3-a85059d69d7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:35.818044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9abf253-57f5-439e-9eb3-a85059d69d7d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:35.834139 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-f9abf253-57f5-439e-9eb3-a85059d69d7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:35.834139 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:35.834139 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:35.834139 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:35.834139 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:35.834139 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:35.834139 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:35.834139 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:35.834139 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:35.834139 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:35.834139 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:35.834139 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:35.834139 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:35.834139 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:35.834139 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:35.834139 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:35.835691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:35.835691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:35.835691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:35.835691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:35.835691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:35.835691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:35.835691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:35.835691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:35.835691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:35.835691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:35.835691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:35.835691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:35.835691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:35.835691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:35.835691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:35.835691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:35.835691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:35.837187 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:35.837187 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:35.837187 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:35.837187 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 409/793] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:35.837440 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ea544-d570-40b2-bca7-5a8f9b9e12e0 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:35.839365 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ea544-d570-40b2-bca7-5a8f9b9e12e0 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:35.839365 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ea544-d570-40b2-bca7-5a8f9b9e12e0 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:35.842997 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3db7f1-a3ba-4a4a-82c6-c7c8bdd213b0 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:35.843586 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 410/794] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:35.844382 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849810f-4d88-4afd-afe5-8644ccc74ae0 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:35.844668 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849810f-4d88-4afd-afe5-8644ccc74ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:35.844947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849810f-4d88-4afd-afe5-8644ccc74ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:35.863571 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-a849810f-4d88-4afd-afe5-8644ccc74ae0 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:35.866680 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a849810f-4d88-4afd-afe5-8644ccc74ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:35.889583 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b7a96-40bc-4c1a-9055-edbc55077db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:35.890479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b7a96-40bc-4c1a-9055-edbc55077db2 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:35.891185 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b7a96-40bc-4c1a-9055-edbc55077db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:35.891463 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b7a96-40bc-4c1a-9055-edbc55077db2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:35.905942 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b7a96-40bc-4c1a-9055-edbc55077db2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:35.907394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b7a96-40bc-4c1a-9055-edbc55077db2 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:35.919630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:35.930339 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-7c6b7a96-40bc-4c1a-9055-edbc55077db2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:35.930339 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:35.930339 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:35.930339 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:35.930339 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:35.930339 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:35.930339 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:35.930339 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:35.930339 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:35.930339 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:35.930339 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:35.930339 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:35.930339 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:35.930339 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:35.930339 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:35.930339 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:35.932295 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:35.932295 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:35.932295 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:35.932295 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:35.932295 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:35.932295 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:35.932295 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:35.932295 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:35.932295 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:35.932295 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:35.932295 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:35.932295 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:35.932295 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:35.932295 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:35.932295 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:35.932295 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:35.932295 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:35.933692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:35.933692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:35.933692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:35.933692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 385/795] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:35.937084 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b7a96-40bc-4c1a-9055-edbc55077db2 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:35.949577 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 411/796] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:03:35.950528 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849810f-4d88-4afd-afe5-8644ccc74ae0 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:35.972428 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:36.069324 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849810f-4d88-4afd-afe5-8644ccc74ae0 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:36.127420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb4146-99af-42a6-a2d8-63b1403589dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:36.128032 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb4146-99af-42a6-a2d8-63b1403589dc None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:36.128352 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb4146-99af-42a6-a2d8-63b1403589dc None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:36.128621 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb4146-99af-42a6-a2d8-63b1403589dc None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:36.129262 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb4146-99af-42a6-a2d8-63b1403589dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:36.129440 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b7a96-40bc-4c1a-9055-edbc55077db2 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:36.129600 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb4146-99af-42a6-a2d8-63b1403589dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:36.130913 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb4146-99af-42a6-a2d8-63b1403589dc None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:36.144441 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 412/797] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:36.145790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f45dd0-9f97-49e0-98a6-46d7a1317841 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:36.146075 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f45dd0-9f97-49e0-98a6-46d7a1317841 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:36.146351 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f45dd0-9f97-49e0-98a6-46d7a1317841 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:36.152217 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 413/798] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:36.152982 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f45dd0-9f97-49e0-98a6-46d7a1317841 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:36.178241 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d2667-cfca-411a-b839-daf0cc38e213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:36.179116 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d2667-cfca-411a-b839-daf0cc38e213 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:36.179580 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d2667-cfca-411a-b839-daf0cc38e213 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:36.180297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d2667-cfca-411a-b839-daf0cc38e213 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:36.181268 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d2667-cfca-411a-b839-daf0cc38e213 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:36.181584 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d2667-cfca-411a-b839-daf0cc38e213 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:36.183684 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d2667-cfca-411a-b839-daf0cc38e213 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:36.201183 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 386/799] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:36.205036 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71711b5-91dd-4edb-a37f-c277e08465a8 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:36.205382 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71711b5-91dd-4edb-a37f-c277e08465a8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:36.205658 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71711b5-91dd-4edb-a37f-c277e08465a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:36.226442 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-b71711b5-91dd-4edb-a37f-c277e08465a8 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:36.228368 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b71711b5-91dd-4edb-a37f-c277e08465a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:36.246929 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:36.274791 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f45dd0-9f97-49e0-98a6-46d7a1317841 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:36.303639 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:36.318261 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285fe76-34ec-45d9-8b61-b66f4be0bd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:36.318870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285fe76-34ec-45d9-8b61-b66f4be0bd3a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:36.319170 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285fe76-34ec-45d9-8b61-b66f4be0bd3a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:36.319774 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285fe76-34ec-45d9-8b61-b66f4be0bd3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:36.325347 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 387/800] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:03:36.326639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285fe76-34ec-45d9-8b61-b66f4be0bd3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:36.328287 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285fe76-34ec-45d9-8b61-b66f4be0bd3a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:36.331965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71711b5-91dd-4edb-a37f-c277e08465a8 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:36.341544 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-0285fe76-34ec-45d9-8b61-b66f4be0bd3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:36.341544 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:36.341544 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:36.341544 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:36.341544 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:36.341544 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:36.341544 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:36.341544 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:36.341544 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:36.341544 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:36.341544 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:36.341544 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:36.341544 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:03:36.341544 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:03:36.341544 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:03:36.342438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:03:36.342438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:36.342438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:36.342438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:36.342438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:36.342438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:36.342438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:36.342438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:36.342438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:36.342438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:36.342438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:36.342438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:36.342438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:36.342438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:36.342438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:36.342438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:36.342438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:36.343420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:03:36.343420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:03:36.343420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:03:36.343420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:03:36.343420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:03:36.343420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:03:36.343420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:36.343420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:36.345767 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 414/801] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:03:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:36.346780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285fe76-34ec-45d9-8b61-b66f4be0bd3a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:36.446733 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71711b5-91dd-4edb-a37f-c277e08465a8 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:36.453340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285fe76-34ec-45d9-8b61-b66f4be0bd3a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:36.483104 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6f5bc-0ec8-4de7-ae21-8166072acd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:36.483743 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6f5bc-0ec8-4de7-ae21-8166072acd9a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:36.484023 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6f5bc-0ec8-4de7-ae21-8166072acd9a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:36.484323 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f6f5bc-0ec8-4de7-ae21-8166072acd9a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:36.490568 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0c6dc-6a6f-4500-b692-fefdecb01134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:36.491510 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0c6dc-6a6f-4500-b692-fefdecb01134 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:36.491965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6f5bc-0ec8-4de7-ae21-8166072acd9a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:36.492248 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0c6dc-6a6f-4500-b692-fefdecb01134 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:36.492718 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0c6dc-6a6f-4500-b692-fefdecb01134 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:36.494049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f6f5bc-0ec8-4de7-ae21-8166072acd9a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:36.496075 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:36.507817 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-89f6f5bc-0ec8-4de7-ae21-8166072acd9a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 21:03:36.507817 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:36.507817 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:36.507817 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:36.507817 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:36.507817 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:36.507817 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:36.507817 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:36.507817 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:36.507817 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:36.507817 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:36.507817 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:36.507817 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:03:36.507817 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:03:36.507817 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:03:36.507817 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:03:36.514451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:36.514451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:36.514451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:03:36.514451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:36.514451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:03:36.514451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:36.514451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:36.514451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:36.514451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:36.514451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:36.514451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:36.514451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:36.514451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:36.514451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:36.514451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:36.514451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:36.514451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:36.514451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:36.515404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:36.515404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:36.515404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:03:36.515404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:03:36.515404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:03:36.515404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:03:36.515404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:03:36.515404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:03:36.515404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 21:03:36.515404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:36.515937 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0c6dc-6a6f-4500-b692-fefdecb01134 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:03:36.516012 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 388/802] 10.222.0.81 () {56 vars in 1093 bytes} [Tue Sep 6 21:03:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:36.516012 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6f5bc-0ec8-4de7-ae21-8166072acd9a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:36.518387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-7ff0c6dc-6a6f-4500-b692-fefdecb01134 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:36.518387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:36.518387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:36.518387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:36.518387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:36.518387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:36.518387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:36.518387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:36.518387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:36.518387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:36.518387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:36.518387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:36.518387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:03:36.518387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:03:36.518387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:03:36.518387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:03:36.519311 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:03:36.519311 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:03:36.519311 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:03:36.519311 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:03:36.519311 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:36.519311 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:36.519311 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:36.519311 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:36.519311 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:36.519311 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:36.519311 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:36.519311 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:36.519311 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:36.519311 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:36.519311 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:36.519311 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:36.520190 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:36.520190 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:36.520190 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:36.520190 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:36.520190 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:03:36.520190 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:03:36.520190 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:03:36.520190 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:03:36.520190 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:03:36.520190 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:03:36.520190 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:36.520190 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:36.529184 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 415/803] 10.222.0.81 () {56 vars in 1102 bytes} [Tue Sep 6 21:03:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:36.530337 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0c6dc-6a6f-4500-b692-fefdecb01134 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:36.598851 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:36.638173 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0c6dc-6a6f-4500-b692-fefdecb01134 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:36.680919 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f6f5bc-0ec8-4de7-ae21-8166072acd9a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:36.693088 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123fb80-bee5-4e37-900d-ec493bc2b147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:36.694056 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123fb80-bee5-4e37-900d-ec493bc2b147 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:36.694435 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123fb80-bee5-4e37-900d-ec493bc2b147 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:36.694776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123fb80-bee5-4e37-900d-ec493bc2b147 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:36.695721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f123fb80-bee5-4e37-900d-ec493bc2b147 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:36.696437 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f123fb80-bee5-4e37-900d-ec493bc2b147 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:36.697903 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f123fb80-bee5-4e37-900d-ec493bc2b147 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:36.715570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 416/804] 10.222.0.81 () {56 vars in 1133 bytes} [Tue Sep 6 21:03:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:36.716443 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123fb80-bee5-4e37-900d-ec493bc2b147 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:36.722977 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6a08a-3db0-45fc-a8bd-378d8586ae0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:36.723656 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6a08a-3db0-45fc-a8bd-378d8586ae0d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:36.723935 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6a08a-3db0-45fc-a8bd-378d8586ae0d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:36.724286 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6a08a-3db0-45fc-a8bd-378d8586ae0d None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:36.724989 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6a08a-3db0-45fc-a8bd-378d8586ae0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:36.725301 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6a08a-3db0-45fc-a8bd-378d8586ae0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:36.727840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6a08a-3db0-45fc-a8bd-378d8586ae0d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:36.747266 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 389/805] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:03:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:36.747945 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6a08a-3db0-45fc-a8bd-378d8586ae0d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:36.797008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:36.846089 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123fb80-bee5-4e37-900d-ec493bc2b147 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:36.859705 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:36.862584 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6a08a-3db0-45fc-a8bd-378d8586ae0d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:36.889796 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55446f71-7082-42ce-81b8-96d1fe3480c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:36.890422 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55446f71-7082-42ce-81b8-96d1fe3480c9 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:36.890699 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55446f71-7082-42ce-81b8-96d1fe3480c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:36.890974 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55446f71-7082-42ce-81b8-96d1fe3480c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:36.891637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55446f71-7082-42ce-81b8-96d1fe3480c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:36.891932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55446f71-7082-42ce-81b8-96d1fe3480c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:36.893339 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55446f71-7082-42ce-81b8-96d1fe3480c9 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:36.907503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 417/806] 10.222.0.81 () {56 vars in 1103 bytes} [Tue Sep 6 21:03:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:36.908638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55446f71-7082-42ce-81b8-96d1fe3480c9 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:36.911071 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c113f7e-f141-4d54-b91a-746e24162e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:36.912114 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c113f7e-f141-4d54-b91a-746e24162e4a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:36.912409 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c113f7e-f141-4d54-b91a-746e24162e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:36.914017 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c113f7e-f141-4d54-b91a-746e24162e4a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:36.914669 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c113f7e-f141-4d54-b91a-746e24162e4a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:36.916111 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c113f7e-f141-4d54-b91a-746e24162e4a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:36.929903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-8c113f7e-f141-4d54-b91a-746e24162e4a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 21:03:36.929903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:36.929903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 21:03:36.929903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 21:03:36.929903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 21:03:36.929903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 21:03:36.929903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 21:03:36.929903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:36.929903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 21:03:36.929903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:36.929903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 21:03:36.929903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:36.929903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:36.929903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:36.929903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:36.929903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:36.929903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:36.930993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:36.930993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:36.930993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:36.930993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:36.930993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:36.930993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:36.930993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 21:03:36.930993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 21:03:36.930993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 21:03:36.930993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 21:03:36.930993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:36.930993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:36.930993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:36.930993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:36.930993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:36.930993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:36.931831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:36.931831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:36.931831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:36.931831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:36.931831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:36.931831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:36.931831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:36.931831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:36.931831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:36.931831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:36.931831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 21:03:36.931831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:36.931831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 06 21:03:36.931831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:36.936971 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 390/807] 10.222.0.81 () {56 vars in 1129 bytes} [Tue Sep 6 21:03:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:36.937971 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c113f7e-f141-4d54-b91a-746e24162e4a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:37.022177 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55446f71-7082-42ce-81b8-96d1fe3480c9 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:37.038964 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:37.047220 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c113f7e-f141-4d54-b91a-746e24162e4a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:37.056767 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214a1db-9450-41f9-ba13-ee7c10be1b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:37.057380 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214a1db-9450-41f9-ba13-ee7c10be1b4b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:37.057660 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214a1db-9450-41f9-ba13-ee7c10be1b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:37.057959 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214a1db-9450-41f9-ba13-ee7c10be1b4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:37.081567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da63386-b723-4048-bd34-96ca81701153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:37.082216 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da63386-b723-4048-bd34-96ca81701153 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:37.082492 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da63386-b723-4048-bd34-96ca81701153 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:37.082767 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da63386-b723-4048-bd34-96ca81701153 None admin] PATH_INFO: `/v3/projects/002e09339d4e49ce98434571d3b64248/users/cf0aac45d8b549afafae0a3f623bce46/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:37.084663 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da63386-b723-4048-bd34-96ca81701153 None admin] RBAC: Authorizing `identity:create_grant(project_id=002e09339d4e49ce98434571d3b64248, user_id=cf0aac45d8b549afafae0a3f623bce46, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:37.086123 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da63386-b723-4048-bd34-96ca81701153 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:37.124667 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214a1db-9450-41f9-ba13-ee7c10be1b4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:37.126041 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214a1db-9450-41f9-ba13-ee7c10be1b4b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:37.158371 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 391/808] 10.222.0.81 () {58 vars in 1439 bytes} [Tue Sep 6 21:03:36 2022] PUT /identity/v3/projects/002e09339d4e49ce98434571d3b64248/users/cf0aac45d8b549afafae0a3f623bce46/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:03:37.159438 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da63386-b723-4048-bd34-96ca81701153 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:37.190478 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:37.235080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 418/809] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:03:36 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 21:03:37.236000 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214a1db-9450-41f9-ba13-ee7c10be1b4b None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:37.255815 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:37.292362 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da63386-b723-4048-bd34-96ca81701153 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:37.337259 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239ece8-96a3-4ef9-9ccb-5f4f1b863e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:37.337259 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239ece8-96a3-4ef9-9ccb-5f4f1b863e27 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:37.337259 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239ece8-96a3-4ef9-9ccb-5f4f1b863e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:37.337259 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239ece8-96a3-4ef9-9ccb-5f4f1b863e27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:37.348593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4239ece8-96a3-4ef9-9ccb-5f4f1b863e27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:37.349939 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4239ece8-96a3-4ef9-9ccb-5f4f1b863e27 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:37.354985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214a1db-9450-41f9-ba13-ee7c10be1b4b None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:37.365740 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-4239ece8-96a3-4ef9-9ccb-5f4f1b863e27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:37.365740 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:37.365740 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:37.365740 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:37.365740 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:37.365740 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:37.365740 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:37.365740 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:37.365740 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:37.365740 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:37.365740 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:37.365740 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:37.365740 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:37.365740 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:37.365740 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:37.365740 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:37.367319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:37.367319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:37.367319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:37.367319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:37.367319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:37.367319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:37.367319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:37.367319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:37.367319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:37.367319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:37.367319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:37.367319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:37.367319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:37.367319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:37.367319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:37.367319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:37.367319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:37.368540 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:37.368540 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:37.368540 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:37.368540 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 392/810] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:37.368907 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731eb065-6524-4720-b8f8-1c91a641a067 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:37.369064 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731eb065-6524-4720-b8f8-1c91a641a067 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:37.369341 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731eb065-6524-4720-b8f8-1c91a641a067 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:37.374106 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 393/811] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:37.374106 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731eb065-6524-4720-b8f8-1c91a641a067 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:37.399234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f8d34-93ff-4105-a27f-6f58dfb3094b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:37.399758 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f8d34-93ff-4105-a27f-6f58dfb3094b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:37.400046 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f8d34-93ff-4105-a27f-6f58dfb3094b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:37.400365 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f8d34-93ff-4105-a27f-6f58dfb3094b None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:37.400994 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f8d34-93ff-4105-a27f-6f58dfb3094b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:37.401297 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f8d34-93ff-4105-a27f-6f58dfb3094b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:37.402841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235f8d34-93ff-4105-a27f-6f58dfb3094b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:37.407525 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 419/812] 10.222.0.81 () {56 vars in 1124 bytes} [Tue Sep 6 21:03:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:37.408342 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f8d34-93ff-4105-a27f-6f58dfb3094b None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:37.464301 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:37.488866 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731eb065-6524-4720-b8f8-1c91a641a067 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:37.495266 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:37.515640 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f8d34-93ff-4105-a27f-6f58dfb3094b None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:37.524932 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6428f-1a9e-4393-bf59-bc2484433570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:37.525596 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6428f-1a9e-4393-bf59-bc2484433570 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:37.525876 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6428f-1a9e-4393-bf59-bc2484433570 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:37.526152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6428f-1a9e-4393-bf59-bc2484433570 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:37.537448 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6428f-1a9e-4393-bf59-bc2484433570 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:37.539699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6428f-1a9e-4393-bf59-bc2484433570 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:37.555474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-9ce6428f-1a9e-4393-bf59-bc2484433570 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:37.555474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:37.555474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:37.555474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:37.555474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:37.555474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:37.555474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:37.555474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:37.555474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:37.555474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:37.555474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:37.555474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:37.555474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:37.555474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:37.555474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:37.555474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:37.556497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:37.556497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:37.556497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:37.556497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:37.556497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:37.556497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:37.556497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:37.556497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:37.556497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:37.556497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:37.556497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:37.556497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:37.556497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:37.556497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:37.556497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:37.556497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:37.556497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:37.557608 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:37.557608 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:37.557608 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:37.557608 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 394/813] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:37.558499 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642de9f2-321c-48d4-acbb-866b31163bba None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:37.558767 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642de9f2-321c-48d4-acbb-866b31163bba None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:37.559082 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642de9f2-321c-48d4-acbb-866b31163bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:37.563362 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61824c2e-05a8-473f-bd4a-73292f619f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:37.563996 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61824c2e-05a8-473f-bd4a-73292f619f66 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:37.564310 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61824c2e-05a8-473f-bd4a-73292f619f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:37.564583 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61824c2e-05a8-473f-bd4a-73292f619f66 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:37.565225 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61824c2e-05a8-473f-bd4a-73292f619f66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:37.565531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61824c2e-05a8-473f-bd4a-73292f619f66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:37.567449 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61824c2e-05a8-473f-bd4a-73292f619f66 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:37.577335 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-642de9f2-321c-48d4-acbb-866b31163bba None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:37.578508 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-642de9f2-321c-48d4-acbb-866b31163bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:37.583354 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 420/814] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:37.583354 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61824c2e-05a8-473f-bd4a-73292f619f66 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:37.662837 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 395/815] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:03:37.662837 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642de9f2-321c-48d4-acbb-866b31163bba None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:37.711228 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61824c2e-05a8-473f-bd4a-73292f619f66 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:37.723296 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:37.757996 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946149d-4bc6-4e4f-8f30-6f6f758f82dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:37.758974 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946149d-4bc6-4e4f-8f30-6f6f758f82dc None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:37.759322 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946149d-4bc6-4e4f-8f30-6f6f758f82dc None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:37.759664 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946149d-4bc6-4e4f-8f30-6f6f758f82dc None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:37.760620 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946149d-4bc6-4e4f-8f30-6f6f758f82dc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:37.761413 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946149d-4bc6-4e4f-8f30-6f6f758f82dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:37.763431 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946149d-4bc6-4e4f-8f30-6f6f758f82dc None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:37.766611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642de9f2-321c-48d4-acbb-866b31163bba None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:37.770763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 421/816] 10.222.0.81 () {56 vars in 1124 bytes} [Tue Sep 6 21:03:37 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:37.771692 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946149d-4bc6-4e4f-8f30-6f6f758f82dc None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:37.776580 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:37.804496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8260e17-94c7-41a8-90ab-43cfeb6abd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:37.805108 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8260e17-94c7-41a8-90ab-43cfeb6abd30 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:37.805386 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8260e17-94c7-41a8-90ab-43cfeb6abd30 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:37.805653 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8260e17-94c7-41a8-90ab-43cfeb6abd30 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:37.806347 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8260e17-94c7-41a8-90ab-43cfeb6abd30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:37.806648 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8260e17-94c7-41a8-90ab-43cfeb6abd30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:37.808059 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8260e17-94c7-41a8-90ab-43cfeb6abd30 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:37.820976 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 396/817] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:37.821784 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8260e17-94c7-41a8-90ab-43cfeb6abd30 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:37.922431 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946149d-4bc6-4e4f-8f30-6f6f758f82dc None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:37.938638 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8260e17-94c7-41a8-90ab-43cfeb6abd30 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:37.956192 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:37.965158 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9483742-4293-459d-8de9-f9e4f50fe4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:37.965791 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9483742-4293-459d-8de9-f9e4f50fe4b5 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:37.966068 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9483742-4293-459d-8de9-f9e4f50fe4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:37.966505 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9483742-4293-459d-8de9-f9e4f50fe4b5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:37.974129 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9483742-4293-459d-8de9-f9e4f50fe4b5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:37.974270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64744f90-aa95-4850-b5ed-fac1220cb607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:37.974820 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64744f90-aa95-4850-b5ed-fac1220cb607 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:37.977063 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64744f90-aa95-4850-b5ed-fac1220cb607 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:37.977063 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64744f90-aa95-4850-b5ed-fac1220cb607 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:37.977237 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9483742-4293-459d-8de9-f9e4f50fe4b5 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:37.977311 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64744f90-aa95-4850-b5ed-fac1220cb607 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:37.977940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64744f90-aa95-4850-b5ed-fac1220cb607 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:37.987732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-d9483742-4293-459d-8de9-f9e4f50fe4b5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 21:03:37.987732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:37.987732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:37.987732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:37.987732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:37.987732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:37.987732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:37.987732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:37.987732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:37.987732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:37.987732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:37.987732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:37.987732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:03:37.987732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:03:37.987732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:03:37.987732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:03:37.988721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:37.988721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:37.988721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:03:37.988721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:37.988721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:03:37.988721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:37.988721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:37.988721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:37.988721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:37.988721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:37.988721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:37.988721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:37.988721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:37.988721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:37.988721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:37.988721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:37.988721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:37.988721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:37.989672 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:37.989672 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:37.989672 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:03:37.989672 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:03:37.989672 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:03:37.989672 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:03:37.989672 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:03:37.989672 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:03:37.989672 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 21:03:37.989672 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:37.994261 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 422/818] 10.222.0.81 () {56 vars in 1117 bytes} [Tue Sep 6 21:03:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:37.995244 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9483742-4293-459d-8de9-f9e4f50fe4b5 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:38.059218 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:38.097078 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9483742-4293-459d-8de9-f9e4f50fe4b5 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:38.105796 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 397/819] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:03:37 2022] POST /identity/v3/endpoints => generated 346 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:03:38.106806 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64744f90-aa95-4850-b5ed-fac1220cb607 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:38.159805 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad45ae6-4033-4578-b854-e90cb17a8380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:38.160490 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad45ae6-4033-4578-b854-e90cb17a8380 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:38.160797 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad45ae6-4033-4578-b854-e90cb17a8380 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:38.161154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad45ae6-4033-4578-b854-e90cb17a8380 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:38.170159 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad45ae6-4033-4578-b854-e90cb17a8380 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:38.171938 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad45ae6-4033-4578-b854-e90cb17a8380 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:38.185234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-2ad45ae6-4033-4578-b854-e90cb17a8380 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:38.185234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:38.185234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:38.185234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:38.185234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:38.185234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:38.185234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:38.185234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:38.185234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:38.185234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:38.185234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:38.185234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:38.185234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:03:38.185234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:03:38.185234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:03:38.186482 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:03:38.186482 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:38.186482 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:38.186482 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:38.186482 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:38.186482 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:38.186482 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:38.186482 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:38.186482 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:38.186482 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:38.186482 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:38.186482 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:38.186482 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:38.186482 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:38.186482 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:38.186482 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:38.186482 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:38.187586 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:03:38.187586 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:03:38.187586 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:03:38.187586 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:03:38.187586 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:03:38.187586 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:03:38.187586 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:38.187586 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:38.191373 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 423/820] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:03:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:38.192379 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad45ae6-4033-4578-b854-e90cb17a8380 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:38.280852 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64744f90-aa95-4850-b5ed-fac1220cb607 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:38.335643 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73653343-cd59-4ad5-856b-ca1ff2c18ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:38.337359 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73653343-cd59-4ad5-856b-ca1ff2c18ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:38.337870 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73653343-cd59-4ad5-856b-ca1ff2c18ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:38.338412 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73653343-cd59-4ad5-856b-ca1ff2c18ee5 None admin] PATH_INFO: `/v3/services/network` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:38.338737 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad45ae6-4033-4578-b854-e90cb17a8380 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:38.339441 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73653343-cd59-4ad5-856b-ca1ff2c18ee5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:38.341051 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73653343-cd59-4ad5-856b-ca1ff2c18ee5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:38.351458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-73653343-cd59-4ad5-856b-ca1ff2c18ee5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 21:03:38.351458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:38.351458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 21:03:38.351458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 21:03:38.351458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 21:03:38.351458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 21:03:38.351458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 21:03:38.351458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:38.351458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 21:03:38.351458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:38.351458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 21:03:38.351458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:38.351458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:38.351458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:38.351458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:38.351458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:38.351458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:38.352593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:38.352593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:38.352593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:38.352593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:38.352593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:38.352593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:38.352593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 21:03:38.352593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 21:03:38.352593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 21:03:38.352593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 21:03:38.352593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:38.352593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:38.352593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:38.352593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:38.352593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:38.352593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:38.353517 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:38.353517 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:38.353517 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:38.353517 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:38.353517 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:38.353517 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:38.353517 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:38.353517 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:38.353517 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:38.353517 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:38.353517 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 21:03:38.353517 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:38.353517 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 06 21:03:38.353517 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:38.353517 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 398/821] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:03:38 2022] GET /identity/v3/services/network => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:38.354365 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73653343-cd59-4ad5-856b-ca1ff2c18ee5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:38.371229 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:38.388596 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d82c8-329b-47cf-bd00-0de6b0b89d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:38.389489 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d82c8-329b-47cf-bd00-0de6b0b89d1d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:38.389767 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d82c8-329b-47cf-bd00-0de6b0b89d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:38.390098 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d82c8-329b-47cf-bd00-0de6b0b89d1d None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:38.391043 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d82c8-329b-47cf-bd00-0de6b0b89d1d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:38.391682 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d82c8-329b-47cf-bd00-0de6b0b89d1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:38.393582 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d82c8-329b-47cf-bd00-0de6b0b89d1d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:38.409057 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:38.420193 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 424/822] 10.222.0.81 () {56 vars in 1149 bytes} [Tue Sep 6 21:03:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:38.421139 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d82c8-329b-47cf-bd00-0de6b0b89d1d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:38.483092 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73653343-cd59-4ad5-856b-ca1ff2c18ee5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:38.520637 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55356354-f100-40f1-ba4a-e767ee91890f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:38.521354 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55356354-f100-40f1-ba4a-e767ee91890f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:38.521644 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55356354-f100-40f1-ba4a-e767ee91890f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:38.521916 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55356354-f100-40f1-ba4a-e767ee91890f None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:38.523203 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55356354-f100-40f1-ba4a-e767ee91890f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:38.523514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55356354-f100-40f1-ba4a-e767ee91890f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:38.525215 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55356354-f100-40f1-ba4a-e767ee91890f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:38.527843 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d82c8-329b-47cf-bd00-0de6b0b89d1d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:38.543730 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 399/823] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:03:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:38.544935 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55356354-f100-40f1-ba4a-e767ee91890f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:38.564552 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d933ed-45fe-4f6b-bee6-b5fa8c437761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:38.565364 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d933ed-45fe-4f6b-bee6-b5fa8c437761 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:38.565732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d933ed-45fe-4f6b-bee6-b5fa8c437761 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:38.566157 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d933ed-45fe-4f6b-bee6-b5fa8c437761 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:38.566846 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d933ed-45fe-4f6b-bee6-b5fa8c437761 None admin] RBAC: Adding query filter params (name=network) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:38.567215 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d933ed-45fe-4f6b-bee6-b5fa8c437761 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:38.568666 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d933ed-45fe-4f6b-bee6-b5fa8c437761 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:38.573911 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 425/824] 10.222.0.81 () {56 vars in 1112 bytes} [Tue Sep 6 21:03:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:38.579399 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d933ed-45fe-4f6b-bee6-b5fa8c437761 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:38.625952 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:38.650075 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:38.653716 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55356354-f100-40f1-ba4a-e767ee91890f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:38.693090 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d933ed-45fe-4f6b-bee6-b5fa8c437761 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:38.696864 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010eb3fa-3e6d-4de6-bc18-1d53a033ce88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:38.697709 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010eb3fa-3e6d-4de6-bc18-1d53a033ce88 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:38.698136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010eb3fa-3e6d-4de6-bc18-1d53a033ce88 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:38.698554 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010eb3fa-3e6d-4de6-bc18-1d53a033ce88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:38.712389 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010eb3fa-3e6d-4de6-bc18-1d53a033ce88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:38.714501 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010eb3fa-3e6d-4de6-bc18-1d53a033ce88 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:38.731803 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c830488-7852-401f-9bb6-d360d657efef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:38.732436 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c830488-7852-401f-9bb6-d360d657efef None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:38.732714 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c830488-7852-401f-9bb6-d360d657efef None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:38.732983 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c830488-7852-401f-9bb6-d360d657efef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:38.733758 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c830488-7852-401f-9bb6-d360d657efef None admin] RBAC: Adding query filter params (role.id=fe9661f095094dd0931e0b96a1d6ef74, scope.project.id=002e09339d4e49ce98434571d3b64248, user.id=4441d8fea57f401a96fb8cbd2b501059) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:38.734001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c830488-7852-401f-9bb6-d360d657efef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:38.734913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-010eb3fa-3e6d-4de6-bc18-1d53a033ce88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:38.734913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:38.734913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:38.734913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:38.734913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:38.734913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:38.734913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:38.734913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:38.734913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:38.734913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:38.734913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:38.734913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:38.734913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:38.734913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:38.734913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:38.734913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:38.736013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:38.736013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:38.736013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:38.736013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:38.736013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:38.736013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:38.736013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:38.736013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:38.736013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:38.736013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:38.736013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:38.736013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:38.736013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:38.736013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:38.736013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:38.736013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:38.736013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:38.737401 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:38.737401 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:38.737401 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:38.737571 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c830488-7852-401f-9bb6-d360d657efef None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:38.739769 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 400/825] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:38.740835 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010eb3fa-3e6d-4de6-bc18-1d53a033ce88 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:38.752301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 426/826] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:03:38 2022] GET /identity/v3/role_assignments?user.id=4441d8fea57f401a96fb8cbd2b501059&scope.project.id=002e09339d4e49ce98434571d3b64248&role.id=fe9661f095094dd0931e0b96a1d6ef74 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:38.753263 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c830488-7852-401f-9bb6-d360d657efef None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:38.866431 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010eb3fa-3e6d-4de6-bc18-1d53a033ce88 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:38.909203 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863324b7-d291-4570-ba51-badaac72f0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:38.910077 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863324b7-d291-4570-ba51-badaac72f0da None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:38.910640 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863324b7-d291-4570-ba51-badaac72f0da None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:38.911067 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863324b7-d291-4570-ba51-badaac72f0da None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:38.911851 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863324b7-d291-4570-ba51-badaac72f0da None admin] RBAC: Adding query filter params (type=network) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:38.912353 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863324b7-d291-4570-ba51-badaac72f0da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:38.914187 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863324b7-d291-4570-ba51-badaac72f0da None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:38.921538 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 401/827] 10.222.0.81 () {56 vars in 1112 bytes} [Tue Sep 6 21:03:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:38.927669 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863324b7-d291-4570-ba51-badaac72f0da None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:38.945924 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:38.984655 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c830488-7852-401f-9bb6-d360d657efef None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:38.997081 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:39.045315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863324b7-d291-4570-ba51-badaac72f0da None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:39.066372 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caca77f-f918-4a04-9249-3f91d19b2ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:39.067155 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caca77f-f918-4a04-9249-3f91d19b2ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:39.067365 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caca77f-f918-4a04-9249-3f91d19b2ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:39.067592 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caca77f-f918-4a04-9249-3f91d19b2ff1 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:39.068283 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caca77f-f918-4a04-9249-3f91d19b2ff1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:39.068590 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caca77f-f918-4a04-9249-3f91d19b2ff1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:39.070082 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caca77f-f918-4a04-9249-3f91d19b2ff1 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:39.086350 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f3093-aa02-4cc6-9619-0ddeb1c89928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:39.087316 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f3093-aa02-4cc6-9619-0ddeb1c89928 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:39.087803 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f3093-aa02-4cc6-9619-0ddeb1c89928 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:39.088301 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f3093-aa02-4cc6-9619-0ddeb1c89928 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:39.089166 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f3093-aa02-4cc6-9619-0ddeb1c89928 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:39.091099 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 427/828] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:39.091641 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f3093-aa02-4cc6-9619-0ddeb1c89928 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:39.099783 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caca77f-f918-4a04-9249-3f91d19b2ff1 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:39.184023 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 402/829] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:03:38 2022] POST /identity/v3/endpoints => generated 337 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:03:39.219871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caca77f-f918-4a04-9249-3f91d19b2ff1 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:39.270788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b6c8cc-96ba-4ba3-a8e7-da8f16009e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:39.271667 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6c8cc-96ba-4ba3-a8e7-da8f16009e21 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:39.272152 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6c8cc-96ba-4ba3-a8e7-da8f16009e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:39.273104 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b6c8cc-96ba-4ba3-a8e7-da8f16009e21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:39.281764 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6c8cc-96ba-4ba3-a8e7-da8f16009e21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:39.283581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b6c8cc-96ba-4ba3-a8e7-da8f16009e21 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:39.297417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-f3b6c8cc-96ba-4ba3-a8e7-da8f16009e21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:39.297417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:39.297417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:39.297417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:39.297417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:39.297417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:39.297417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:39.297417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:39.297417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:39.297417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:39.297417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:39.297417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:39.297417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:03:39.297417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:03:39.297417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:03:39.298638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:03:39.298638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:39.298638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:39.298638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:39.298638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:39.298638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:39.298638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:39.298638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:39.298638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:39.298638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:39.298638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:39.298638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:39.298638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:39.298638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:39.298638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:39.298638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:39.298638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:39.299750 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:03:39.299750 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:03:39.299750 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:03:39.299750 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:03:39.299750 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:03:39.299750 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:03:39.299750 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:39.299750 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:39.301935 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 428/830] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:03:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:39.307832 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f3093-aa02-4cc6-9619-0ddeb1c89928 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:39.384396 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3290771-fe0b-4f6d-9f41-294b76cf27e0 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:39.385846 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3290771-fe0b-4f6d-9f41-294b76cf27e0 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:39.386358 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3290771-fe0b-4f6d-9f41-294b76cf27e0 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:39.388638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 429/831] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:03:39.394095 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa217c-06be-442a-a764-010edbef8f61 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:39.394834 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa217c-06be-442a-a764-010edbef8f61 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:39.395343 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa217c-06be-442a-a764-010edbef8f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:39.428549 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:39.437231 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-0daa217c-06be-442a-a764-010edbef8f61 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:39.438475 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-0daa217c-06be-442a-a764-010edbef8f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:39.455280 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f3093-aa02-4cc6-9619-0ddeb1c89928 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:39.468230 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:39.500661 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb0b3c-2859-44d6-97cc-173996324515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:39.501294 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb0b3c-2859-44d6-97cc-173996324515 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:39.501580 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb0b3c-2859-44d6-97cc-173996324515 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:39.502740 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cb0b3c-2859-44d6-97cc-173996324515 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:39.503475 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb0b3c-2859-44d6-97cc-173996324515 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:39.503787 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb0b3c-2859-44d6-97cc-173996324515 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:39.505266 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cb0b3c-2859-44d6-97cc-173996324515 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:39.523555 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 403/832] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:03:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:39.529659 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb0b3c-2859-44d6-97cc-173996324515 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:39.546607 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 430/833] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:03:39.649543 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cb0b3c-2859-44d6-97cc-173996324515 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:39.683280 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:39.689459 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40daada4-d0d4-43ba-9b6f-921c87c8543f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:39.690156 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40daada4-d0d4-43ba-9b6f-921c87c8543f None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:39.697231 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40daada4-d0d4-43ba-9b6f-921c87c8543f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:39.697231 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40daada4-d0d4-43ba-9b6f-921c87c8543f None admin] PATH_INFO: `/v3/projects/002e09339d4e49ce98434571d3b64248/users/0ba7376671a24d35a920e0ec3290472b/roles/747c70d4cefb4a82816c17da1259b90f` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:39.705366 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40daada4-d0d4-43ba-9b6f-921c87c8543f None admin] RBAC: Authorizing `identity:create_grant(project_id=002e09339d4e49ce98434571d3b64248, user_id=0ba7376671a24d35a920e0ec3290472b, role_id=747c70d4cefb4a82816c17da1259b90f)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:39.706798 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40daada4-d0d4-43ba-9b6f-921c87c8543f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:39.782266 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 404/834] 10.222.0.81 () {58 vars in 1439 bytes} [Tue Sep 6 21:03:39 2022] PUT /identity/v3/projects/002e09339d4e49ce98434571d3b64248/users/0ba7376671a24d35a920e0ec3290472b/roles/747c70d4cefb4a82816c17da1259b90f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:03:39.836515 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa217c-06be-442a-a764-010edbef8f61 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:39.958958 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa217c-06be-442a-a764-010edbef8f61 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:39.998691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b9529-8ff0-4b4d-a219-74ad3fc848b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:39.999702 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b9529-8ff0-4b4d-a219-74ad3fc848b9 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:40.000266 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b9529-8ff0-4b4d-a219-74ad3fc848b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:40.000741 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b9529-8ff0-4b4d-a219-74ad3fc848b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:40.011733 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953b9529-8ff0-4b4d-a219-74ad3fc848b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:03:40.016742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-953b9529-8ff0-4b4d-a219-74ad3fc848b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:03:40.016742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:40.016742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:40.016742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:40.016742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:40.016742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:40.016742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:40.016742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:40.016742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:40.016742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:40.016742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:40.016742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:40.016742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:03:40.016742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:03:40.016742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:03:40.016742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:03:40.017654 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:03:40.017654 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:03:40.017654 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:03:40.017654 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:03:40.017654 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:40.017654 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:40.017654 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:40.017654 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:40.017654 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:40.017654 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:40.017654 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:40.017654 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:40.017654 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:40.017654 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:40.017654 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:40.017654 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:40.018503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:40.018503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:40.018503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:40.018503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:40.018503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:03:40.018503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:03:40.018503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:03:40.018503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:03:40.018503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:03:40.018503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:03:40.018503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:03:40.018503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:40.021127 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 431/835] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:03:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:40.032154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40daada4-d0d4-43ba-9b6f-921c87c8543f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:40.133296 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40daada4-d0d4-43ba-9b6f-921c87c8543f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:40.173349 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025c639-47ff-4bfc-a709-7677ecc2c6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:40.174138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025c639-47ff-4bfc-a709-7677ecc2c6b6 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:40.174416 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025c639-47ff-4bfc-a709-7677ecc2c6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:40.174690 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025c639-47ff-4bfc-a709-7677ecc2c6b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:40.175348 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025c639-47ff-4bfc-a709-7677ecc2c6b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:40.175652 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025c639-47ff-4bfc-a709-7677ecc2c6b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:40.177033 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025c639-47ff-4bfc-a709-7677ecc2c6b6 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:40.185800 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 405/836] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:03:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:40.191288 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b9529-8ff0-4b4d-a219-74ad3fc848b9 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:40.207880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:40.312363 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b9529-8ff0-4b4d-a219-74ad3fc848b9 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:40.349230 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc385704-48ae-45bd-a7e4-117f9ee5ca02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:40.350235 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc385704-48ae-45bd-a7e4-117f9ee5ca02 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:40.350756 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc385704-48ae-45bd-a7e4-117f9ee5ca02 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:40.351254 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc385704-48ae-45bd-a7e4-117f9ee5ca02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:40.362409 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc385704-48ae-45bd-a7e4-117f9ee5ca02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:40.364252 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc385704-48ae-45bd-a7e4-117f9ee5ca02 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:40.379801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-fc385704-48ae-45bd-a7e4-117f9ee5ca02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:40.379801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:40.379801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:40.379801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:40.379801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:40.379801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:40.379801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:40.379801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:40.379801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:40.379801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:40.379801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:40.379801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:40.379801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:40.379801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:40.379801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:40.379801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:40.380833 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:40.380833 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:40.380833 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:40.380833 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:40.380833 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:40.380833 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:40.380833 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:40.380833 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:40.380833 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:40.380833 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:40.380833 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:40.380833 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:40.380833 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:40.380833 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:40.380833 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:40.380833 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:40.380833 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:40.382284 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:40.382284 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:40.382284 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:40.384408 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 432/837] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:40.390464 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025c639-47ff-4bfc-a709-7677ecc2c6b6 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:40.439576 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:40.503863 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025c639-47ff-4bfc-a709-7677ecc2c6b6 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:40.544432 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5927f9-1803-4819-956e-97f7e0728ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:40.545039 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5927f9-1803-4819-956e-97f7e0728ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:40.545315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5927f9-1803-4819-956e-97f7e0728ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:40.545583 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5927f9-1803-4819-956e-97f7e0728ca0 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:40.546220 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5927f9-1803-4819-956e-97f7e0728ca0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:40.546519 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5927f9-1803-4819-956e-97f7e0728ca0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:40.547868 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5927f9-1803-4819-956e-97f7e0728ca0 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:40.561186 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 406/838] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:40.566897 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc385704-48ae-45bd-a7e4-117f9ee5ca02 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:40.588590 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbaa92-dcdd-4bd4-9375-02d774544132 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:40.588910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbaa92-dcdd-4bd4-9375-02d774544132 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:40.589147 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbaa92-dcdd-4bd4-9375-02d774544132 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:40.590732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 407/839] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:03:40.595692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df958ae3-954e-4882-8b91-221843e45319 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:40.595972 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df958ae3-954e-4882-8b91-221843e45319 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:40.596278 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df958ae3-954e-4882-8b91-221843e45319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:40.614907 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-df958ae3-954e-4882-8b91-221843e45319 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:40.616665 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-df958ae3-954e-4882-8b91-221843e45319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:40.637291 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:40.682798 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc385704-48ae-45bd-a7e4-117f9ee5ca02 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:40.700176 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 408/840] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:40 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 21:03:40.717800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486961ba-4179-4f59-af43-37234cadc072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:40.718427 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486961ba-4179-4f59-af43-37234cadc072 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:40.718699 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486961ba-4179-4f59-af43-37234cadc072 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:40.718971 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486961ba-4179-4f59-af43-37234cadc072 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:40.727189 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486961ba-4179-4f59-af43-37234cadc072 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:40.728665 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486961ba-4179-4f59-af43-37234cadc072 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:40.739674 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-486961ba-4179-4f59-af43-37234cadc072 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 06 21:03:40.739674 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:40.739674 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:40.739674 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:40.739674 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:40.739674 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:40.739674 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:40.739674 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:40.739674 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:40.739674 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:40.739674 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:40.739674 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:40.739674 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:03:40.739674 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:03:40.739674 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:03:40.739674 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:03:40.740870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:40.740870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:40.740870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:03:40.740870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:40.740870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:03:40.740870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:40.740870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:40.740870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:40.740870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:40.740870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:40.740870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:40.740870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:40.740870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:40.740870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:40.740870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:40.740870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:40.740870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:40.740870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:40.741991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:40.741991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:40.741991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:03:40.741991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:03:40.741991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:03:40.741991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:03:40.741991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:03:40.741991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:03:40.741991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 06 21:03:40.741991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:40.741991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 433/841] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:03:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:40.749253 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df958ae3-954e-4882-8b91-221843e45319 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:40.784476 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:40.859682 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df958ae3-954e-4882-8b91-221843e45319 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:40.894279 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2e467-86d0-4dd0-9860-5bd94cb8de4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:40.894797 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2e467-86d0-4dd0-9860-5bd94cb8de4d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:40.895080 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2e467-86d0-4dd0-9860-5bd94cb8de4d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:40.895353 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2e467-86d0-4dd0-9860-5bd94cb8de4d None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:40.896075 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2e467-86d0-4dd0-9860-5bd94cb8de4d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:40.896432 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2e467-86d0-4dd0-9860-5bd94cb8de4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:40.898614 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2e467-86d0-4dd0-9860-5bd94cb8de4d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:40.917505 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 409/842] 10.222.0.81 () {56 vars in 1135 bytes} [Tue Sep 6 21:03:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:40.923312 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486961ba-4179-4f59-af43-37234cadc072 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:40.991830 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2e467-86d0-4dd0-9860-5bd94cb8de4d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:41.035348 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486961ba-4179-4f59-af43-37234cadc072 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:41.075039 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f17e4-b434-4298-8f07-60c29e767636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:41.076001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f17e4-b434-4298-8f07-60c29e767636 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:41.076586 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f17e4-b434-4298-8f07-60c29e767636 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:41.077084 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f17e4-b434-4298-8f07-60c29e767636 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:41.080282 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:41.098535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:41.111618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2e467-86d0-4dd0-9860-5bd94cb8de4d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:41.157510 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74749cd9-5333-435e-9474-1cfe53ec996b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:41.158065 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74749cd9-5333-435e-9474-1cfe53ec996b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:41.158343 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74749cd9-5333-435e-9474-1cfe53ec996b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:41.158620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74749cd9-5333-435e-9474-1cfe53ec996b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:41.159204 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74749cd9-5333-435e-9474-1cfe53ec996b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:41.160761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74749cd9-5333-435e-9474-1cfe53ec996b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:41.164380 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f17e4-b434-4298-8f07-60c29e767636 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:41.166405 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f17e4-b434-4298-8f07-60c29e767636 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:41.171393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-74749cd9-5333-435e-9474-1cfe53ec996b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 21:03:41.171393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:41.171393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 21:03:41.171393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 21:03:41.171393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 21:03:41.171393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 21:03:41.171393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 21:03:41.171393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:41.171393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 21:03:41.171393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:41.171393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 21:03:41.171393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:41.171393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:41.171393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:41.171393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:41.171393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:41.171393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:41.172447 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:41.172447 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:41.172447 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:41.172447 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:41.172447 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:41.172447 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:41.172447 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 21:03:41.172447 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 21:03:41.172447 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 21:03:41.172447 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 21:03:41.172447 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:41.172447 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:41.172447 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:41.172447 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:41.172447 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:41.172447 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:41.173308 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:41.173308 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:41.173308 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:41.173308 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:41.173308 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:41.173308 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:41.173308 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:41.173308 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:41.173308 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:41.173308 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:41.173308 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 21:03:41.173308 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:41.173308 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 21:03:41.173308 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:41.177420 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 410/843] 10.222.0.81 () {56 vars in 1114 bytes} [Tue Sep 6 21:03:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:03:41.179239 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74749cd9-5333-435e-9474-1cfe53ec996b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:41.285213 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 434/844] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:03:40 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 21:03:41.291073 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f17e4-b434-4298-8f07-60c29e767636 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:41.307165 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74749cd9-5333-435e-9474-1cfe53ec996b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:41.322657 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:41.355773 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2ba86-421e-425d-ad00-0b5595cab1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:41.357544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2ba86-421e-425d-ad00-0b5595cab1d6 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:41.358059 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2ba86-421e-425d-ad00-0b5595cab1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:41.358861 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2ba86-421e-425d-ad00-0b5595cab1d6 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:41.360184 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2ba86-421e-425d-ad00-0b5595cab1d6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:41.360959 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2ba86-421e-425d-ad00-0b5595cab1d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:41.363312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2ba86-421e-425d-ad00-0b5595cab1d6 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:41.371066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 411/845] 10.222.0.81 () {56 vars in 1114 bytes} [Tue Sep 6 21:03:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:03:41.376587 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2ba86-421e-425d-ad00-0b5595cab1d6 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:41.403891 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:41.408583 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f17e4-b434-4298-8f07-60c29e767636 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:41.452128 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84495c29-802c-430c-9bfe-968d63340a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:41.452772 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84495c29-802c-430c-9bfe-968d63340a49 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:41.453052 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84495c29-802c-430c-9bfe-968d63340a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:41.453368 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84495c29-802c-430c-9bfe-968d63340a49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:41.464754 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84495c29-802c-430c-9bfe-968d63340a49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:41.466208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84495c29-802c-430c-9bfe-968d63340a49 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:41.482424 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-84495c29-802c-430c-9bfe-968d63340a49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:41.482424 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:41.482424 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:41.482424 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:41.482424 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:41.482424 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:41.482424 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:41.482424 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:41.482424 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:41.482424 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:41.482424 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:41.482424 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:41.482424 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:41.482424 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:41.482424 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:41.482424 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:41.483463 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:41.483463 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:41.483463 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:41.483463 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:41.483463 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:41.483463 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:41.483463 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:41.483463 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:41.483463 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:41.483463 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:41.483463 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:41.483463 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:41.483463 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:41.483463 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:41.483463 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:41.483463 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:41.483463 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:41.489334 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:41.489334 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:41.489334 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:41.489334 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 435/846] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:41.489334 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee108b-76af-4868-ad7a-0c65ca5005de None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:41.489334 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee108b-76af-4868-ad7a-0c65ca5005de None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:41.489334 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee108b-76af-4868-ad7a-0c65ca5005de None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:41.489334 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 436/847] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:41.491478 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee108b-76af-4868-ad7a-0c65ca5005de None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:41.499519 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2ba86-421e-425d-ad00-0b5595cab1d6 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:41.533566 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3522d30e-7fce-4d98-96db-de3b92b035b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:41.534178 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522d30e-7fce-4d98-96db-de3b92b035b6 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:41.534457 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522d30e-7fce-4d98-96db-de3b92b035b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:41.534729 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3522d30e-7fce-4d98-96db-de3b92b035b6 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:41.535361 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522d30e-7fce-4d98-96db-de3b92b035b6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:41.535667 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522d30e-7fce-4d98-96db-de3b92b035b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:41.537060 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3522d30e-7fce-4d98-96db-de3b92b035b6 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:41.542218 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 412/848] 10.222.0.81 () {56 vars in 1114 bytes} [Tue Sep 6 21:03:41 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:03:41.543363 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04034803-8ece-4563-b164-386fecc9e2b5 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:41.543640 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04034803-8ece-4563-b164-386fecc9e2b5 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:41.543914 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04034803-8ece-4563-b164-386fecc9e2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:41.563881 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-04034803-8ece-4563-b164-386fecc9e2b5 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:41.565260 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-04034803-8ece-4563-b164-386fecc9e2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:41.591375 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:41.620556 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee108b-76af-4868-ad7a-0c65ca5005de None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:41.664204 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 413/849] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:03:41.668037 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad513de5-07b3-42a5-ad57-40747d9d517a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:41.668758 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad513de5-07b3-42a5-ad57-40747d9d517a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:41.669043 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad513de5-07b3-42a5-ad57-40747d9d517a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:41.669316 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad513de5-07b3-42a5-ad57-40747d9d517a None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:41.669975 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad513de5-07b3-42a5-ad57-40747d9d517a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:41.670277 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad513de5-07b3-42a5-ad57-40747d9d517a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:41.671806 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad513de5-07b3-42a5-ad57-40747d9d517a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:41.685975 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 437/850] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:41.691240 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04034803-8ece-4563-b164-386fecc9e2b5 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:41.716538 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:41.800949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04034803-8ece-4563-b164-386fecc9e2b5 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:41.837599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a59e75-68f4-4ff6-8b3f-f7449c5bf7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:41.838275 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a59e75-68f4-4ff6-8b3f-f7449c5bf7b3 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:41.838564 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a59e75-68f4-4ff6-8b3f-f7449c5bf7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:41.838839 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a59e75-68f4-4ff6-8b3f-f7449c5bf7b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:41.846181 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a59e75-68f4-4ff6-8b3f-f7449c5bf7b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:41.847839 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a59e75-68f4-4ff6-8b3f-f7449c5bf7b3 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:41.859842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-71a59e75-68f4-4ff6-8b3f-f7449c5bf7b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:41.859842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:41.859842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:41.859842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:41.859842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:41.859842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:41.859842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:41.859842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:41.859842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:41.859842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:41.859842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:41.859842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:41.859842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:03:41.859842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:03:41.859842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:03:41.864616 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:03:41.864616 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:41.864616 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:41.864616 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:41.864616 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:41.864616 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:41.864616 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:41.864616 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:41.864616 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:41.864616 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:41.864616 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:41.864616 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:41.864616 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:41.864616 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:41.864616 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:41.864616 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:41.864616 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:41.865515 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:03:41.865515 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:03:41.865515 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:03:41.865515 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:03:41.865515 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:03:41.865515 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:03:41.865515 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:41.865515 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:41.865515 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 414/851] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:03:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:41.867309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad513de5-07b3-42a5-ad57-40747d9d517a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:41.948181 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a59e75-68f4-4ff6-8b3f-f7449c5bf7b3 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:41.973557 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad513de5-07b3-42a5-ad57-40747d9d517a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:42.019402 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5c6c7-10aa-4b58-b20f-e49fb0eeed0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:42.020027 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5c6c7-10aa-4b58-b20f-e49fb0eeed0d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:42.020346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5c6c7-10aa-4b58-b20f-e49fb0eeed0d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:42.020726 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5c6c7-10aa-4b58-b20f-e49fb0eeed0d None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:42.021522 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5c6c7-10aa-4b58-b20f-e49fb0eeed0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:42.021833 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5c6c7-10aa-4b58-b20f-e49fb0eeed0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:42.023316 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5c6c7-10aa-4b58-b20f-e49fb0eeed0d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:42.026814 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:42.035268 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:42.038991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 438/852] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:03:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:42.046468 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5c6c7-10aa-4b58-b20f-e49fb0eeed0d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:42.072591 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a59e75-68f4-4ff6-8b3f-f7449c5bf7b3 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:42.108742 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3c854-d1f8-45d2-963f-834c461326aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:42.109377 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3c854-d1f8-45d2-963f-834c461326aa None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:42.109647 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3c854-d1f8-45d2-963f-834c461326aa None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:42.109921 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3c854-d1f8-45d2-963f-834c461326aa None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:42.110505 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3c854-d1f8-45d2-963f-834c461326aa None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:42.111906 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3c854-d1f8-45d2-963f-834c461326aa None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:42.121705 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-33c3c854-d1f8-45d2-963f-834c461326aa None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 21:03:42.121705 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:42.121705 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 21:03:42.121705 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 21:03:42.121705 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 21:03:42.121705 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 21:03:42.121705 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 21:03:42.121705 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:42.121705 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 21:03:42.121705 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:42.121705 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 21:03:42.121705 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:42.121705 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:42.121705 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:42.121705 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:42.121705 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:42.122806 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:42.122806 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:42.122806 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:42.122806 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:42.122806 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:42.122806 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:42.122806 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:42.122806 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 21:03:42.122806 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 21:03:42.122806 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 21:03:42.122806 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 21:03:42.122806 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:42.122806 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:42.122806 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:42.122806 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:42.122806 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:42.122806 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:42.123767 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:42.123767 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:42.123767 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:42.123767 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:42.123767 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:42.123767 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:42.123767 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:42.123767 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:42.123767 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:42.123767 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:42.123767 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 21:03:42.123767 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:42.123767 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 21:03:42.123767 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:42.123767 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 415/853] 10.222.0.81 () {56 vars in 1132 bytes} [Tue Sep 6 21:03:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:03:42.124913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb94dcb-c640-4a02-9e02-1f0cd7c49361 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:42.124913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb94dcb-c640-4a02-9e02-1f0cd7c49361 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:42.125203 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb94dcb-c640-4a02-9e02-1f0cd7c49361 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:42.126494 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 416/854] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:42.129908 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb94dcb-c640-4a02-9e02-1f0cd7c49361 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:42.164881 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5c6c7-10aa-4b58-b20f-e49fb0eeed0d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:42.200109 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db67d59-bf0e-4d89-a6db-b73ab5e4003f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:42.200656 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db67d59-bf0e-4d89-a6db-b73ab5e4003f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:42.200956 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db67d59-bf0e-4d89-a6db-b73ab5e4003f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:42.201200 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db67d59-bf0e-4d89-a6db-b73ab5e4003f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:42.202033 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db67d59-bf0e-4d89-a6db-b73ab5e4003f None admin] RBAC: Adding query filter params (role.id=fe9661f095094dd0931e0b96a1d6ef74, scope.project.id=002e09339d4e49ce98434571d3b64248, user.id=cf0aac45d8b549afafae0a3f623bce46) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:42.202343 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db67d59-bf0e-4d89-a6db-b73ab5e4003f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:42.203755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db67d59-bf0e-4d89-a6db-b73ab5e4003f None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:42.210974 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 439/855] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:03:42 2022] GET /identity/v3/role_assignments?user.id=cf0aac45d8b549afafae0a3f623bce46&scope.project.id=002e09339d4e49ce98434571d3b64248&role.id=fe9661f095094dd0931e0b96a1d6ef74 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:42.211545 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7f23c-649f-492e-a0a2-2d1040df719b None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:42.211823 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7f23c-649f-492e-a0a2-2d1040df719b None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:42.212116 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7f23c-649f-492e-a0a2-2d1040df719b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:42.231867 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-97f7f23c-649f-492e-a0a2-2d1040df719b None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:42.233171 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-97f7f23c-649f-492e-a0a2-2d1040df719b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:42.265996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb94dcb-c640-4a02-9e02-1f0cd7c49361 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:42.306730 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc15f65-64be-4c2f-a987-d1759d1e312c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:42.307401 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc15f65-64be-4c2f-a987-d1759d1e312c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:42.307683 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc15f65-64be-4c2f-a987-d1759d1e312c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:42.307953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc15f65-64be-4c2f-a987-d1759d1e312c None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:42.308700 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc15f65-64be-4c2f-a987-d1759d1e312c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:42.308997 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc15f65-64be-4c2f-a987-d1759d1e312c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:42.310395 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc15f65-64be-4c2f-a987-d1759d1e312c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:42.312623 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:42.316049 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:42.316826 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 417/856] 10.222.0.81 () {56 vars in 1126 bytes} [Tue Sep 6 21:03:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:03:42.328124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc15f65-64be-4c2f-a987-d1759d1e312c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:42.339322 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 440/857] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:03:42.454061 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc15f65-64be-4c2f-a987-d1759d1e312c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:42.491002 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352e467-ebb6-4689-93e9-3815513f851e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:42.491989 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352e467-ebb6-4689-93e9-3815513f851e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:42.492497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352e467-ebb6-4689-93e9-3815513f851e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:42.492955 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352e467-ebb6-4689-93e9-3815513f851e None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:42.493763 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352e467-ebb6-4689-93e9-3815513f851e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:42.494247 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352e467-ebb6-4689-93e9-3815513f851e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:42.495827 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352e467-ebb6-4689-93e9-3815513f851e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:42.500928 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 418/858] 10.222.0.81 () {56 vars in 1126 bytes} [Tue Sep 6 21:03:42 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:42.625506 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7f23c-649f-492e-a0a2-2d1040df719b None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:42.737749 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7f23c-649f-492e-a0a2-2d1040df719b None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:42.773377 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a0c32-da9f-4664-9197-127c2d95a36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:42.774015 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a0c32-da9f-4664-9197-127c2d95a36b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:42.774288 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a0c32-da9f-4664-9197-127c2d95a36b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:42.774555 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a0c32-da9f-4664-9197-127c2d95a36b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:42.789448 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a0c32-da9f-4664-9197-127c2d95a36b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:03:42.794971 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-ff0a0c32-da9f-4664-9197-127c2d95a36b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:42.794971 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:42.794971 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:42.794971 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:42.794971 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:42.794971 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:42.794971 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:42.794971 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:42.794971 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:42.794971 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:42.794971 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:42.794971 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:42.794971 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:03:42.794971 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:03:42.794971 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:03:42.794971 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:03:42.795914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:03:42.795914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:03:42.795914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:03:42.795914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:03:42.795914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:42.795914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:42.795914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:42.795914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:42.795914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:42.795914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:42.795914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:42.795914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:42.795914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:42.795914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:42.795914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:42.795914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:42.796817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:42.796817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:42.796817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:42.796817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:42.796817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:03:42.796817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:03:42.796817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:03:42.796817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:03:42.796817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:03:42.796817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:03:42.796817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:03:42.796817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:42.796817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 441/859] 10.222.0.81 () {56 vars in 1102 bytes} [Tue Sep 6 21:03:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:42.802048 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352e467-ebb6-4689-93e9-3815513f851e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:42.873300 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:42.912261 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352e467-ebb6-4689-93e9-3815513f851e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:42.948063 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed323cb-3ce0-4b49-8e14-b0a2af60dd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:42.948765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed323cb-3ce0-4b49-8e14-b0a2af60dd2a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:42.949045 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed323cb-3ce0-4b49-8e14-b0a2af60dd2a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:42.949317 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed323cb-3ce0-4b49-8e14-b0a2af60dd2a None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:42.950032 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed323cb-3ce0-4b49-8e14-b0a2af60dd2a None admin] RBAC: Adding query filter params (name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:42.950335 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed323cb-3ce0-4b49-8e14-b0a2af60dd2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:42.951757 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed323cb-3ce0-4b49-8e14-b0a2af60dd2a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:42.960906 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 419/860] 10.222.0.81 () {56 vars in 1103 bytes} [Tue Sep 6 21:03:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:03:42.966117 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a0c32-da9f-4664-9197-127c2d95a36b None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:43.022396 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:43.078890 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a0c32-da9f-4664-9197-127c2d95a36b None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:43.116412 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535b102-c0e0-40f0-ad79-e57934b19f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:43.117060 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535b102-c0e0-40f0-ad79-e57934b19f07 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:43.117337 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535b102-c0e0-40f0-ad79-e57934b19f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:43.117606 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535b102-c0e0-40f0-ad79-e57934b19f07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:43.127768 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535b102-c0e0-40f0-ad79-e57934b19f07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:43.129246 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b535b102-c0e0-40f0-ad79-e57934b19f07 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:43.145381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-b535b102-c0e0-40f0-ad79-e57934b19f07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:43.145381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:43.145381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:43.145381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:43.145381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:43.145381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:43.145381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:43.145381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:43.145381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:43.145381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:43.145381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:43.145381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:43.145381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:43.145381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:43.145381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:43.145381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:43.146351 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:43.146351 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:43.146351 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:43.146351 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:43.146351 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:43.146351 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:43.146351 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:43.146351 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:43.146351 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:43.146351 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:43.146351 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:43.146351 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:43.146351 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:43.146351 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:43.146351 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:43.146351 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:43.146351 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:43.147785 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:43.147785 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:43.147785 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:43.147785 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 442/861] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:43.152520 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed323cb-3ce0-4b49-8e14-b0a2af60dd2a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:43.265723 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed323cb-3ce0-4b49-8e14-b0a2af60dd2a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:43.290944 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:43.299884 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23028cba-95b7-46b1-8af7-6cad05518c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:43.300539 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23028cba-95b7-46b1-8af7-6cad05518c11 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:43.300823 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23028cba-95b7-46b1-8af7-6cad05518c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:43.301101 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23028cba-95b7-46b1-8af7-6cad05518c11 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:43.301761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23028cba-95b7-46b1-8af7-6cad05518c11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:43.302070 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23028cba-95b7-46b1-8af7-6cad05518c11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:43.303493 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23028cba-95b7-46b1-8af7-6cad05518c11 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:43.316759 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 420/862] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:43.322784 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535b102-c0e0-40f0-ad79-e57934b19f07 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:43.462299 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535b102-c0e0-40f0-ad79-e57934b19f07 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:43.463947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:43.498336 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b29a0-6fb6-47e3-aef9-9fd1d29e56d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:43.498979 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b29a0-6fb6-47e3-aef9-9fd1d29e56d5 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:43.499258 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b29a0-6fb6-47e3-aef9-9fd1d29e56d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:43.499523 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b29a0-6fb6-47e3-aef9-9fd1d29e56d5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:43.508867 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b29a0-6fb6-47e3-aef9-9fd1d29e56d5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:43.511003 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15b29a0-6fb6-47e3-aef9-9fd1d29e56d5 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:43.524489 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-b15b29a0-6fb6-47e3-aef9-9fd1d29e56d5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 21:03:43.524489 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:43.524489 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:43.524489 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:43.524489 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:43.524489 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:43.524489 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:43.524489 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:43.524489 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:43.524489 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:43.524489 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:43.524489 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:43.524489 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:03:43.524489 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:03:43.524489 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:03:43.524489 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:03:43.525496 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:43.525496 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:43.525496 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:03:43.525496 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:43.525496 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:03:43.525496 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:43.525496 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:43.525496 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:43.525496 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:43.525496 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:43.525496 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:43.525496 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:43.525496 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:43.525496 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:43.525496 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:43.525496 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:43.525496 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:43.525496 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:43.526442 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:43.526442 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:43.526442 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:03:43.526442 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:03:43.526442 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:03:43.526442 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:03:43.526442 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:03:43.526442 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:03:43.526442 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 21:03:43.526442 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:43.526442 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 443/863] 10.222.0.81 () {56 vars in 1117 bytes} [Tue Sep 6 21:03:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:43.533692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23028cba-95b7-46b1-8af7-6cad05518c11 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:43.642143 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23028cba-95b7-46b1-8af7-6cad05518c11 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:43.677693 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d5e44-31a3-45f6-affc-a40ffce26fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:43.678314 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d5e44-31a3-45f6-affc-a40ffce26fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:43.679112 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d5e44-31a3-45f6-affc-a40ffce26fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:43.679391 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d5e44-31a3-45f6-affc-a40ffce26fd5 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:43.680152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d5e44-31a3-45f6-affc-a40ffce26fd5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:43.680466 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d5e44-31a3-45f6-affc-a40ffce26fd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:43.681958 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69d5e44-31a3-45f6-affc-a40ffce26fd5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:43.701060 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 421/864] 10.222.0.81 () {56 vars in 1149 bytes} [Tue Sep 6 21:03:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:43.706937 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b29a0-6fb6-47e3-aef9-9fd1d29e56d5 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:43.829258 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b29a0-6fb6-47e3-aef9-9fd1d29e56d5 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:43.857542 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72acf1de-046a-400e-91f7-100420520f0e None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:43.857829 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72acf1de-046a-400e-91f7-100420520f0e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:43.858095 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72acf1de-046a-400e-91f7-100420520f0e None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:43.859573 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 422/865] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:43.864739 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ece0c-19a5-4775-9f07-d022b228ac91 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:43.865015 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ece0c-19a5-4775-9f07-d022b228ac91 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:43.865295 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ece0c-19a5-4775-9f07-d022b228ac91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:43.871838 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095c4e8-d00d-4662-97f1-d17a7d235807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:43.872785 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095c4e8-d00d-4662-97f1-d17a7d235807 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:43.873120 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095c4e8-d00d-4662-97f1-d17a7d235807 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:43.873399 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095c4e8-d00d-4662-97f1-d17a7d235807 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:43.884067 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-bb6ece0c-19a5-4775-9f07-d022b228ac91 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:43.885643 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-bb6ece0c-19a5-4775-9f07-d022b228ac91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:43.906285 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:43.946648 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:43.957287 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095c4e8-d00d-4662-97f1-d17a7d235807 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:43.959060 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095c4e8-d00d-4662-97f1-d17a7d235807 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:43.976014 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 423/866] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:43 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 21:03:44.064882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 444/867] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:03:43 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 21:03:44.070441 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ece0c-19a5-4775-9f07-d022b228ac91 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:44.180307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ece0c-19a5-4775-9f07-d022b228ac91 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:44.218316 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a5487-47fd-44b5-8255-9e5555d7d367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:44.218952 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a5487-47fd-44b5-8255-9e5555d7d367 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:44.219299 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a5487-47fd-44b5-8255-9e5555d7d367 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:44.219566 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229a5487-47fd-44b5-8255-9e5555d7d367 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:44.230521 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a5487-47fd-44b5-8255-9e5555d7d367 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:44.232011 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229a5487-47fd-44b5-8255-9e5555d7d367 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:44.249252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-229a5487-47fd-44b5-8255-9e5555d7d367 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:44.249252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:44.249252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:44.249252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:44.249252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:44.249252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:44.249252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:44.249252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:44.249252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:44.249252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:44.249252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:44.249252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:44.249252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:44.249252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:44.249252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:44.249252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:44.250378 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:44.250378 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:44.250378 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:44.250378 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:44.250378 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:44.250378 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:44.250378 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:44.250378 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:44.250378 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:44.250378 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:44.250378 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:44.250378 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:44.250378 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:44.250378 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:44.250378 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:44.250378 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:44.250378 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:44.251314 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:44.251314 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:44.251314 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:44.251314 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 424/868] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:44.257190 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095c4e8-d00d-4662-97f1-d17a7d235807 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:44.268855 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a5487-47fd-44b5-8255-9e5555d7d367 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:44.299003 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:44.338103 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:44.385220 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229a5487-47fd-44b5-8255-9e5555d7d367 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:44.386981 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095c4e8-d00d-4662-97f1-d17a7d235807 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:44.426967 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e98417-0689-4c86-98f3-08e4e7f19e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:44.427990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e98417-0689-4c86-98f3-08e4e7f19e19 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:44.429143 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e98417-0689-4c86-98f3-08e4e7f19e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:44.429745 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e98417-0689-4c86-98f3-08e4e7f19e19 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:44.430960 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e98417-0689-4c86-98f3-08e4e7f19e19 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:44.433009 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e98417-0689-4c86-98f3-08e4e7f19e19 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:44.433274 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccf92e-ce60-4dbe-9b33-bf18e99721f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:44.434046 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccf92e-ce60-4dbe-9b33-bf18e99721f8 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:44.434397 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccf92e-ce60-4dbe-9b33-bf18e99721f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:44.434738 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fccf92e-ce60-4dbe-9b33-bf18e99721f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:44.435466 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccf92e-ce60-4dbe-9b33-bf18e99721f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:44.435833 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccf92e-ce60-4dbe-9b33-bf18e99721f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:44.437438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fccf92e-ce60-4dbe-9b33-bf18e99721f8 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:44.453101 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 445/869] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:44.458657 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccf92e-ce60-4dbe-9b33-bf18e99721f8 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:44.516727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 425/870] 10.222.0.81 () {60 vars in 1141 bytes} [Tue Sep 6 21:03:44 2022] POST /identity/v3/services => generated 251 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:03:44.549308 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa174d6-cb36-4379-b7fd-5765f2c7c541 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:44.549666 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa174d6-cb36-4379-b7fd-5765f2c7c541 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:44.549953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa174d6-cb36-4379-b7fd-5765f2c7c541 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:44.551649 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 426/871] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:03:44.558121 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009fc45-f76d-420f-bcfe-a62a308f01cb None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:44.558436 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009fc45-f76d-420f-bcfe-a62a308f01cb None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:44.558690 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009fc45-f76d-420f-bcfe-a62a308f01cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:44.579716 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-e009fc45-f76d-420f-bcfe-a62a308f01cb None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:44.581094 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e009fc45-f76d-420f-bcfe-a62a308f01cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:44.588519 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fccf92e-ce60-4dbe-9b33-bf18e99721f8 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:44.625931 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:44.653152 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6eb1eb-3640-4ed5-b166-a0f0fb5e2d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:44.654547 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6eb1eb-3640-4ed5-b166-a0f0fb5e2d31 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:44.655042 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6eb1eb-3640-4ed5-b166-a0f0fb5e2d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:44.655779 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6eb1eb-3640-4ed5-b166-a0f0fb5e2d31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:44.667511 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6eb1eb-3640-4ed5-b166-a0f0fb5e2d31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:44.669711 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6eb1eb-3640-4ed5-b166-a0f0fb5e2d31 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:44.672535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 427/872] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:44 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:03:44.684387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-6b6eb1eb-3640-4ed5-b166-a0f0fb5e2d31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:44.684387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:44.684387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:44.684387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:44.684387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:44.684387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:44.684387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:44.684387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:44.684387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:44.684387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:44.684387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:44.684387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:44.684387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:03:44.684387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:03:44.684387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:03:44.685326 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:03:44.685326 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:44.685326 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:44.685326 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:44.685326 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:44.685326 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:44.685326 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:44.685326 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:44.685326 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:44.685326 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:44.685326 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:44.685326 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:44.685326 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:44.685326 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:44.685326 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:44.685326 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:44.685326 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:44.686222 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:03:44.686222 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:03:44.686222 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:03:44.686222 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:03:44.686222 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:03:44.686222 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:03:44.686222 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:44.686222 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:44.693154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 446/873] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:03:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:03:44.694899 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009fc45-f76d-420f-bcfe-a62a308f01cb None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:44.714058 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:44.802921 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009fc45-f76d-420f-bcfe-a62a308f01cb None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:44.846544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f829c-6fe1-4c8c-afe1-31d9395d0555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:44.847713 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f829c-6fe1-4c8c-afe1-31d9395d0555 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:44.848328 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f829c-6fe1-4c8c-afe1-31d9395d0555 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:44.848837 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f829c-6fe1-4c8c-afe1-31d9395d0555 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:44.849926 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f829c-6fe1-4c8c-afe1-31d9395d0555 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:44.851097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f829c-6fe1-4c8c-afe1-31d9395d0555 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:44.852783 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f829c-6fe1-4c8c-afe1-31d9395d0555 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:44.871798 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 428/874] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:03:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:44.878134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6eb1eb-3640-4ed5-b166-a0f0fb5e2d31 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:44.947012 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea09c7-211f-4c6c-aa3a-d83b1f3da161 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:44.947202 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea09c7-211f-4c6c-aa3a-d83b1f3da161 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:44.947478 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea09c7-211f-4c6c-aa3a-d83b1f3da161 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:44.948852 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 429/875] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:03:44.953189 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea09c7-211f-4c6c-aa3a-d83b1f3da161 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:44.990068 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6eb1eb-3640-4ed5-b166-a0f0fb5e2d31 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:45.029326 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9daae21-e786-4d44-8591-a33c3a5e1d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:45.030013 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9daae21-e786-4d44-8591-a33c3a5e1d5a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:45.030302 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9daae21-e786-4d44-8591-a33c3a5e1d5a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:45.030580 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9daae21-e786-4d44-8591-a33c3a5e1d5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:45.031309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9daae21-e786-4d44-8591-a33c3a5e1d5a None admin] RBAC: Adding query filter params (role.id=747c70d4cefb4a82816c17da1259b90f, scope.project.id=002e09339d4e49ce98434571d3b64248, user.id=0ba7376671a24d35a920e0ec3290472b) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:45.031625 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9daae21-e786-4d44-8591-a33c3a5e1d5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:45.033090 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9daae21-e786-4d44-8591-a33c3a5e1d5a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:45.039730 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:45.040976 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 447/876] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:03:44 2022] GET /identity/v3/role_assignments?user.id=0ba7376671a24d35a920e0ec3290472b&scope.project.id=002e09339d4e49ce98434571d3b64248&role.id=747c70d4cefb4a82816c17da1259b90f => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:45.042524 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362af08a-ee29-4398-b3fb-b5c37fdce0a4 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:45.042964 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362af08a-ee29-4398-b3fb-b5c37fdce0a4 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:45.043386 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362af08a-ee29-4398-b3fb-b5c37fdce0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:45.068677 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea09c7-211f-4c6c-aa3a-d83b1f3da161 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:45.073597 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-362af08a-ee29-4398-b3fb-b5c37fdce0a4 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:45.074846 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-362af08a-ee29-4398-b3fb-b5c37fdce0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:45.109526 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd897207-58c7-4536-8d1f-a3c257a79f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:45.110193 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd897207-58c7-4536-8d1f-a3c257a79f3a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:45.110476 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd897207-58c7-4536-8d1f-a3c257a79f3a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:45.110756 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd897207-58c7-4536-8d1f-a3c257a79f3a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:45.111375 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd897207-58c7-4536-8d1f-a3c257a79f3a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:45.112948 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd897207-58c7-4536-8d1f-a3c257a79f3a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:45.123290 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-cd897207-58c7-4536-8d1f-a3c257a79f3a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 21:03:45.123290 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:45.123290 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 21:03:45.123290 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 21:03:45.123290 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 21:03:45.123290 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 21:03:45.123290 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 21:03:45.123290 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:45.123290 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 21:03:45.123290 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:45.123290 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 21:03:45.123290 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:45.123290 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:45.123290 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:45.123290 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:45.123290 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:45.123290 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:45.124489 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:45.124489 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:45.124489 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:45.124489 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:45.124489 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:45.124489 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:45.124489 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 21:03:45.124489 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 21:03:45.124489 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 21:03:45.124489 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 21:03:45.124489 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:45.124489 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:45.124489 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:45.124489 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:45.124489 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:45.124489 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:45.125401 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:45.125401 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:45.125401 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:45.125401 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:45.125401 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:45.125401 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:45.125401 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:45.125401 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:45.125401 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:45.125401 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:45.125401 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 21:03:45.125401 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:45.125401 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 21:03:45.125401 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:45.129932 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 430/877] 10.222.0.81 () {56 vars in 1126 bytes} [Tue Sep 6 21:03:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:45.131021 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd897207-58c7-4536-8d1f-a3c257a79f3a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:45.136482 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:45.167315 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 448/878] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:45 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:03:45.262695 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd897207-58c7-4536-8d1f-a3c257a79f3a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:45.304475 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b0cb0-dcfe-43b6-8e1e-9b44e05a7801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:45.305497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b0cb0-dcfe-43b6-8e1e-9b44e05a7801 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:45.305976 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b0cb0-dcfe-43b6-8e1e-9b44e05a7801 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:45.306474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b0cb0-dcfe-43b6-8e1e-9b44e05a7801 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:45.307307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b0cb0-dcfe-43b6-8e1e-9b44e05a7801 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:45.307848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b0cb0-dcfe-43b6-8e1e-9b44e05a7801 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:45.309433 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b0cb0-dcfe-43b6-8e1e-9b44e05a7801 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:45.315302 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 431/879] 10.222.0.81 () {56 vars in 1122 bytes} [Tue Sep 6 21:03:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:45.321553 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362af08a-ee29-4398-b3fb-b5c37fdce0a4 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:45.440386 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362af08a-ee29-4398-b3fb-b5c37fdce0a4 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:45.443267 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b0cb0-dcfe-43b6-8e1e-9b44e05a7801 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:45.452351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:45.479780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb0fce-157b-4d8c-859e-8b2a7966e51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:45.480429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb0fce-157b-4d8c-859e-8b2a7966e51d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:45.480712 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb0fce-157b-4d8c-859e-8b2a7966e51d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:45.480989 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb0fce-157b-4d8c-859e-8b2a7966e51d None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:45.481632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb0fce-157b-4d8c-859e-8b2a7966e51d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:45.481982 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb0fce-157b-4d8c-859e-8b2a7966e51d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:45.483387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb0fce-157b-4d8c-859e-8b2a7966e51d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:45.492636 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 449/880] 10.222.0.81 () {56 vars in 1122 bytes} [Tue Sep 6 21:03:45 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:45.575974 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b0cb0-dcfe-43b6-8e1e-9b44e05a7801 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:45.615889 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361477f5-7b05-4779-bd4f-7d40f475c8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:45.616555 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361477f5-7b05-4779-bd4f-7d40f475c8dd None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:45.616881 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361477f5-7b05-4779-bd4f-7d40f475c8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:45.617112 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361477f5-7b05-4779-bd4f-7d40f475c8dd None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:45.617786 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361477f5-7b05-4779-bd4f-7d40f475c8dd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:45.619188 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361477f5-7b05-4779-bd4f-7d40f475c8dd None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:45.723428 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 432/881] 10.222.0.81 () {60 vars in 1141 bytes} [Tue Sep 6 21:03:45 2022] POST /identity/v3/services => generated 269 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:03:46.809417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1e63a-f6a4-4d73-b591-5b278b48e922 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:46.809969 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1e63a-f6a4-4d73-b591-5b278b48e922 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:46.809969 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1e63a-f6a4-4d73-b591-5b278b48e922 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:46.811554 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 450/882] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:46.816846 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f0da8-72b9-46aa-b270-bcd5f8aa56f5 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:46.817680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f0da8-72b9-46aa-b270-bcd5f8aa56f5 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:46.818160 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f0da8-72b9-46aa-b270-bcd5f8aa56f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:46.837229 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f09f0da8-72b9-46aa-b270-bcd5f8aa56f5 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:46.838721 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f09f0da8-72b9-46aa-b270-bcd5f8aa56f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:46.902134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:46.917123 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 433/883] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:46 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 21:03:47.192761 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1e63a-f6a4-4d73-b591-5b278b48e922 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:47.229360 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:47.313741 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1e63a-f6a4-4d73-b591-5b278b48e922 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:47.352656 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d828b18-e141-41a6-a198-a1f2d8fc38da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:47.353393 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d828b18-e141-41a6-a198-a1f2d8fc38da None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:47.353677 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d828b18-e141-41a6-a198-a1f2d8fc38da None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:47.353948 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d828b18-e141-41a6-a198-a1f2d8fc38da None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:47.354535 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d828b18-e141-41a6-a198-a1f2d8fc38da None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:47.355921 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d828b18-e141-41a6-a198-a1f2d8fc38da None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:47.365599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-0d828b18-e141-41a6-a198-a1f2d8fc38da None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 21:03:47.365599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:47.365599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 21:03:47.365599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 21:03:47.365599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 21:03:47.365599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 21:03:47.365599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 21:03:47.365599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:47.365599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 21:03:47.365599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:47.365599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 21:03:47.365599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:47.365599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:47.365599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:47.365599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:47.365599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:47.365599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:47.366707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:47.366707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:47.366707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:47.366707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:47.366707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:47.366707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:47.366707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 21:03:47.366707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 21:03:47.366707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 21:03:47.366707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 21:03:47.366707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:47.366707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:47.366707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:47.366707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:47.366707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:47.366707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:47.367570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:47.367570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:47.367570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:47.367570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:47.367570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:47.367570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:47.367570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:47.367570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:47.367570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:47.367570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:47.367570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 21:03:47.367570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:47.367570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 21:03:47.367570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:47.367570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 451/884] 10.222.0.81 () {56 vars in 1114 bytes} [Tue Sep 6 21:03:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:47.373054 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f0da8-72b9-46aa-b270-bcd5f8aa56f5 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:47.423421 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550afb54-bab3-43aa-8fcc-fa76e3ab7f60 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:47.424086 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550afb54-bab3-43aa-8fcc-fa76e3ab7f60 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:47.424687 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550afb54-bab3-43aa-8fcc-fa76e3ab7f60 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:47.426607 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 452/885] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:03:47.432440 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae33a6-9591-4045-a88d-be7f1581c784 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:47.433035 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae33a6-9591-4045-a88d-be7f1581c784 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:47.433526 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae33a6-9591-4045-a88d-be7f1581c784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:47.453233 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f7ae33a6-9591-4045-a88d-be7f1581c784 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:47.454829 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f7ae33a6-9591-4045-a88d-be7f1581c784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:47.488803 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f0da8-72b9-46aa-b270-bcd5f8aa56f5 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:47.532331 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428c96b-9f03-40b1-893c-1860c6486cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:47.532331 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428c96b-9f03-40b1-893c-1860c6486cfd None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:47.532603 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428c96b-9f03-40b1-893c-1860c6486cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:47.532876 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428c96b-9f03-40b1-893c-1860c6486cfd None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:47.533087 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 453/886] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:47 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 21:03:47.536134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428c96b-9f03-40b1-893c-1860c6486cfd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:47.536134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428c96b-9f03-40b1-893c-1860c6486cfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:47.536134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9428c96b-9f03-40b1-893c-1860c6486cfd None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:47.541549 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 434/887] 10.222.0.81 () {56 vars in 1114 bytes} [Tue Sep 6 21:03:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:47.547713 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae33a6-9591-4045-a88d-be7f1581c784 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:47.592624 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:47.665932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae33a6-9591-4045-a88d-be7f1581c784 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:47.702421 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6d363-c48e-4019-a8d9-46a8beacc734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:47.703467 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6d363-c48e-4019-a8d9-46a8beacc734 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:47.703968 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6d363-c48e-4019-a8d9-46a8beacc734 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:47.704632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6d363-c48e-4019-a8d9-46a8beacc734 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:47.705489 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6d363-c48e-4019-a8d9-46a8beacc734 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:47.706000 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6d363-c48e-4019-a8d9-46a8beacc734 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:47.707592 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6d363-c48e-4019-a8d9-46a8beacc734 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:47.713853 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 454/888] 10.222.0.81 () {56 vars in 1114 bytes} [Tue Sep 6 21:03:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:47.722104 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428c96b-9f03-40b1-893c-1860c6486cfd None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:47.728963 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474cfdc-80bb-4bfc-8a29-3976ec930191 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:47.729252 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474cfdc-80bb-4bfc-8a29-3976ec930191 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:47.729531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474cfdc-80bb-4bfc-8a29-3976ec930191 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:47.730890 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 455/889] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:03:47.735880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a3d2d-cc5a-4caf-99f4-73dabf8728b0 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:47.736201 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a3d2d-cc5a-4caf-99f4-73dabf8728b0 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:47.736620 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a3d2d-cc5a-4caf-99f4-73dabf8728b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:47.757987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-7d9a3d2d-cc5a-4caf-99f4-73dabf8728b0 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:47.759552 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7d9a3d2d-cc5a-4caf-99f4-73dabf8728b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:47.790640 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:47.844989 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 456/890] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:47 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:03:47.845854 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a3d2d-cc5a-4caf-99f4-73dabf8728b0 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:47.846625 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428c96b-9f03-40b1-893c-1860c6486cfd None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:47.876930 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:47.901004 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b49318-fa41-461a-90d7-fa1f67938ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:47.901820 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b49318-fa41-461a-90d7-fa1f67938ecb None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:47.902198 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b49318-fa41-461a-90d7-fa1f67938ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:47.902611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b49318-fa41-461a-90d7-fa1f67938ecb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:47.904043 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b49318-fa41-461a-90d7-fa1f67938ecb None admin] RBAC: Adding query filter params (interface=public, service_id=49cc56aa26104e648a8ed1a5a4b69e4c, region_id=RegionOne) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:47.904590 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b49318-fa41-461a-90d7-fa1f67938ecb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:47.907611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b49318-fa41-461a-90d7-fa1f67938ecb None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:47.920256 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 435/891] 10.222.0.81 () {56 vars in 1251 bytes} [Tue Sep 6 21:03:47 2022] GET /identity/v3/endpoints?service_id=49cc56aa26104e648a8ed1a5a4b69e4c&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:47.925467 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b49318-fa41-461a-90d7-fa1f67938ecb None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:47.974064 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a3d2d-cc5a-4caf-99f4-73dabf8728b0 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:48.025445 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032545b-1aef-4223-a0ac-afabfef5f563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:48.026874 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032545b-1aef-4223-a0ac-afabfef5f563 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:48.026874 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032545b-1aef-4223-a0ac-afabfef5f563 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:48.026874 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032545b-1aef-4223-a0ac-afabfef5f563 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:48.040015 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032545b-1aef-4223-a0ac-afabfef5f563 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:03:48.044990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-a032545b-1aef-4223-a0ac-afabfef5f563 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 21:03:48.044990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:48.044990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:48.044990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:48.044990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:48.044990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:48.044990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:48.044990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:48.044990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:48.044990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:48.044990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:48.044990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:48.044990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:03:48.044990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:03:48.044990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:03:48.044990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:03:48.045932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:03:48.045932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:03:48.045932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:03:48.045932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:03:48.045932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:48.045932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:48.045932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:48.045932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:48.045932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:48.045932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:48.045932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:48.045932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:48.045932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:48.045932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:48.045932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:48.045932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:48.046801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:48.046801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:48.046801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:48.046801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:48.046801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:03:48.046801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:03:48.046801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:03:48.046801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:03:48.046801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:03:48.046801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:03:48.046801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 21:03:48.046801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:48.046801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 457/892] 10.222.0.81 () {56 vars in 1120 bytes} [Tue Sep 6 21:03:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:48.048009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb9e70-2e64-42d8-8f99-353c71802745 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:48.048009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb9e70-2e64-42d8-8f99-353c71802745 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:48.048009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb9e70-2e64-42d8-8f99-353c71802745 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:48.050432 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 458/893] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:48.053055 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb9e70-2e64-42d8-8f99-353c71802745 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:48.063613 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b49318-fa41-461a-90d7-fa1f67938ecb None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:48.085515 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:48.106535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4651a4-9fcd-45b4-8399-866b2ddd3e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:48.107159 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4651a4-9fcd-45b4-8399-866b2ddd3e28 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:48.107441 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4651a4-9fcd-45b4-8399-866b2ddd3e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:48.107722 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4651a4-9fcd-45b4-8399-866b2ddd3e28 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:48.108367 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4651a4-9fcd-45b4-8399-866b2ddd3e28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:48.109744 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4651a4-9fcd-45b4-8399-866b2ddd3e28 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:48.116405 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 436/894] 10.222.0.81 () {56 vars in 1087 bytes} [Tue Sep 6 21:03:47 2022] GET /identity/v3/services => generated 1268 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:03:48.117524 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5bc6b-d6f1-47d8-90a5-afef6cdb5475 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:48.117813 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5bc6b-d6f1-47d8-90a5-afef6cdb5475 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:48.118093 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e5bc6b-d6f1-47d8-90a5-afef6cdb5475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:48.140569 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-68e5bc6b-d6f1-47d8-90a5-afef6cdb5475 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:48.141808 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-68e5bc6b-d6f1-47d8-90a5-afef6cdb5475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:48.159121 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:48.179466 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb9e70-2e64-42d8-8f99-353c71802745 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:48.220915 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b8b56-c678-4c50-bc1b-2bca61283fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:48.228482 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b8b56-c678-4c50-bc1b-2bca61283fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:48.228685 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 437/895] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:48 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:03:48.228786 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b8b56-c678-4c50-bc1b-2bca61283fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:48.228786 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b8b56-c678-4c50-bc1b-2bca61283fb4 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:48.228918 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5bc6b-d6f1-47d8-90a5-afef6cdb5475 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:48.228995 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b8b56-c678-4c50-bc1b-2bca61283fb4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:48.228995 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b8b56-c678-4c50-bc1b-2bca61283fb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:48.228995 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b8b56-c678-4c50-bc1b-2bca61283fb4 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:48.241847 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 459/896] 10.222.0.81 () {56 vars in 1115 bytes} [Tue Sep 6 21:03:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:48.242855 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b8b56-c678-4c50-bc1b-2bca61283fb4 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:48.356027 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e5bc6b-d6f1-47d8-90a5-afef6cdb5475 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:48.375263 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:48.394091 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b8b56-c678-4c50-bc1b-2bca61283fb4 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:48.397734 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42fae0-d54f-4a66-8fc1-878ee46ac8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:48.398431 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42fae0-d54f-4a66-8fc1-878ee46ac8f2 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:48.398815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42fae0-d54f-4a66-8fc1-878ee46ac8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:48.399159 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c42fae0-d54f-4a66-8fc1-878ee46ac8f2 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:48.399882 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c42fae0-d54f-4a66-8fc1-878ee46ac8f2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:48.401491 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c42fae0-d54f-4a66-8fc1-878ee46ac8f2 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:48.431116 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbf5fc-5c76-4209-8a68-40663955ffa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:48.431755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbf5fc-5c76-4209-8a68-40663955ffa6 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:48.432033 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbf5fc-5c76-4209-8a68-40663955ffa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:48.432339 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dbf5fc-5c76-4209-8a68-40663955ffa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:48.443365 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbf5fc-5c76-4209-8a68-40663955ffa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:48.447335 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dbf5fc-5c76-4209-8a68-40663955ffa6 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:48.452761 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:48.463451 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-73dbf5fc-5c76-4209-8a68-40663955ffa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:48.463451 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:48.463451 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:48.463451 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:48.463451 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:48.463451 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:48.463451 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:48.463451 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:48.463451 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:48.463451 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:48.463451 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:48.463451 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:48.463451 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:48.463451 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:48.463451 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:48.463451 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:48.464633 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:48.464633 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:48.464633 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:48.464633 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:48.464633 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:48.464633 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:48.464633 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:48.464633 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:48.464633 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:48.464633 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:48.464633 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:48.464633 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:48.464633 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:48.464633 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:48.464633 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:48.464633 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:48.464633 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:48.465572 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:48.465572 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:48.465572 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:48.465572 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 460/897] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:48.473835 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbf5fc-5c76-4209-8a68-40663955ffa6 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:48.488938 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 438/898] 10.222.0.81 () {60 vars in 1141 bytes} [Tue Sep 6 21:03:48 2022] POST /identity/v3/services => generated 241 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:03:48.518687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42fae0-d54f-4a66-8fc1-878ee46ac8f2 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:48.617573 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dbf5fc-5c76-4209-8a68-40663955ffa6 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:48.671668 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c42fae0-d54f-4a66-8fc1-878ee46ac8f2 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:48.679409 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f3002-fa7d-4924-8a77-d7b03de0b49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:48.680042 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f3002-fa7d-4924-8a77-d7b03de0b49e None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:48.680380 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f3002-fa7d-4924-8a77-d7b03de0b49e None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:48.680700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f3002-fa7d-4924-8a77-d7b03de0b49e None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:48.681355 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f3002-fa7d-4924-8a77-d7b03de0b49e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:48.681666 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f3002-fa7d-4924-8a77-d7b03de0b49e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:48.683616 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f3002-fa7d-4924-8a77-d7b03de0b49e None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:48.699454 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 461/899] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:48.704974 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f3002-fa7d-4924-8a77-d7b03de0b49e None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:48.717547 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1941c0-34ae-4e3a-a796-541d2b361cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:48.718196 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1941c0-34ae-4e3a-a796-541d2b361cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:48.718481 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1941c0-34ae-4e3a-a796-541d2b361cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:48.718761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1941c0-34ae-4e3a-a796-541d2b361cf5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:48.720138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1941c0-34ae-4e3a-a796-541d2b361cf5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:48.720851 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1941c0-34ae-4e3a-a796-541d2b361cf5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:48.732234 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-1a1941c0-34ae-4e3a-a796-541d2b361cf5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 21:03:48.732234 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:48.732234 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 21:03:48.732234 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 21:03:48.732234 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 21:03:48.732234 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 21:03:48.732234 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 21:03:48.732234 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:48.732234 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 21:03:48.732234 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:48.732234 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 21:03:48.732234 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:48.732234 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:48.732234 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:48.732234 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:48.732234 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:48.733252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:48.733252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:48.733252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:48.733252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:48.733252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:48.733252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:48.733252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:48.733252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 21:03:48.733252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 21:03:48.733252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 21:03:48.733252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 21:03:48.733252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:48.733252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:48.733252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:48.733252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:48.733252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:48.733252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:48.734148 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:48.734148 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:48.734148 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:48.734148 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:48.734148 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:48.734148 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:48.734148 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:48.734148 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:48.734148 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:48.734148 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:48.734148 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 21:03:48.734148 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:48.734148 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 21:03:48.734148 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:48.735647 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 439/900] 10.222.0.81 () {56 vars in 1132 bytes} [Tue Sep 6 21:03:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:03:48.742260 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1941c0-34ae-4e3a-a796-541d2b361cf5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:48.777453 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:48.780113 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:48.828475 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f3002-fa7d-4924-8a77-d7b03de0b49e None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:48.857131 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1941c0-34ae-4e3a-a796-541d2b361cf5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:48.879085 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516fb42-8aaa-472c-ba47-1ee0d2f4f0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:48.880390 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516fb42-8aaa-472c-ba47-1ee0d2f4f0f5 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:48.881334 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516fb42-8aaa-472c-ba47-1ee0d2f4f0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:48.881769 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516fb42-8aaa-472c-ba47-1ee0d2f4f0f5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:48.894188 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516fb42-8aaa-472c-ba47-1ee0d2f4f0f5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:48.895882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516fb42-8aaa-472c-ba47-1ee0d2f4f0f5 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:48.897987 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed4c1e-3400-402c-8ee2-85ad7ebccbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:48.898724 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed4c1e-3400-402c-8ee2-85ad7ebccbcd None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:48.899146 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed4c1e-3400-402c-8ee2-85ad7ebccbcd None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:48.899522 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed4c1e-3400-402c-8ee2-85ad7ebccbcd None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:48.900592 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed4c1e-3400-402c-8ee2-85ad7ebccbcd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:48.900715 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed4c1e-3400-402c-8ee2-85ad7ebccbcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:48.902431 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed4c1e-3400-402c-8ee2-85ad7ebccbcd None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:48.908301 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 440/901] 10.222.0.81 () {56 vars in 1126 bytes} [Tue Sep 6 21:03:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:03:48.911605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-1516fb42-8aaa-472c-ba47-1ee0d2f4f0f5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 21:03:48.911605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:48.911605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:48.911605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:48.911605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:48.911605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:48.911605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:48.911605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:48.911605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:48.911605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:48.911605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:48.911605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:48.911605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:03:48.911605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:03:48.911605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:03:48.911605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:03:48.913617 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:48.913617 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:48.913617 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:03:48.913617 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:48.913617 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:03:48.913617 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:48.913617 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:48.913617 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:48.913617 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:48.913617 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:48.913617 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:48.913617 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:48.913617 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:48.913617 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:48.913617 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:48.913617 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:48.913617 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:48.913617 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:48.914612 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:48.914612 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:48.914612 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:03:48.914612 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:03:48.914612 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:03:48.914612 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:03:48.914612 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:03:48.914612 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:03:48.914612 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 21:03:48.914612 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:48.914612 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 462/902] 10.222.0.81 () {56 vars in 1117 bytes} [Tue Sep 6 21:03:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:03:48.916597 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed4c1e-3400-402c-8ee2-85ad7ebccbcd None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:48.919199 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516fb42-8aaa-472c-ba47-1ee0d2f4f0f5 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:49.018779 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:49.026586 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed4c1e-3400-402c-8ee2-85ad7ebccbcd None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:49.029952 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516fb42-8aaa-472c-ba47-1ee0d2f4f0f5 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:49.049868 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:49.066427 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda6220-eadd-49bd-a77d-26f956f6f908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:49.067559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda6220-eadd-49bd-a77d-26f956f6f908 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:49.068194 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda6220-eadd-49bd-a77d-26f956f6f908 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:49.068691 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda6220-eadd-49bd-a77d-26f956f6f908 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:49.069462 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda6220-eadd-49bd-a77d-26f956f6f908 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:49.069870 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda6220-eadd-49bd-a77d-26f956f6f908 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:49.070728 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4618a4-faf4-4992-a166-31480aa13036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:49.071447 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda6220-eadd-49bd-a77d-26f956f6f908 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:49.071670 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4618a4-faf4-4992-a166-31480aa13036 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:49.072176 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4618a4-faf4-4992-a166-31480aa13036 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:49.072589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4618a4-faf4-4992-a166-31480aa13036 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:49.076861 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4618a4-faf4-4992-a166-31480aa13036 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:49.076861 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4618a4-faf4-4992-a166-31480aa13036 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:49.076861 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4618a4-faf4-4992-a166-31480aa13036 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:49.077855 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 441/903] 10.222.0.81 () {56 vars in 1126 bytes} [Tue Sep 6 21:03:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:49.085166 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda6220-eadd-49bd-a77d-26f956f6f908 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:49.102461 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 463/904] 10.222.0.81 () {56 vars in 1149 bytes} [Tue Sep 6 21:03:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:03:49.104162 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4618a4-faf4-4992-a166-31480aa13036 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:49.203633 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda6220-eadd-49bd-a77d-26f956f6f908 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:49.227713 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4618a4-faf4-4992-a166-31480aa13036 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:49.252732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b599ee1-16ec-4021-9c2c-94cbc5687aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:49.253707 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b599ee1-16ec-4021-9c2c-94cbc5687aef None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:49.254129 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b599ee1-16ec-4021-9c2c-94cbc5687aef None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:49.254544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b599ee1-16ec-4021-9c2c-94cbc5687aef None admin] PATH_INFO: `/v3/endpoints` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:49.255389 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b599ee1-16ec-4021-9c2c-94cbc5687aef None admin] RBAC: Adding query filter params (interface=public, service_id=1145a84862664b73ba5aa08b34526d99, region_id=RegionOne) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:49.255875 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b599ee1-16ec-4021-9c2c-94cbc5687aef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:49.258096 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b599ee1-16ec-4021-9c2c-94cbc5687aef None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:49.269212 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 442/905] 10.222.0.81 () {56 vars in 1251 bytes} [Tue Sep 6 21:03:49 2022] GET /identity/v3/endpoints?service_id=1145a84862664b73ba5aa08b34526d99&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:49.270651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b599ee1-16ec-4021-9c2c-94cbc5687aef None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:49.279568 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b530bfe-1b58-4e84-a56b-41ccda2831f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:49.280451 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b530bfe-1b58-4e84-a56b-41ccda2831f2 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:49.281334 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b530bfe-1b58-4e84-a56b-41ccda2831f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:49.281764 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b530bfe-1b58-4e84-a56b-41ccda2831f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:49.298751 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:49.343328 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:49.372439 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b530bfe-1b58-4e84-a56b-41ccda2831f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:49.375263 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b530bfe-1b58-4e84-a56b-41ccda2831f2 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:49.383278 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b599ee1-16ec-4021-9c2c-94cbc5687aef None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:49.420704 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7af38-481c-4117-b6dd-2362367ef9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:49.421319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7af38-481c-4117-b6dd-2362367ef9a5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:49.421599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7af38-481c-4117-b6dd-2362367ef9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:49.421872 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7af38-481c-4117-b6dd-2362367ef9a5 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:49.422488 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7af38-481c-4117-b6dd-2362367ef9a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:49.423852 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7af38-481c-4117-b6dd-2362367ef9a5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:49.430460 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 443/906] 10.222.0.81 () {56 vars in 1087 bytes} [Tue Sep 6 21:03:49 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:03:49.506993 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 464/907] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:03:49 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 06 21:03:49.512842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7af38-481c-4117-b6dd-2362367ef9a5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:49.630001 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:49.644320 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7af38-481c-4117-b6dd-2362367ef9a5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:49.680115 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae85085-92d6-4368-860d-83b06d6b6a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:49.680777 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae85085-92d6-4368-860d-83b06d6b6a90 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:49.681041 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae85085-92d6-4368-860d-83b06d6b6a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:49.681315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae85085-92d6-4368-860d-83b06d6b6a90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:49.691664 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae85085-92d6-4368-860d-83b06d6b6a90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:49.693118 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae85085-92d6-4368-860d-83b06d6b6a90 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:49.709136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-9ae85085-92d6-4368-860d-83b06d6b6a90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:49.709136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:49.709136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:49.709136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:49.709136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:49.709136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:49.709136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:49.709136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:49.709136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:49.709136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:49.709136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:49.709136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:49.709136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:49.709136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:49.709136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:49.709136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:49.710135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:49.710135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:49.710135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:49.710135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:49.710135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:49.710135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:49.710135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:49.710135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:49.710135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:49.710135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:49.710135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:49.710135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:49.710135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:49.710135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:49.710135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:49.710135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:49.710135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:49.711176 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:49.711176 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:49.711176 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:49.711176 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 444/908] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:03:49.717504 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b530bfe-1b58-4e84-a56b-41ccda2831f2 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:49.795899 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:49.820862 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b530bfe-1b58-4e84-a56b-41ccda2831f2 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:49.856471 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a741c-f369-4853-be59-eca58b25d8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:49.862195 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a741c-f369-4853-be59-eca58b25d8df None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:49.862195 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a741c-f369-4853-be59-eca58b25d8df None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:49.862195 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536a741c-f369-4853-be59-eca58b25d8df None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:49.862195 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a741c-f369-4853-be59-eca58b25d8df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:49.862195 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a741c-f369-4853-be59-eca58b25d8df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:49.862195 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536a741c-f369-4853-be59-eca58b25d8df None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:49.873071 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 465/909] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:49.878400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae85085-92d6-4368-860d-83b06d6b6a90 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:49.987169 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae85085-92d6-4368-860d-83b06d6b6a90 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:50.023070 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc86f89-3894-46bc-b041-8902d419c131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:50.024084 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc86f89-3894-46bc-b041-8902d419c131 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:50.024614 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc86f89-3894-46bc-b041-8902d419c131 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:50.025097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc86f89-3894-46bc-b041-8902d419c131 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:50.032323 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc86f89-3894-46bc-b041-8902d419c131 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:50.034120 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc86f89-3894-46bc-b041-8902d419c131 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:50.046978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-5bc86f89-3894-46bc-b041-8902d419c131 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:50.046978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:50.046978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:50.046978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:50.046978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:50.046978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:50.046978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:50.046978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:50.046978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:50.046978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:50.046978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:50.046978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:50.046978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:03:50.046978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:03:50.046978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:03:50.047907 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:03:50.047907 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:50.047907 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:50.047907 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:50.047907 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:50.047907 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:50.047907 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:50.047907 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:50.047907 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:50.047907 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:50.047907 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:50.047907 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:50.047907 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:50.047907 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:50.047907 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:50.047907 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:50.047907 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:50.048940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:03:50.048940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:03:50.048940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:03:50.048940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:03:50.048940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:03:50.048940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:03:50.048940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:50.048940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:50.051421 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 445/910] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:03:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:50.052391 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:50.057460 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a741c-f369-4853-be59-eca58b25d8df None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:50.164335 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536a741c-f369-4853-be59-eca58b25d8df None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:50.203099 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca6495d-a309-4b87-95c9-1a1108795429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:50.203725 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6495d-a309-4b87-95c9-1a1108795429 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:50.204003 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6495d-a309-4b87-95c9-1a1108795429 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:50.204307 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca6495d-a309-4b87-95c9-1a1108795429 None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:50.205148 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6495d-a309-4b87-95c9-1a1108795429 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:50.205542 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6495d-a309-4b87-95c9-1a1108795429 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:50.207100 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca6495d-a309-4b87-95c9-1a1108795429 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:50.216861 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:50.222479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 466/911] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:03:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:50.228343 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc86f89-3894-46bc-b041-8902d419c131 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:50.344134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc86f89-3894-46bc-b041-8902d419c131 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:50.380393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec46f8c-db46-4f7b-876e-a97aa1d0012a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:50.381074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec46f8c-db46-4f7b-876e-a97aa1d0012a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:50.381995 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec46f8c-db46-4f7b-876e-a97aa1d0012a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:50.382271 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec46f8c-db46-4f7b-876e-a97aa1d0012a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:50.383026 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec46f8c-db46-4f7b-876e-a97aa1d0012a None admin] RBAC: Adding query filter params (role.id=10d5d25768bd401b86eabfddb1dadf98, scope.project.id=002e09339d4e49ce98434571d3b64248, user.id=0ba7376671a24d35a920e0ec3290472b) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:50.383317 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec46f8c-db46-4f7b-876e-a97aa1d0012a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:50.384789 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec46f8c-db46-4f7b-876e-a97aa1d0012a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:50.396247 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 446/912] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:03:50 2022] GET /identity/v3/role_assignments?user.id=0ba7376671a24d35a920e0ec3290472b&scope.project.id=002e09339d4e49ce98434571d3b64248&role.id=10d5d25768bd401b86eabfddb1dadf98 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:50.412371 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc83f8-18a8-4ea7-8286-627242f94b76 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:50.413486 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc83f8-18a8-4ea7-8286-627242f94b76 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:50.413966 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc83f8-18a8-4ea7-8286-627242f94b76 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:50.416144 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 467/913] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:50.422046 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855789ab-a022-4076-88e8-c8a7a240e82a None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:50.422359 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855789ab-a022-4076-88e8-c8a7a240e82a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:50.422614 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855789ab-a022-4076-88e8-c8a7a240e82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:50.443077 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-855789ab-a022-4076-88e8-c8a7a240e82a None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:50.444451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-855789ab-a022-4076-88e8-c8a7a240e82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:50.515711 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:50.526081 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 447/914] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:03:50.802557 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca41e97-8226-46c2-9ba5-dd7362283d81 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:50.802946 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca41e97-8226-46c2-9ba5-dd7362283d81 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:50.803171 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca41e97-8226-46c2-9ba5-dd7362283d81 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:50.803279 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855789ab-a022-4076-88e8-c8a7a240e82a None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:50.804719 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 468/915] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:50.810404 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16542eb8-ebbf-4db1-a7f6-310eb4f47724 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:50.810687 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16542eb8-ebbf-4db1-a7f6-310eb4f47724 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:50.810965 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16542eb8-ebbf-4db1-a7f6-310eb4f47724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:50.829344 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-16542eb8-ebbf-4db1-a7f6-310eb4f47724 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:50.830551 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-16542eb8-ebbf-4db1-a7f6-310eb4f47724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:50.920250 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855789ab-a022-4076-88e8-c8a7a240e82a None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:50.929978 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 469/916] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 21:03:50.963735 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990f4c0-e1f3-4716-80e3-d9c7475cbe68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:50.964752 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990f4c0-e1f3-4716-80e3-d9c7475cbe68 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:50.965231 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990f4c0-e1f3-4716-80e3-d9c7475cbe68 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:50.965717 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3990f4c0-e1f3-4716-80e3-d9c7475cbe68 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:50.966618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990f4c0-e1f3-4716-80e3-d9c7475cbe68 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:50.968204 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3990f4c0-e1f3-4716-80e3-d9c7475cbe68 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:50.977620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-3990f4c0-e1f3-4716-80e3-d9c7475cbe68 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 21:03:50.977620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:50.977620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 21:03:50.977620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 21:03:50.977620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 21:03:50.977620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 21:03:50.977620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 21:03:50.977620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:50.977620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 21:03:50.977620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:50.977620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 21:03:50.977620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:50.977620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:50.977620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:50.977620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:50.977620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:50.977620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:50.978654 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:50.978654 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:50.978654 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:50.978654 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:50.978654 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:50.978654 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:50.978654 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 21:03:50.978654 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 21:03:50.978654 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 21:03:50.978654 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 21:03:50.978654 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:50.978654 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:50.978654 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:50.978654 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:50.978654 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:50.978654 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:50.979496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:50.979496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:50.979496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:50.979496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:50.979496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:50.979496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:50.979496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:50.979496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:50.979496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:50.979496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:50.979496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 21:03:50.979496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:50.979496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 06 21:03:50.979496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:50.982198 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 448/917] 10.222.0.81 () {56 vars in 1114 bytes} [Tue Sep 6 21:03:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:03:50.989267 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16542eb8-ebbf-4db1-a7f6-310eb4f47724 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:51.102871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16542eb8-ebbf-4db1-a7f6-310eb4f47724 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:51.131881 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:51.141103 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110dc70e-9418-487a-bd14-c6d4ef08b9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:51.142058 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110dc70e-9418-487a-bd14-c6d4ef08b9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:51.142537 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110dc70e-9418-487a-bd14-c6d4ef08b9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:51.143028 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110dc70e-9418-487a-bd14-c6d4ef08b9f4 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:51.143851 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110dc70e-9418-487a-bd14-c6d4ef08b9f4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:51.144478 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110dc70e-9418-487a-bd14-c6d4ef08b9f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:51.161680 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110dc70e-9418-487a-bd14-c6d4ef08b9f4 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:51.161680 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 470/918] 10.222.0.81 () {56 vars in 1114 bytes} [Tue Sep 6 21:03:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:51.161882 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990f4c0-e1f3-4716-80e3-d9c7475cbe68 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:51.237098 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:51.244137 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110dc70e-9418-487a-bd14-c6d4ef08b9f4 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:51.294103 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3990f4c0-e1f3-4716-80e3-d9c7475cbe68 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:51.333528 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf71a4-2c0c-45eb-b486-2831adadaab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:51.334175 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf71a4-2c0c-45eb-b486-2831adadaab8 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:51.334993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf71a4-2c0c-45eb-b486-2831adadaab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:51.335273 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf71a4-2c0c-45eb-b486-2831adadaab8 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:51.336603 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf71a4-2c0c-45eb-b486-2831adadaab8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:51.337159 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf71a4-2c0c-45eb-b486-2831adadaab8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:51.338740 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf71a4-2c0c-45eb-b486-2831adadaab8 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:51.349645 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 449/919] 10.222.0.81 () {56 vars in 1114 bytes} [Tue Sep 6 21:03:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:51.351331 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf71a4-2c0c-45eb-b486-2831adadaab8 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:51.373384 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110dc70e-9418-487a-bd14-c6d4ef08b9f4 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:51.420951 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0b342-c621-47b0-95bc-5cc33cb53ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:51.421595 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0b342-c621-47b0-95bc-5cc33cb53ac5 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:51.421875 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0b342-c621-47b0-95bc-5cc33cb53ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:51.422147 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0b342-c621-47b0-95bc-5cc33cb53ac5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:51.422734 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0b342-c621-47b0-95bc-5cc33cb53ac5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:51.424156 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0b342-c621-47b0-95bc-5cc33cb53ac5 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:51.434852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-1cd0b342-c621-47b0-95bc-5cc33cb53ac5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 21:03:51.434852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:51.434852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 21:03:51.434852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 21:03:51.434852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 21:03:51.434852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 21:03:51.434852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 21:03:51.434852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:51.434852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 21:03:51.434852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:51.434852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 21:03:51.434852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:51.434852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:51.434852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:51.434852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:51.434852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:51.434852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:51.435871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:51.435871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:51.435871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:51.435871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:51.435871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:51.435871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:51.435871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 21:03:51.435871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 21:03:51.435871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 21:03:51.435871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 21:03:51.435871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:51.435871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:51.435871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:51.435871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:51.435871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:51.435871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:51.436743 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:51.436743 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:51.436743 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:51.436743 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:51.436743 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:51.436743 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:51.436743 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:51.436743 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:51.436743 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:51.436743 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:51.436743 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 21:03:51.436743 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:51.436743 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 21:03:51.436743 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:51.441388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 471/920] 10.222.0.81 () {56 vars in 1126 bytes} [Tue Sep 6 21:03:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:51.442290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0b342-c621-47b0-95bc-5cc33cb53ac5 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:51.489680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf71a4-2c0c-45eb-b486-2831adadaab8 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:51.508468 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:51.515565 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:51.528554 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef256e1d-cb13-4968-8df7-bb3a32e4a786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:51.529494 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef256e1d-cb13-4968-8df7-bb3a32e4a786 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:51.530003 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef256e1d-cb13-4968-8df7-bb3a32e4a786 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:51.530478 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef256e1d-cb13-4968-8df7-bb3a32e4a786 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:51.531389 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef256e1d-cb13-4968-8df7-bb3a32e4a786 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:51.532993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef256e1d-cb13-4968-8df7-bb3a32e4a786 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:51.557373 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0b342-c621-47b0-95bc-5cc33cb53ac5 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:51.593555 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133357a-e058-438a-a9f8-81ffdaf77cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:51.598271 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133357a-e058-438a-a9f8-81ffdaf77cda None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:51.598271 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133357a-e058-438a-a9f8-81ffdaf77cda None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:51.598271 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133357a-e058-438a-a9f8-81ffdaf77cda None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:51.598271 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133357a-e058-438a-a9f8-81ffdaf77cda None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:51.598271 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133357a-e058-438a-a9f8-81ffdaf77cda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:51.598271 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c133357a-e058-438a-a9f8-81ffdaf77cda None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:51.602597 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 472/921] 10.222.0.81 () {56 vars in 1122 bytes} [Tue Sep 6 21:03:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:51.607988 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133357a-e058-438a-a9f8-81ffdaf77cda None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:51.636410 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 450/922] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:03:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:03:51.734028 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133357a-e058-438a-a9f8-81ffdaf77cda None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:51.753719 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:51.769939 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d4cee-97a7-4be0-986f-da2638a725d4 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:51.774701 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d4cee-97a7-4be0-986f-da2638a725d4 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:51.774701 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d4cee-97a7-4be0-986f-da2638a725d4 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:51.774701 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 451/923] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:03:51.779222 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e16855-f99b-4020-a639-7c952dfcb047 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:51.779808 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e16855-f99b-4020-a639-7c952dfcb047 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:51.780352 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e16855-f99b-4020-a639-7c952dfcb047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:51.780688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29b5f9-9773-4f04-805d-d70c47bce079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:51.781319 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29b5f9-9773-4f04-805d-d70c47bce079 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:51.781595 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29b5f9-9773-4f04-805d-d70c47bce079 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:51.781866 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e29b5f9-9773-4f04-805d-d70c47bce079 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:51.782507 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29b5f9-9773-4f04-805d-d70c47bce079 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:51.782817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29b5f9-9773-4f04-805d-d70c47bce079 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:51.784258 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e29b5f9-9773-4f04-805d-d70c47bce079 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:51.790521 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 473/924] 10.222.0.81 () {56 vars in 1122 bytes} [Tue Sep 6 21:03:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:03:51.796299 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29b5f9-9773-4f04-805d-d70c47bce079 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:51.805068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-c1e16855-f99b-4020-a639-7c952dfcb047 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:51.806331 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c1e16855-f99b-4020-a639-7c952dfcb047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:51.888042 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 452/925] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 21:03:51.916217 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e29b5f9-9773-4f04-805d-d70c47bce079 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:51.951033 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a004796-65e3-46d6-bf2e-79b99bc0fd71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:51.951644 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a004796-65e3-46d6-bf2e-79b99bc0fd71 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:51.951919 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a004796-65e3-46d6-bf2e-79b99bc0fd71 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:51.952216 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a004796-65e3-46d6-bf2e-79b99bc0fd71 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:51.952910 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a004796-65e3-46d6-bf2e-79b99bc0fd71 None admin] RBAC: Adding query filter params (interface=public, service_id=a922444f582f423a805812a42888c37a, region_id=RegionOne) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:51.953215 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a004796-65e3-46d6-bf2e-79b99bc0fd71 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:51.954572 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a004796-65e3-46d6-bf2e-79b99bc0fd71 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:51.960172 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 474/926] 10.222.0.81 () {56 vars in 1251 bytes} [Tue Sep 6 21:03:51 2022] GET /identity/v3/endpoints?service_id=a922444f582f423a805812a42888c37a&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:03:51.965909 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e16855-f99b-4020-a639-7c952dfcb047 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:52.070700 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e16855-f99b-4020-a639-7c952dfcb047 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:52.081010 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:52.107588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e843a7-c997-42cb-9da4-b9a07ad0ae6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:52.108234 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e843a7-c997-42cb-9da4-b9a07ad0ae6c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:52.108521 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e843a7-c997-42cb-9da4-b9a07ad0ae6c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:52.108794 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e843a7-c997-42cb-9da4-b9a07ad0ae6c None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:52.109408 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e843a7-c997-42cb-9da4-b9a07ad0ae6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:52.110780 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e843a7-c997-42cb-9da4-b9a07ad0ae6c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:52.117350 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 453/927] 10.222.0.81 () {56 vars in 1087 bytes} [Tue Sep 6 21:03:51 2022] GET /identity/v3/services => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:03:52.197251 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a004796-65e3-46d6-bf2e-79b99bc0fd71 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:52.252583 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:52.317946 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a004796-65e3-46d6-bf2e-79b99bc0fd71 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:52.360422 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f46a0b-658c-40a2-a142-b1d9b65b319c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:52.361075 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f46a0b-658c-40a2-a142-b1d9b65b319c None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:52.361357 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f46a0b-658c-40a2-a142-b1d9b65b319c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:52.361632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f46a0b-658c-40a2-a142-b1d9b65b319c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:52.362224 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f46a0b-658c-40a2-a142-b1d9b65b319c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:52.363593 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f46a0b-658c-40a2-a142-b1d9b65b319c None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:52.373319 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-85f46a0b-658c-40a2-a142-b1d9b65b319c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 21:03:52.373319 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:52.373319 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 21:03:52.373319 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 21:03:52.373319 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 21:03:52.373319 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 21:03:52.373319 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 21:03:52.373319 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:52.373319 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 21:03:52.373319 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:52.373319 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 21:03:52.373319 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:52.373319 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:52.373319 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:52.373319 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:52.373319 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:52.374278 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:52.374278 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:52.374278 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:52.374278 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:52.374278 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:52.374278 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:52.374278 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:52.374278 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 21:03:52.374278 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 21:03:52.374278 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 21:03:52.374278 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 21:03:52.374278 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:52.374278 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:52.374278 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:52.374278 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:52.374278 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:52.374278 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:52.375193 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:52.375193 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:52.375193 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:52.375193 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:52.375193 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:52.375193 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:52.375193 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:52.375193 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:52.375193 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:52.375193 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:52.375193 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 21:03:52.375193 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:52.375193 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 06 21:03:52.375193 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:52.375193 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 475/928] 10.222.0.81 () {56 vars in 1132 bytes} [Tue Sep 6 21:03:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:52.383210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e843a7-c997-42cb-9da4-b9a07ad0ae6c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:52.492584 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e843a7-c997-42cb-9da4-b9a07ad0ae6c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:52.530924 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9153458-6dc5-486a-842a-c4dd4e0a2e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:52.531609 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9153458-6dc5-486a-842a-c4dd4e0a2e7d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:52.531895 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9153458-6dc5-486a-842a-c4dd4e0a2e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:52.532206 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9153458-6dc5-486a-842a-c4dd4e0a2e7d None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:52.532930 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9153458-6dc5-486a-842a-c4dd4e0a2e7d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:52.533242 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9153458-6dc5-486a-842a-c4dd4e0a2e7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:52.534682 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9153458-6dc5-486a-842a-c4dd4e0a2e7d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:52.541080 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 454/929] 10.222.0.81 () {56 vars in 1126 bytes} [Tue Sep 6 21:03:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:52.553802 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f46a0b-658c-40a2-a142-b1d9b65b319c None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:52.667293 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca35bbc-0075-4f27-b773-0179f3b12b0c None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:52.667651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca35bbc-0075-4f27-b773-0179f3b12b0c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:52.667853 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca35bbc-0075-4f27-b773-0179f3b12b0c None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:52.669523 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 455/930] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:52.672864 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f46a0b-658c-40a2-a142-b1d9b65b319c None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:52.676028 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6486d9f-cfa7-4891-a7f5-e10d09cf4694 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:52.676344 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6486d9f-cfa7-4891-a7f5-e10d09cf4694 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:52.676624 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6486d9f-cfa7-4891-a7f5-e10d09cf4694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:52.684446 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:52.697613 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-e6486d9f-cfa7-4891-a7f5-e10d09cf4694 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:52.699270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e6486d9f-cfa7-4891-a7f5-e10d09cf4694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:52.720920 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4cf8e8-0df8-4160-aaf9-49a274d13246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:52.721946 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4cf8e8-0df8-4160-aaf9-49a274d13246 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:52.722752 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4cf8e8-0df8-4160-aaf9-49a274d13246 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:52.723640 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4cf8e8-0df8-4160-aaf9-49a274d13246 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:52.724525 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4cf8e8-0df8-4160-aaf9-49a274d13246 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:52.725114 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4cf8e8-0df8-4160-aaf9-49a274d13246 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:52.727775 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4cf8e8-0df8-4160-aaf9-49a274d13246 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:52.735525 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 476/931] 10.222.0.81 () {56 vars in 1126 bytes} [Tue Sep 6 21:03:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:52.740996 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4cf8e8-0df8-4160-aaf9-49a274d13246 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:52.741693 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:52.791689 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 456/932] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:03:52.859135 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4cf8e8-0df8-4160-aaf9-49a274d13246 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:52.897232 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7164d99-f5cb-4123-9727-ff36f1e10e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:52.898154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7164d99-f5cb-4123-9727-ff36f1e10e5e None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:52.898590 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7164d99-f5cb-4123-9727-ff36f1e10e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:52.899064 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7164d99-f5cb-4123-9727-ff36f1e10e5e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:52.904076 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7164d99-f5cb-4123-9727-ff36f1e10e5e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:52.904076 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7164d99-f5cb-4123-9727-ff36f1e10e5e None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:53.023014 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 477/933] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:03:52 2022] POST /identity/v3/endpoints => generated 347 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:03:53.060756 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6486d9f-cfa7-4891-a7f5-e10d09cf4694 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:53.189465 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6486d9f-cfa7-4891-a7f5-e10d09cf4694 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:53.239928 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c3894-4b71-408e-bbd4-47a2ee524234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:53.241158 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c3894-4b71-408e-bbd4-47a2ee524234 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:53.241425 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c3894-4b71-408e-bbd4-47a2ee524234 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:53.241702 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c3894-4b71-408e-bbd4-47a2ee524234 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:53.267410 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c3894-4b71-408e-bbd4-47a2ee524234 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:03:53.273336 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-fe0c3894-4b71-408e-bbd4-47a2ee524234 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 21:03:53.273336 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:53.273336 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:53.273336 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:53.273336 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:53.273336 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:53.273336 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:53.273336 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:53.273336 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:53.273336 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:53.273336 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:53.273336 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:53.273336 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:03:53.273336 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:03:53.273336 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:03:53.273336 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:03:53.274546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:03:53.274546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:03:53.274546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:03:53.274546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:03:53.274546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:53.274546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:53.274546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:53.274546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:53.274546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:53.274546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:53.274546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:53.274546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:53.274546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:53.274546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:53.274546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:53.274546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:53.275645 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:53.275645 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:53.275645 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:53.275645 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:53.275645 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:03:53.275645 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:03:53.275645 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:03:53.275645 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:03:53.275645 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:03:53.275645 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:03:53.275645 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 21:03:53.275645 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:53.275645 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 457/934] 10.222.0.81 () {56 vars in 1120 bytes} [Tue Sep 6 21:03:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:53.280076 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7164d99-f5cb-4123-9727-ff36f1e10e5e None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:53.318825 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:53.411010 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7164d99-f5cb-4123-9727-ff36f1e10e5e None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:53.448625 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45cb488-b0f1-45cb-8b0a-8f627ed0093a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:53.449590 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cb488-b0f1-45cb-8b0a-8f627ed0093a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:53.450055 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cb488-b0f1-45cb-8b0a-8f627ed0093a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:53.450603 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cb488-b0f1-45cb-8b0a-8f627ed0093a None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:53.451459 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45cb488-b0f1-45cb-8b0a-8f627ed0093a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:53.451949 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45cb488-b0f1-45cb-8b0a-8f627ed0093a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:53.453529 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45cb488-b0f1-45cb-8b0a-8f627ed0093a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:53.465071 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 478/935] 10.222.0.81 () {56 vars in 1115 bytes} [Tue Sep 6 21:03:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:53.471022 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c3894-4b71-408e-bbd4-47a2ee524234 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:53.498918 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:53.588145 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c3894-4b71-408e-bbd4-47a2ee524234 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:53.625320 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eaf9e6-daad-4ce3-a84d-eb0c4ce84baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:53.626300 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaf9e6-daad-4ce3-a84d-eb0c4ce84baa None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:53.626769 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaf9e6-daad-4ce3-a84d-eb0c4ce84baa None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:53.627314 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eaf9e6-daad-4ce3-a84d-eb0c4ce84baa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:53.639073 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eaf9e6-daad-4ce3-a84d-eb0c4ce84baa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:53.640868 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eaf9e6-daad-4ce3-a84d-eb0c4ce84baa None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:53.657355 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-f6eaf9e6-daad-4ce3-a84d-eb0c4ce84baa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:53.657355 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:53.657355 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:53.657355 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:53.657355 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:53.657355 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:53.657355 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:53.657355 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:53.657355 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:53.657355 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:53.657355 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:53.657355 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:53.657355 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:53.657355 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:53.657355 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:53.657355 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:53.658407 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:53.658407 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:53.658407 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:53.658407 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:53.658407 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:53.658407 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:53.658407 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:53.658407 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:53.658407 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:53.658407 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:53.658407 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:53.658407 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:53.658407 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:53.658407 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:53.658407 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:53.658407 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:53.658407 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:53.659328 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:53.659328 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:53.659328 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:53.661280 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 458/936] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:03:53.668056 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45cb488-b0f1-45cb-8b0a-8f627ed0093a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:53.770979 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:53.784240 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45cb488-b0f1-45cb-8b0a-8f627ed0093a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:53.826850 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e092d05-221b-48bb-ab84-f206607ca7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:53.827479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e092d05-221b-48bb-ab84-f206607ca7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:53.827755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e092d05-221b-48bb-ab84-f206607ca7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:53.828028 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e092d05-221b-48bb-ab84-f206607ca7d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:53.828718 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e092d05-221b-48bb-ab84-f206607ca7d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:53.829021 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e092d05-221b-48bb-ab84-f206607ca7d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:53.830386 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e092d05-221b-48bb-ab84-f206607ca7d7 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:53.843244 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 479/937] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:53.848995 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eaf9e6-daad-4ce3-a84d-eb0c4ce84baa None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:53.937767 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:53.965574 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eaf9e6-daad-4ce3-a84d-eb0c4ce84baa None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:54.002475 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e105c354-218b-47cd-8cc3-0e8c8052b16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:54.003118 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105c354-218b-47cd-8cc3-0e8c8052b16b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:54.003403 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105c354-218b-47cd-8cc3-0e8c8052b16b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:54.003677 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e105c354-218b-47cd-8cc3-0e8c8052b16b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:54.012131 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105c354-218b-47cd-8cc3-0e8c8052b16b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:54.013600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e105c354-218b-47cd-8cc3-0e8c8052b16b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:54.025852 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-e105c354-218b-47cd-8cc3-0e8c8052b16b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 21:03:54.025852 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:54.025852 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:54.025852 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:54.025852 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:54.025852 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:54.025852 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:54.025852 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:54.025852 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:54.025852 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:54.025852 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:54.025852 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:54.025852 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:03:54.025852 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:03:54.025852 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:03:54.025852 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:03:54.026887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:54.026887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:54.026887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:03:54.026887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:54.026887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:03:54.026887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:54.026887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:54.026887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:54.026887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:54.026887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:54.026887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:54.026887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:54.026887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:54.026887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:54.026887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:54.026887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:54.026887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:54.026887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:54.027849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:54.027849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:54.027849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:03:54.027849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:03:54.027849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:03:54.027849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:03:54.027849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:03:54.027849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:03:54.027849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 21:03:54.027849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:54.027849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 459/938] 10.222.0.81 () {56 vars in 1117 bytes} [Tue Sep 6 21:03:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:54.033267 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e092d05-221b-48bb-ab84-f206607ca7d7 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:54.050985 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b8600-27aa-4c89-bd16-8a6bf4156bde None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:54.051302 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b8600-27aa-4c89-bd16-8a6bf4156bde None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:54.051543 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b8600-27aa-4c89-bd16-8a6bf4156bde None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:54.053840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 460/939] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:03:54.059949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf1f9c-f628-448f-96e8-abe152d33ed2 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:54.060268 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf1f9c-f628-448f-96e8-abe152d33ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:54.060599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf1f9c-f628-448f-96e8-abe152d33ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:54.081671 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-30bf1f9c-f628-448f-96e8-abe152d33ed2 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:54.082445 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-30bf1f9c-f628-448f-96e8-abe152d33ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:54.156780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e092d05-221b-48bb-ab84-f206607ca7d7 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:54.165021 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 461/940] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 21:03:54.198520 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed593ed2-c437-4e75-a515-a721f97f2484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:54.199383 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed593ed2-c437-4e75-a515-a721f97f2484 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:54.199816 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed593ed2-c437-4e75-a515-a721f97f2484 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:54.200285 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed593ed2-c437-4e75-a515-a721f97f2484 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:54.201237 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed593ed2-c437-4e75-a515-a721f97f2484 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:54.201704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed593ed2-c437-4e75-a515-a721f97f2484 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:54.203360 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed593ed2-c437-4e75-a515-a721f97f2484 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:54.222272 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 480/941] 10.222.0.81 () {56 vars in 1149 bytes} [Tue Sep 6 21:03:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:03:54.228821 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf1f9c-f628-448f-96e8-abe152d33ed2 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:54.300591 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:54.333301 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf1f9c-f628-448f-96e8-abe152d33ed2 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:54.369587 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c43892-2551-4252-bb12-95ec690b5ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:54.370457 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c43892-2551-4252-bb12-95ec690b5ae0 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:54.370920 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c43892-2551-4252-bb12-95ec690b5ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:54.371415 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c43892-2551-4252-bb12-95ec690b5ae0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:54.381962 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c43892-2551-4252-bb12-95ec690b5ae0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:54.383619 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c43892-2551-4252-bb12-95ec690b5ae0 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:54.399757 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-32c43892-2551-4252-bb12-95ec690b5ae0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:54.399757 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:54.399757 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:54.399757 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:54.399757 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:54.399757 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:54.399757 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:54.399757 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:54.399757 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:54.399757 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:54.399757 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:54.399757 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:54.399757 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:54.399757 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:54.399757 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:54.399757 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:54.400988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:54.400988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:54.400988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:54.400988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:54.400988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:54.400988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:54.400988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:54.400988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:54.400988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:54.400988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:54.400988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:54.400988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:54.400988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:54.400988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:54.400988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:54.400988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:54.400988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:54.402131 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:54.402131 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:54.402131 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:54.403902 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 462/942] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:54.409876 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed593ed2-c437-4e75-a515-a721f97f2484 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:54.420449 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:54.437379 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c43892-2551-4252-bb12-95ec690b5ae0 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:54.530949 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed593ed2-c437-4e75-a515-a721f97f2484 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:54.560036 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c43892-2551-4252-bb12-95ec690b5ae0 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:54.573720 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b21608-7b5e-4bd7-bb6a-d495b778d0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:54.574518 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b21608-7b5e-4bd7-bb6a-d495b778d0ce None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:54.574901 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b21608-7b5e-4bd7-bb6a-d495b778d0ce None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:54.575275 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b21608-7b5e-4bd7-bb6a-d495b778d0ce None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:54.576325 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b21608-7b5e-4bd7-bb6a-d495b778d0ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:54.576607 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b21608-7b5e-4bd7-bb6a-d495b778d0ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:54.578197 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b21608-7b5e-4bd7-bb6a-d495b778d0ce None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:54.580623 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:54.597233 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 481/943] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:54.598703 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b21608-7b5e-4bd7-bb6a-d495b778d0ce None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:54.610675 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ac28e-9faf-4f6a-a1cd-49f0c8ad556d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:54.611300 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ac28e-9faf-4f6a-a1cd-49f0c8ad556d None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:54.611582 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ac28e-9faf-4f6a-a1cd-49f0c8ad556d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:54.611851 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ac28e-9faf-4f6a-a1cd-49f0c8ad556d None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:54.612553 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ac28e-9faf-4f6a-a1cd-49f0c8ad556d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:54.613989 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ac28e-9faf-4f6a-a1cd-49f0c8ad556d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:54.616732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: WARNING keystone.server.flask.common [None req-992ac28e-9faf-4f6a-a1cd-49f0c8ad556d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 06 21:03:54.666804 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.sql.core [None req-992ac28e-9faf-4f6a-a1cd-49f0c8ad556d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 06 21:03:54.666804 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 06 21:03:54.666804 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [parameters: {'id': 'f3f6532146854ad495020c8fa0083512', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 06 21:03:54.666804 dv-cinder-749155-11-smb devstack@keystone.service[81778]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81778) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 06 21:03:54.674480 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-992ac28e-9faf-4f6a-a1cd-49f0c8ad556d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f3f6532146854ad495020c8fa0083512.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f3f6532146854ad495020c8fa0083512. Sep 06 21:03:54.674480 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:54.674480 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 21:03:54.674480 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 21:03:54.674480 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 21:03:54.674480 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 21:03:54.674480 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 21:03:54.674480 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 21:03:54.674480 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 21:03:54.674480 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application conn.query(q) Sep 06 21:03:54.674480 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 21:03:54.674480 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 21:03:54.674480 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 21:03:54.677599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application result.read() Sep 06 21:03:54.677599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 21:03:54.677599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 21:03:54.677599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 21:03:54.677599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 21:03:54.677599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 21:03:54.677599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 21:03:54.677599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 21:03:54.677599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 21:03:54.677599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 06 21:03:54.677599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:54.677599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 06 21:03:54.677599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:54.677599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:54.677599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 06 21:03:54.677599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 06 21:03:54.677599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 06 21:03:54.677599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 06 21:03:54.678626 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 21:03:54.678626 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application next(self.gen) Sep 06 21:03:54.678626 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 06 21:03:54.678626 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application yield resource Sep 06 21:03:54.678626 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 21:03:54.678626 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application next(self.gen) Sep 06 21:03:54.678626 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 06 21:03:54.678626 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self.session.rollback() Sep 06 21:03:54.678626 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 21:03:54.678626 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self.force_reraise() Sep 06 21:03:54.678626 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 21:03:54.678626 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise self.value Sep 06 21:03:54.678626 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 06 21:03:54.678626 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 06 21:03:54.678626 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 06 21:03:54.678626 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application session.commit() Sep 06 21:03:54.678626 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 06 21:03:54.679561 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 06 21:03:54.679561 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 06 21:03:54.679561 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._prepare_impl() Sep 06 21:03:54.679561 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 06 21:03:54.679561 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self.session.flush() Sep 06 21:03:54.679561 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 06 21:03:54.679561 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._flush(objects) Sep 06 21:03:54.679561 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 06 21:03:54.679561 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 06 21:03:54.679561 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 06 21:03:54.679561 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application compat.raise_( Sep 06 21:03:54.679561 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 21:03:54.679561 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception Sep 06 21:03:54.679561 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 06 21:03:54.679561 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application flush_context.execute() Sep 06 21:03:54.679561 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 06 21:03:54.679561 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rec.execute(self) Sep 06 21:03:54.680514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 06 21:03:54.680514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 06 21:03:54.680514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 06 21:03:54.680514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 06 21:03:54.680514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 06 21:03:54.680514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 06 21:03:54.680514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 06 21:03:54.680514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 06 21:03:54.680514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 06 21:03:54.680514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 06 21:03:54.680514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 06 21:03:54.680514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 06 21:03:54.680514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 06 21:03:54.680514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 06 21:03:54.680514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 06 21:03:54.681715 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 06 21:03:54.681715 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 21:03:54.681715 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception Sep 06 21:03:54.681715 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 21:03:54.681715 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 21:03:54.681715 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 21:03:54.681715 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 21:03:54.681715 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 21:03:54.681715 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 21:03:54.681715 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 21:03:54.681715 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application conn.query(q) Sep 06 21:03:54.681715 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 21:03:54.681715 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 21:03:54.681715 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 21:03:54.681715 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application result.read() Sep 06 21:03:54.681715 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 21:03:54.681715 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 21:03:54.682807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 21:03:54.682807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 21:03:54.682807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 21:03:54.682807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 21:03:54.682807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 21:03:54.682807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 21:03:54.682807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 06 21:03:54.682807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 06 21:03:54.682807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [parameters: {'id': 'f3f6532146854ad495020c8fa0083512', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 06 21:03:54.682807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 06 21:03:54.682807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:54.682807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 21:03:54.682807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:54.682807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:54.682807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 06 21:03:54.683799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 06 21:03:54.683799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 06 21:03:54.683799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 06 21:03:54.683799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 06 21:03:54.683799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:54.683799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 21:03:54.683799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:54.683799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:54.683799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:54.683799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:54.683799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:54.683799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:54.683799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:54.683799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:54.683799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:54.683799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:54.683799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:54.684952 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:54.684952 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 06 21:03:54.684952 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 06 21:03:54.684952 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:54.684952 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:54.684952 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 06 21:03:54.684952 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 06 21:03:54.684952 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f3f6532146854ad495020c8fa0083512. Sep 06 21:03:54.684952 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:54.684952 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 463/944] 10.222.0.81 () {60 vars in 1140 bytes} [Tue Sep 6 21:03:54 2022] POST /identity/v3/projects => generated 262 bytes in 239 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:03:54.688896 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ac28e-9faf-4f6a-a1cd-49f0c8ad556d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:54.689136 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:54.726863 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b21608-7b5e-4bd7-bb6a-d495b778d0ce None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:54.762530 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d9d0d-4f97-4ac1-aa39-d26deb4b2716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:54.763390 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d9d0d-4f97-4ac1-aa39-d26deb4b2716 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:54.763824 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d9d0d-4f97-4ac1-aa39-d26deb4b2716 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:54.764278 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d9d0d-4f97-4ac1-aa39-d26deb4b2716 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:54.771692 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d9d0d-4f97-4ac1-aa39-d26deb4b2716 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:54.774005 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d9d0d-4f97-4ac1-aa39-d26deb4b2716 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:54.786374 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-b35d9d0d-4f97-4ac1-aa39-d26deb4b2716 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:54.786374 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:54.786374 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:54.786374 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:54.786374 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:54.786374 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:54.786374 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:54.786374 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:54.786374 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:54.786374 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:54.786374 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:54.786374 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:54.786374 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:03:54.786374 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:03:54.786374 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:03:54.787411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:03:54.787411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:54.787411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:54.787411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:54.787411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:54.787411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:54.787411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:54.787411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:54.787411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:54.787411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:54.787411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:54.787411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:54.787411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:54.787411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:54.787411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:54.787411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:54.787411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:54.788611 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:03:54.788611 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:03:54.788611 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:03:54.788611 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:03:54.788611 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:03:54.788611 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:03:54.788611 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:54.788611 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:54.795547 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 482/945] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:03:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:54.796605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d9d0d-4f97-4ac1-aa39-d26deb4b2716 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:54.804601 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ac28e-9faf-4f6a-a1cd-49f0c8ad556d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:54.842411 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3e69c-420b-4073-9cfc-9e2159b5389e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:54.843215 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3e69c-420b-4073-9cfc-9e2159b5389e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:54.843892 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3e69c-420b-4073-9cfc-9e2159b5389e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:54.844043 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3e69c-420b-4073-9cfc-9e2159b5389e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:54.851819 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3e69c-420b-4073-9cfc-9e2159b5389e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:54.853702 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3e69c-420b-4073-9cfc-9e2159b5389e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:54.867651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-9bb3e69c-420b-4073-9cfc-9e2159b5389e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:54.867651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:54.867651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:54.867651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:54.867651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:54.867651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:54.867651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:54.867651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:54.867651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:54.867651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:54.867651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:54.867651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:54.867651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:03:54.867651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:03:54.867651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:03:54.868864 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:03:54.868864 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:54.868864 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:54.868864 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:54.868864 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:54.868864 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:54.868864 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:54.868864 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:54.868864 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:54.868864 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:54.868864 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:54.868864 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:54.868864 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:54.868864 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:54.868864 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:54.868864 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:54.868864 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:54.870017 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:03:54.870017 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:03:54.870017 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:03:54.870017 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:03:54.870017 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:03:54.870017 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:03:54.870017 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:54.870017 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:54.877084 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 464/946] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:03:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:54.878979 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3e69c-420b-4073-9cfc-9e2159b5389e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:54.914505 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d9d0d-4f97-4ac1-aa39-d26deb4b2716 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:54.917655 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:54.942631 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:54.951342 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aafd91-3979-43c5-9d90-a49a17cc89b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:54.951933 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aafd91-3979-43c5-9d90-a49a17cc89b9 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:54.952045 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aafd91-3979-43c5-9d90-a49a17cc89b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:54.952354 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aafd91-3979-43c5-9d90-a49a17cc89b9 None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:54.953054 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aafd91-3979-43c5-9d90-a49a17cc89b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:54.953375 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aafd91-3979-43c5-9d90-a49a17cc89b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:54.954806 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aafd91-3979-43c5-9d90-a49a17cc89b9 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:54.967652 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 483/947] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:03:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:54.973521 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aafd91-3979-43c5-9d90-a49a17cc89b9 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:55.003966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3e69c-420b-4073-9cfc-9e2159b5389e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:55.041238 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d902af62-4210-4bb9-b131-f61baa928538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:55.041855 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902af62-4210-4bb9-b131-f61baa928538 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:55.042140 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902af62-4210-4bb9-b131-f61baa928538 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:55.042420 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d902af62-4210-4bb9-b131-f61baa928538 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:55.043090 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902af62-4210-4bb9-b131-f61baa928538 None admin] RBAC: Adding query filter params (name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:55.043398 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902af62-4210-4bb9-b131-f61baa928538 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:55.044868 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d902af62-4210-4bb9-b131-f61baa928538 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:55.064779 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 465/948] 10.222.0.81 () {56 vars in 1112 bytes} [Tue Sep 6 21:03:54 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:55.066104 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e102e-4188-4f9c-99e5-06a47aa3061a None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:55.066393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e102e-4188-4f9c-99e5-06a47aa3061a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:55.066670 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e102e-4188-4f9c-99e5-06a47aa3061a None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:55.068051 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 466/949] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:55.073759 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0f342-f618-4a0a-9d40-3cb630ff3812 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:55.074043 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0f342-f618-4a0a-9d40-3cb630ff3812 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:55.074323 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0f342-f618-4a0a-9d40-3cb630ff3812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:55.095986 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aafd91-3979-43c5-9d90-a49a17cc89b9 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:55.098668 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-44b0f342-f618-4a0a-9d40-3cb630ff3812 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:55.101425 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-44b0f342-f618-4a0a-9d40-3cb630ff3812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:55.140233 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ef0f9-f289-4804-9842-6c3c82f1d334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:55.141043 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ef0f9-f289-4804-9842-6c3c82f1d334 None admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:55.141322 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ef0f9-f289-4804-9842-6c3c82f1d334 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:55.141595 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ef0f9-f289-4804-9842-6c3c82f1d334 None admin] PATH_INFO: `/v3/projects/002e09339d4e49ce98434571d3b64248/users/0ba7376671a24d35a920e0ec3290472b/roles/10d5d25768bd401b86eabfddb1dadf98` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:55.144353 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ef0f9-f289-4804-9842-6c3c82f1d334 None admin] RBAC: Authorizing `identity:create_grant(project_id=002e09339d4e49ce98434571d3b64248, user_id=0ba7376671a24d35a920e0ec3290472b, role_id=10d5d25768bd401b86eabfddb1dadf98)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:55.145810 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ef0f9-f289-4804-9842-6c3c82f1d334 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:55.187287 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 467/950] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 21:03:55.234714 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 484/951] 10.222.0.81 () {58 vars in 1439 bytes} [Tue Sep 6 21:03:54 2022] PUT /identity/v3/projects/002e09339d4e49ce98434571d3b64248/users/0ba7376671a24d35a920e0ec3290472b/roles/10d5d25768bd401b86eabfddb1dadf98 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:03:55.468342 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0f342-f618-4a0a-9d40-3cb630ff3812 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:55.492993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:55.532816 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619e2af-6b0a-4992-a794-30e36d308bbe None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:55.533360 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619e2af-6b0a-4992-a794-30e36d308bbe None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:55.533360 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619e2af-6b0a-4992-a794-30e36d308bbe None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:55.534991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 485/952] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:03:55.540353 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdaaba-3d29-466d-935d-517c0ae36cc0 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:55.540635 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdaaba-3d29-466d-935d-517c0ae36cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:55.540907 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcdaaba-3d29-466d-935d-517c0ae36cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:55.559740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-fbcdaaba-3d29-466d-935d-517c0ae36cc0 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:55.560983 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-fbcdaaba-3d29-466d-935d-517c0ae36cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:55.578639 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0f342-f618-4a0a-9d40-3cb630ff3812 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:55.607882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:55.614718 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b6995-127f-468c-9a01-cb02cdd4f3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:55.616144 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b6995-127f-468c-9a01-cb02cdd4f3df None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:55.616333 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b6995-127f-468c-9a01-cb02cdd4f3df None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:55.616553 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b6995-127f-468c-9a01-cb02cdd4f3df None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:55.617153 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b6995-127f-468c-9a01-cb02cdd4f3df None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:55.618520 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b6995-127f-468c-9a01-cb02cdd4f3df None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:55.628569 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-057b6995-127f-468c-9a01-cb02cdd4f3df None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 21:03:55.628569 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:55.628569 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 21:03:55.628569 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 21:03:55.628569 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 21:03:55.628569 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 21:03:55.628569 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 21:03:55.628569 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:55.628569 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 21:03:55.628569 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:55.628569 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 21:03:55.628569 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:55.628569 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:55.628569 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:55.628569 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:55.628569 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:55.628569 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:55.629732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:55.629732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:55.629732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:55.629732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:55.629732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:55.629732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:55.629732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 21:03:55.629732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 21:03:55.629732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 21:03:55.629732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 21:03:55.629732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:55.629732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:55.629732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:55.629732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:55.629732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:55.629732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:55.633832 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:55.633832 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:55.633832 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:55.633832 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:55.633832 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:55.633832 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:55.633832 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:55.633832 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:55.633832 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:55.633832 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:55.633832 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 21:03:55.633832 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:55.633832 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 21:03:55.633832 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:55.633832 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 468/953] 10.222.0.81 () {56 vars in 1126 bytes} [Tue Sep 6 21:03:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:55.637436 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b6995-127f-468c-9a01-cb02cdd4f3df None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:55.638263 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 486/954] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 21:03:55.732364 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:55.749769 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b6995-127f-468c-9a01-cb02cdd4f3df None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:55.785780 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e6859-58a8-452e-9d6e-4238c156fde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:55.786390 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e6859-58a8-452e-9d6e-4238c156fde8 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:55.786674 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e6859-58a8-452e-9d6e-4238c156fde8 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:55.786949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e6859-58a8-452e-9d6e-4238c156fde8 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:55.788136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e6859-58a8-452e-9d6e-4238c156fde8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:55.788730 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e6859-58a8-452e-9d6e-4238c156fde8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:55.790102 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2e6859-58a8-452e-9d6e-4238c156fde8 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:55.795363 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 469/955] 10.222.0.81 () {56 vars in 1122 bytes} [Tue Sep 6 21:03:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:03:55.801092 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcdaaba-3d29-466d-935d-517c0ae36cc0 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:55.909301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcdaaba-3d29-466d-935d-517c0ae36cc0 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:55.940176 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e6859-58a8-452e-9d6e-4238c156fde8 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:55.949389 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49fd319-737c-4985-95ec-a05810e1b5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:55.950068 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fd319-737c-4985-95ec-a05810e1b5db None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:55.950348 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fd319-737c-4985-95ec-a05810e1b5db None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:55.950716 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49fd319-737c-4985-95ec-a05810e1b5db None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:55.951342 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49fd319-737c-4985-95ec-a05810e1b5db None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:55.951640 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49fd319-737c-4985-95ec-a05810e1b5db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:55.953124 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49fd319-737c-4985-95ec-a05810e1b5db None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:55.958966 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 487/956] 10.222.0.81 () {56 vars in 1122 bytes} [Tue Sep 6 21:03:55 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:55.964893 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49fd319-737c-4985-95ec-a05810e1b5db None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:56.021811 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:56.074223 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e6859-58a8-452e-9d6e-4238c156fde8 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:56.085686 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49fd319-737c-4985-95ec-a05810e1b5db None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:56.114223 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678ab6a-bec3-4521-919a-0e557c32f9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:56.116172 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678ab6a-bec3-4521-919a-0e557c32f9a5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:56.116606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678ab6a-bec3-4521-919a-0e557c32f9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:56.117031 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678ab6a-bec3-4521-919a-0e557c32f9a5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:56.117892 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8678ab6a-bec3-4521-919a-0e557c32f9a5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:56.119567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8678ab6a-bec3-4521-919a-0e557c32f9a5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:56.123182 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a055c36-e716-4250-8536-cdc251a9ec1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:56.123865 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a055c36-e716-4250-8536-cdc251a9ec1a None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:56.124248 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a055c36-e716-4250-8536-cdc251a9ec1a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:56.124586 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a055c36-e716-4250-8536-cdc251a9ec1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:56.125314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a055c36-e716-4250-8536-cdc251a9ec1a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:56.126844 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a055c36-e716-4250-8536-cdc251a9ec1a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:56.130443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-8678ab6a-bec3-4521-919a-0e557c32f9a5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 21:03:56.130443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:56.130443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 21:03:56.130443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 21:03:56.130443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 21:03:56.130443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 21:03:56.130443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 21:03:56.130443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:56.130443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 21:03:56.130443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:56.130443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 21:03:56.130443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:56.130443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:56.130443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:56.130443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:56.130443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:56.130443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:56.131708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:56.131708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:56.131708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:56.131708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:56.131708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:56.131708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:56.131708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 21:03:56.131708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 21:03:56.131708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 21:03:56.131708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 21:03:56.131708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:56.131708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:56.131708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:56.131708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:56.131708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:56.131708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:56.132827 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:56.132827 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:56.132827 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:56.132827 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:56.132827 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:56.132827 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:56.132827 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:56.132827 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:56.132827 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:56.132827 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:56.132827 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 21:03:56.132827 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:56.132827 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 21:03:56.132827 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:56.135154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 470/957] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:03:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:56.141446 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678ab6a-bec3-4521-919a-0e557c32f9a5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:56.160416 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:56.212750 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 488/958] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:03:55 2022] POST /identity/v3/endpoints => generated 349 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:03:56.254600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678ab6a-bec3-4521-919a-0e557c32f9a5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:56.299806 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1189ea4-a54c-4b73-a7ec-a4f2f52a35bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:56.300537 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1189ea4-a54c-4b73-a7ec-a4f2f52a35bd None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:56.300824 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1189ea4-a54c-4b73-a7ec-a4f2f52a35bd None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:56.301106 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1189ea4-a54c-4b73-a7ec-a4f2f52a35bd None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:56.301754 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1189ea4-a54c-4b73-a7ec-a4f2f52a35bd None admin] RBAC: Adding query filter params (name=compute) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:56.302072 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1189ea4-a54c-4b73-a7ec-a4f2f52a35bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:56.304046 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1189ea4-a54c-4b73-a7ec-a4f2f52a35bd None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:56.309738 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 471/959] 10.222.0.81 () {56 vars in 1112 bytes} [Tue Sep 6 21:03:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:56.315579 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a055c36-e716-4250-8536-cdc251a9ec1a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:56.430757 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:56.437485 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a055c36-e716-4250-8536-cdc251a9ec1a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:56.472953 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf1d2f-0660-432d-b2f1-483ecb39f619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:56.473574 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf1d2f-0660-432d-b2f1-483ecb39f619 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:56.473851 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf1d2f-0660-432d-b2f1-483ecb39f619 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:56.474121 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf1d2f-0660-432d-b2f1-483ecb39f619 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:56.474752 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf1d2f-0660-432d-b2f1-483ecb39f619 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:56.475602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf1d2f-0660-432d-b2f1-483ecb39f619 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:56.477000 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf1d2f-0660-432d-b2f1-483ecb39f619 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:56.485152 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 489/960] 10.222.0.81 () {56 vars in 1112 bytes} [Tue Sep 6 21:03:56 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:57.369509 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b369d6-c211-4859-8e9d-10d708045335 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:57.370068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b369d6-c211-4859-8e9d-10d708045335 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:57.370068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b369d6-c211-4859-8e9d-10d708045335 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:57.371680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 472/961] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:57.377817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551020a4-a86a-4932-a60b-07c415296ecd None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:57.378329 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551020a4-a86a-4932-a60b-07c415296ecd None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:57.378329 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551020a4-a86a-4932-a60b-07c415296ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:57.397697 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-551020a4-a86a-4932-a60b-07c415296ecd None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:57.398894 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-551020a4-a86a-4932-a60b-07c415296ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:57.443168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21150dc5-b9ad-442e-ba96-0d4e8a17725e None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:57.443496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21150dc5-b9ad-442e-ba96-0d4e8a17725e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:57.443753 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21150dc5-b9ad-442e-ba96-0d4e8a17725e None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:57.445459 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 473/962] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:03:57.450957 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c1659-57de-4295-a462-1f23a034f9d0 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:57.451230 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c1659-57de-4295-a462-1f23a034f9d0 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:57.451511 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c1659-57de-4295-a462-1f23a034f9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:57.471347 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 490/963] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:03:57.477058 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-aa8c1659-57de-4295-a462-1f23a034f9d0 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:57.478403 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-aa8c1659-57de-4295-a462-1f23a034f9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:57.554509 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 474/964] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:03:57.749895 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551020a4-a86a-4932-a60b-07c415296ecd None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:57.825944 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c1659-57de-4295-a462-1f23a034f9d0 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:57.829039 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:57.846814 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:57.857566 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551020a4-a86a-4932-a60b-07c415296ecd None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:57.892241 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefa7d6-80c9-4a1a-ab5b-c5a6929a83d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:57.893171 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefa7d6-80c9-4a1a-ab5b-c5a6929a83d2 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:57.893629 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefa7d6-80c9-4a1a-ab5b-c5a6929a83d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:57.894074 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cefa7d6-80c9-4a1a-ab5b-c5a6929a83d2 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:57.894914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cefa7d6-80c9-4a1a-ab5b-c5a6929a83d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:57.896596 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cefa7d6-80c9-4a1a-ab5b-c5a6929a83d2 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:57.899824 dv-cinder-749155-11-smb devstack@keystone.service[81777]: WARNING keystone.server.flask.common [None req-5cefa7d6-80c9-4a1a-ab5b-c5a6929a83d2 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 06 21:03:57.932269 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c1659-57de-4295-a462-1f23a034f9d0 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:57.968667 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307f19d-d89d-4c5b-b7f5-2f4316d60016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:57.969306 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307f19d-d89d-4c5b-b7f5-2f4316d60016 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:57.969590 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307f19d-d89d-4c5b-b7f5-2f4316d60016 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:57.969873 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307f19d-d89d-4c5b-b7f5-2f4316d60016 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:57.981039 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307f19d-d89d-4c5b-b7f5-2f4316d60016 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:03:57.985910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-e307f19d-d89d-4c5b-b7f5-2f4316d60016 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 21:03:57.985910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:57.985910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:57.985910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:57.985910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:57.985910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:57.985910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:57.985910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:57.985910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:57.985910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:57.985910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:57.985910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:57.985910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:03:57.985910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:03:57.985910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:03:57.985910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:03:57.986848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:03:57.986848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:03:57.986848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:03:57.986848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:03:57.986848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:57.986848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:57.986848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:57.986848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:57.986848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:57.986848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:57.986848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:57.986848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:57.986848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:57.986848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:57.986848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:57.986848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:57.987699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:57.987699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:57.987699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:57.987699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:57.987699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:03:57.987699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:03:57.987699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:03:57.987699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:03:57.987699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:03:57.987699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:03:57.987699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 21:03:57.987699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:57.987699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 475/965] 10.222.0.81 () {56 vars in 1120 bytes} [Tue Sep 6 21:03:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:57.994598 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307f19d-d89d-4c5b-b7f5-2f4316d60016 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:58.001818 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.sql.core [None req-5cefa7d6-80c9-4a1a-ab5b-c5a6929a83d2 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 06 21:03:58.001818 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 06 21:03:58.001818 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [parameters: {'user_id': '2145a02ac95740389b4d67bdecf1a702', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 06 21:03:58.001818 dv-cinder-749155-11-smb devstack@keystone.service[81777]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81777) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 06 21:03:58.029030 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-5cefa7d6-80c9-4a1a-ab5b-c5a6929a83d2 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 06 21:03:58.029030 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:58.029030 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 21:03:58.029030 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 21:03:58.029030 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 21:03:58.029030 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 21:03:58.029030 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 21:03:58.029030 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 21:03:58.029030 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 21:03:58.029030 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application conn.query(q) Sep 06 21:03:58.029030 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 21:03:58.029030 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 21:03:58.029030 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 21:03:58.029030 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application result.read() Sep 06 21:03:58.029030 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 21:03:58.029997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 21:03:58.029997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 21:03:58.029997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 21:03:58.029997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 21:03:58.029997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 21:03:58.029997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 21:03:58.029997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 21:03:58.029997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 06 21:03:58.029997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:58.029997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 06 21:03:58.029997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:58.029997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:58.029997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 06 21:03:58.029997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 06 21:03:58.029997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 06 21:03:58.029997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 06 21:03:58.029997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 21:03:58.029997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application next(self.gen) Sep 06 21:03:58.030952 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 06 21:03:58.030952 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application yield resource Sep 06 21:03:58.030952 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 06 21:03:58.030952 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application next(self.gen) Sep 06 21:03:58.030952 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 06 21:03:58.030952 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self.session.rollback() Sep 06 21:03:58.030952 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 06 21:03:58.030952 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self.force_reraise() Sep 06 21:03:58.030952 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 06 21:03:58.030952 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise self.value Sep 06 21:03:58.030952 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 06 21:03:58.030952 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 06 21:03:58.030952 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 06 21:03:58.030952 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application session.commit() Sep 06 21:03:58.030952 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 06 21:03:58.030952 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 06 21:03:58.030952 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 06 21:03:58.031857 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._prepare_impl() Sep 06 21:03:58.031857 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 06 21:03:58.031857 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self.session.flush() Sep 06 21:03:58.031857 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 06 21:03:58.031857 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._flush(objects) Sep 06 21:03:58.031857 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 06 21:03:58.031857 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 06 21:03:58.031857 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 06 21:03:58.031857 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application compat.raise_( Sep 06 21:03:58.031857 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 21:03:58.031857 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception Sep 06 21:03:58.031857 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 06 21:03:58.031857 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application flush_context.execute() Sep 06 21:03:58.031857 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 06 21:03:58.031857 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rec.execute(self) Sep 06 21:03:58.031857 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 06 21:03:58.031857 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 06 21:03:58.033589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 06 21:03:58.033589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 06 21:03:58.033589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 06 21:03:58.033589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 06 21:03:58.033589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 06 21:03:58.033589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 06 21:03:58.033589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 06 21:03:58.033589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 06 21:03:58.033589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 06 21:03:58.033589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 06 21:03:58.033589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 06 21:03:58.033589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 06 21:03:58.033589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 06 21:03:58.033589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 06 21:03:58.033589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 06 21:03:58.033589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception Sep 06 21:03:58.036978 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 06 21:03:58.036978 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 06 21:03:58.036978 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 06 21:03:58.036978 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 06 21:03:58.036978 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 06 21:03:58.036978 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application result = self._query(query) Sep 06 21:03:58.036978 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 06 21:03:58.036978 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application conn.query(q) Sep 06 21:03:58.036978 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 06 21:03:58.036978 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 06 21:03:58.036978 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 06 21:03:58.036978 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application result.read() Sep 06 21:03:58.036978 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 06 21:03:58.036978 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 06 21:03:58.036978 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 06 21:03:58.036978 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 06 21:03:58.038751 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 06 21:03:58.038751 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 06 21:03:58.038751 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 06 21:03:58.038751 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 06 21:03:58.038751 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 06 21:03:58.038751 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 06 21:03:58.038751 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [parameters: {'user_id': '2145a02ac95740389b4d67bdecf1a702', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 06 21:03:58.038751 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 06 21:03:58.038751 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:58.038751 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 21:03:58.038751 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:58.038751 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:58.038751 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:58.038751 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:58.038751 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:58.040008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:58.040008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:58.040008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:58.040008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:58.040008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:58.040008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:58.040008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:58.040008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 06 21:03:58.040008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 06 21:03:58.040008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:58.040008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:58.040008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:03:58.040008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:58.040008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:03:58.040008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:58.040008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 06 21:03:58.040008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 06 21:03:58.041006 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 06 21:03:58.041006 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 06 21:03:58.041006 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 06 21:03:58.041006 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 06 21:03:58.041006 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 06 21:03:58.041006 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:58.041006 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 491/966] 10.222.0.81 () {60 vars in 1131 bytes} [Tue Sep 6 21:03:57 2022] POST /identity/v3/users => generated 160 bytes in 285 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:58.044280 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefa7d6-80c9-4a1a-ab5b-c5a6929a83d2 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:58.075622 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:58.117394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307f19d-d89d-4c5b-b7f5-2f4316d60016 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:58.155341 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f43511-01cc-4aba-a823-7e1da2043575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:58.156387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cefa7d6-80c9-4a1a-ab5b-c5a6929a83d2 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:58.156635 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f43511-01cc-4aba-a823-7e1da2043575 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:58.157119 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f43511-01cc-4aba-a823-7e1da2043575 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:58.157599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f43511-01cc-4aba-a823-7e1da2043575 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:58.158479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f43511-01cc-4aba-a823-7e1da2043575 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:58.159012 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f43511-01cc-4aba-a823-7e1da2043575 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:58.160653 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f43511-01cc-4aba-a823-7e1da2043575 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:58.170990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 476/967] 10.222.0.81 () {56 vars in 1115 bytes} [Tue Sep 6 21:03:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:58.176584 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f43511-01cc-4aba-a823-7e1da2043575 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:58.198887 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ded2a-e8ba-4ca5-a9dc-442a8743d0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:58.199530 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ded2a-e8ba-4ca5-a9dc-442a8743d0e5 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:58.199806 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ded2a-e8ba-4ca5-a9dc-442a8743d0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:58.200078 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ded2a-e8ba-4ca5-a9dc-442a8743d0e5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:58.208200 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ded2a-e8ba-4ca5-a9dc-442a8743d0e5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:58.210574 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ded2a-e8ba-4ca5-a9dc-442a8743d0e5 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:58.222836 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-795ded2a-e8ba-4ca5-a9dc-442a8743d0e5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 21:03:58.222836 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:58.222836 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:58.222836 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:58.222836 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:58.222836 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:58.222836 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:58.222836 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:58.222836 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:58.222836 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:58.222836 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:58.222836 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:58.222836 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:03:58.222836 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:03:58.222836 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:03:58.222836 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:03:58.223856 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:58.223856 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:58.223856 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:03:58.223856 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:58.223856 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:03:58.223856 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:58.223856 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:58.223856 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:58.223856 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:58.223856 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:58.223856 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:58.223856 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:58.223856 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:58.223856 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:58.223856 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:58.223856 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:58.223856 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:58.223856 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:58.225388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:58.225388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:58.225388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:03:58.225388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:03:58.225388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:03:58.225388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:03:58.225388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:03:58.225388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:03:58.225388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 06 21:03:58.225388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:03:58.228382 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 492/968] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:03:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:03:58.230401 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ded2a-e8ba-4ca5-a9dc-442a8743d0e5 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:58.246820 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:58.292853 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f43511-01cc-4aba-a823-7e1da2043575 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:58.320635 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:58.330246 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc0663-2ad4-4a84-a4dc-f46a28af1068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:58.331239 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc0663-2ad4-4a84-a4dc-f46a28af1068 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:58.331738 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc0663-2ad4-4a84-a4dc-f46a28af1068 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:58.332245 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc0663-2ad4-4a84-a4dc-f46a28af1068 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:58.338459 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ded2a-e8ba-4ca5-a9dc-442a8743d0e5 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:58.344176 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc0663-2ad4-4a84-a4dc-f46a28af1068 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:58.345925 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc0663-2ad4-4a84-a4dc-f46a28af1068 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:58.362505 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-20bc0663-2ad4-4a84-a4dc-f46a28af1068 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:58.362505 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:58.362505 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:58.362505 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:58.362505 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:58.362505 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:58.362505 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:58.362505 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:58.362505 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:58.362505 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:58.362505 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:58.362505 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:58.362505 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:58.362505 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:58.362505 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:58.362505 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:58.363511 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:58.363511 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:58.363511 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:58.363511 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:58.363511 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:58.363511 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:58.363511 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:58.363511 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:58.363511 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:58.363511 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:58.363511 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:58.363511 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:58.363511 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:58.363511 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:58.363511 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:58.363511 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:58.363511 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:58.364453 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:58.364453 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:58.364453 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:58.367068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 477/969] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:03:58.372374 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc0663-2ad4-4a84-a4dc-f46a28af1068 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:58.381139 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25509d72-f463-48e3-99f5-aa70523bb09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:58.381746 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25509d72-f463-48e3-99f5-aa70523bb09f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:58.382032 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25509d72-f463-48e3-99f5-aa70523bb09f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:58.382306 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25509d72-f463-48e3-99f5-aa70523bb09f None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:58.383006 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25509d72-f463-48e3-99f5-aa70523bb09f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:58.383310 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25509d72-f463-48e3-99f5-aa70523bb09f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:58.384780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25509d72-f463-48e3-99f5-aa70523bb09f None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:58.432436 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 493/970] 10.222.0.81 () {56 vars in 1101 bytes} [Tue Sep 6 21:03:58 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:58.496995 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc0663-2ad4-4a84-a4dc-f46a28af1068 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:58.538573 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc6204-e691-4a0a-afe4-d6f9eb6480ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:58.539580 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc6204-e691-4a0a-afe4-d6f9eb6480ce None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:58.540068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc6204-e691-4a0a-afe4-d6f9eb6480ce None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:58.540604 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc6204-e691-4a0a-afe4-d6f9eb6480ce None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:58.541546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc6204-e691-4a0a-afe4-d6f9eb6480ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:58.542120 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc6204-e691-4a0a-afe4-d6f9eb6480ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:58.544141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc6204-e691-4a0a-afe4-d6f9eb6480ce None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:58.546457 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54093000-a6cd-4f0f-aea0-e26fa41e2276 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:58.547688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54093000-a6cd-4f0f-aea0-e26fa41e2276 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:58.548205 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54093000-a6cd-4f0f-aea0-e26fa41e2276 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:58.550117 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 494/971] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:03:58.559566 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbd881-e56c-49f9-be4d-2ef30db4ec9f None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:58.560018 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbd881-e56c-49f9-be4d-2ef30db4ec9f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:58.560260 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbd881-e56c-49f9-be4d-2ef30db4ec9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:58.562994 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 478/972] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:58.570050 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc6204-e691-4a0a-afe4-d6f9eb6480ce None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:58.582900 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-03dbd881-e56c-49f9-be4d-2ef30db4ec9f None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:58.587906 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-03dbd881-e56c-49f9-be4d-2ef30db4ec9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:58.628351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:58.677615 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:58.683016 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 495/973] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:03:58.699291 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc6204-e691-4a0a-afe4-d6f9eb6480ce None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:58.707624 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ad389-a4c9-42e9-8d6b-c97a4b011b02 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:58.708171 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ad389-a4c9-42e9-8d6b-c97a4b011b02 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:58.708699 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ad389-a4c9-42e9-8d6b-c97a4b011b02 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:58.710720 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 496/974] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:03:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:03:58.716364 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad98548-4abb-4dde-b485-2038615aca80 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:58.716886 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad98548-4abb-4dde-b485-2038615aca80 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:58.717342 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad98548-4abb-4dde-b485-2038615aca80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:58.740416 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa1e65-2bfb-4316-b748-295d54c2624b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:58.741057 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa1e65-2bfb-4316-b748-295d54c2624b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:58.741350 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa1e65-2bfb-4316-b748-295d54c2624b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:58.741606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa1e65-2bfb-4316-b748-295d54c2624b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:58.741812 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-4ad98548-4abb-4dde-b485-2038615aca80 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:03:58.743216 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4ad98548-4abb-4dde-b485-2038615aca80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:03:58.750280 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa1e65-2bfb-4316-b748-295d54c2624b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:58.751922 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa1e65-2bfb-4316-b748-295d54c2624b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:58.766667 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-68fa1e65-2bfb-4316-b748-295d54c2624b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 21:03:58.766667 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:58.766667 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:58.766667 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:58.766667 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:58.766667 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:58.766667 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:58.766667 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:58.766667 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:58.766667 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:58.766667 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:58.766667 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:58.766667 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:03:58.766667 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:03:58.766667 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:03:58.766667 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:03:58.767886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:58.767886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:58.767886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:03:58.767886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:58.767886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:03:58.767886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:03:58.767886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:58.767886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:58.767886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:58.767886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:58.767886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:58.767886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:58.767886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:58.767886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:58.767886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:58.767886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:58.767886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:58.767886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:58.768992 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:58.768992 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:58.768992 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:03:58.768992 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:03:58.768992 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:03:58.768992 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:03:58.768992 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:03:58.768992 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:03:58.768992 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 06 21:03:58.768992 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:58.768992 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 479/975] 10.222.0.81 () {56 vars in 1117 bytes} [Tue Sep 6 21:03:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:03:58.774919 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa1e65-2bfb-4316-b748-295d54c2624b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:58.824770 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 497/976] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:03:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:03:58.875270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:58.879407 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa1e65-2bfb-4316-b748-295d54c2624b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:58.921575 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b97566-72ee-4b0c-8acf-61e54e8dd164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:58.922186 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b97566-72ee-4b0c-8acf-61e54e8dd164 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:58.922487 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b97566-72ee-4b0c-8acf-61e54e8dd164 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:58.922756 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b97566-72ee-4b0c-8acf-61e54e8dd164 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:58.923472 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b97566-72ee-4b0c-8acf-61e54e8dd164 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:58.923774 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b97566-72ee-4b0c-8acf-61e54e8dd164 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:58.925251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b97566-72ee-4b0c-8acf-61e54e8dd164 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:58.950467 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 480/977] 10.222.0.81 () {56 vars in 1149 bytes} [Tue Sep 6 21:03:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:03:58.951924 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad98548-4abb-4dde-b485-2038615aca80 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:58.959904 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b97566-72ee-4b0c-8acf-61e54e8dd164 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:59.067760 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad98548-4abb-4dde-b485-2038615aca80 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:59.079411 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b97566-72ee-4b0c-8acf-61e54e8dd164 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:59.102715 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:59.109139 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18bdeb-6dc0-4891-8166-43070df4e330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:59.109878 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18bdeb-6dc0-4891-8166-43070df4e330 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:59.110161 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18bdeb-6dc0-4891-8166-43070df4e330 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:59.113844 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18bdeb-6dc0-4891-8166-43070df4e330 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:59.114654 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c31c3d-75fe-4c9c-8b06-c358d5de7e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:59.115278 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c31c3d-75fe-4c9c-8b06-c358d5de7e0a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:59.115616 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c31c3d-75fe-4c9c-8b06-c358d5de7e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:59.115890 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c31c3d-75fe-4c9c-8b06-c358d5de7e0a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:59.116498 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c31c3d-75fe-4c9c-8b06-c358d5de7e0a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:59.117882 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c31c3d-75fe-4c9c-8b06-c358d5de7e0a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:59.126544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-59c31c3d-75fe-4c9c-8b06-c358d5de7e0a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 21:03:59.126544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:59.126544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 21:03:59.126544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 21:03:59.126544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 21:03:59.126544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 21:03:59.126544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 21:03:59.126544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:59.126544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 21:03:59.126544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:59.126544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 21:03:59.126544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:59.126544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:59.126544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:59.126544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:59.126544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:59.126544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:59.127754 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:59.127754 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:59.127754 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:59.127754 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:59.127754 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:59.127754 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:59.127754 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 21:03:59.127754 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 21:03:59.127754 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 21:03:59.127754 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 21:03:59.127754 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:59.127754 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:59.127754 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:59.127754 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:59.127754 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:59.127754 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:59.128677 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:59.128677 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:59.128677 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:59.128677 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:59.128677 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:59.128677 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:59.128677 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:59.128677 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:59.128677 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:59.128677 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:59.128677 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 21:03:59.128677 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:03:59.128677 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 21:03:59.128677 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:59.128677 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 481/978] 10.222.0.81 () {56 vars in 1126 bytes} [Tue Sep 6 21:03:58 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:03:59.129559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c31c3d-75fe-4c9c-8b06-c358d5de7e0a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:59.152454 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:59.179896 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18bdeb-6dc0-4891-8166-43070df4e330 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:59.181419 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a18bdeb-6dc0-4891-8166-43070df4e330 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:59.230098 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c31c3d-75fe-4c9c-8b06-c358d5de7e0a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:59.263879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa327d-df7b-4ca6-a351-14ddb73edaf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:59.264532 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa327d-df7b-4ca6-a351-14ddb73edaf5 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:59.264814 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa327d-df7b-4ca6-a351-14ddb73edaf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:59.265094 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa327d-df7b-4ca6-a351-14ddb73edaf5 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:59.265761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa327d-df7b-4ca6-a351-14ddb73edaf5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:59.267227 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aa327d-df7b-4ca6-a351-14ddb73edaf5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:59.285276 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 498/979] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:03:58 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 06 21:03:59.286246 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18bdeb-6dc0-4891-8166-43070df4e330 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:59.316349 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:59.339648 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 482/980] 10.222.0.81 () {60 vars in 1141 bytes} [Tue Sep 6 21:03:59 2022] POST /identity/v3/services => generated 242 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:03:59.340640 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa327d-df7b-4ca6-a351-14ddb73edaf5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:59.395922 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18bdeb-6dc0-4891-8166-43070df4e330 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:59.445315 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565111c-456b-4447-a20b-269fb766859d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:59.445940 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565111c-456b-4447-a20b-269fb766859d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:59.446221 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565111c-456b-4447-a20b-269fb766859d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:59.446493 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b565111c-456b-4447-a20b-269fb766859d None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:59.447134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565111c-456b-4447-a20b-269fb766859d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:59.447434 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565111c-456b-4447-a20b-269fb766859d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:59.448858 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b565111c-456b-4447-a20b-269fb766859d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:59.451623 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:59.459881 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 499/981] 10.222.0.81 () {56 vars in 1122 bytes} [Tue Sep 6 21:03:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:59.461114 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565111c-456b-4447-a20b-269fb766859d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:59.479212 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aa327d-df7b-4ca6-a351-14ddb73edaf5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:59.518620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dce86f-b325-422f-bb51-2ba45bf9a30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:59.519261 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dce86f-b325-422f-bb51-2ba45bf9a30a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:59.519698 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dce86f-b325-422f-bb51-2ba45bf9a30a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:59.519975 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dce86f-b325-422f-bb51-2ba45bf9a30a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:59.532377 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dce86f-b325-422f-bb51-2ba45bf9a30a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:59.534531 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dce86f-b325-422f-bb51-2ba45bf9a30a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:59.559190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-20dce86f-b325-422f-bb51-2ba45bf9a30a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:59.559190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:59.559190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:59.559190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:59.559190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:59.559190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:59.559190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:59.559190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:59.559190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:59.559190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:59.559190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:59.559190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:59.559190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:03:59.559190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:03:59.559190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:03:59.559190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:03:59.560404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:59.560404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:59.560404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:59.560404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:59.560404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:59.560404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:59.560404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:59.560404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:59.560404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:59.560404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:59.560404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:59.560404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:59.560404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:59.560404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:59.560404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:59.560404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:59.560404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:03:59.561473 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:03:59.561473 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:03:59.561473 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:59.562880 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 483/982] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:03:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:03:59.569515 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dce86f-b325-422f-bb51-2ba45bf9a30a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:59.574164 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:59.583649 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b565111c-456b-4447-a20b-269fb766859d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:59.626993 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575c4b6-6720-4ce1-9a2f-4445be7764ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:59.627620 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575c4b6-6720-4ce1-9a2f-4445be7764ce None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:59.628108 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575c4b6-6720-4ce1-9a2f-4445be7764ce None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:59.628798 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575c4b6-6720-4ce1-9a2f-4445be7764ce None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:59.629028 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575c4b6-6720-4ce1-9a2f-4445be7764ce None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:59.629509 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575c4b6-6720-4ce1-9a2f-4445be7764ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:59.632960 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575c4b6-6720-4ce1-9a2f-4445be7764ce None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:59.645070 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 500/983] 10.222.0.81 () {56 vars in 1122 bytes} [Tue Sep 6 21:03:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:59.646199 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575c4b6-6720-4ce1-9a2f-4445be7764ce None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:59.686086 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dce86f-b325-422f-bb51-2ba45bf9a30a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:59.717969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:59.724652 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9bb91-e7ae-4fcd-9e31-5f7da08fb0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:59.725289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9bb91-e7ae-4fcd-9e31-5f7da08fb0b9 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:59.725568 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9bb91-e7ae-4fcd-9e31-5f7da08fb0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:59.725836 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9bb91-e7ae-4fcd-9e31-5f7da08fb0b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:59.726470 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9bb91-e7ae-4fcd-9e31-5f7da08fb0b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:59.726861 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9bb91-e7ae-4fcd-9e31-5f7da08fb0b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:59.728573 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9bb91-e7ae-4fcd-9e31-5f7da08fb0b9 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:59.741588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 484/984] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:03:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:03:59.746968 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9bb91-e7ae-4fcd-9e31-5f7da08fb0b9 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:59.753198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575c4b6-6720-4ce1-9a2f-4445be7764ce None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:59.791034 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdb7e4-9ac0-400b-a3db-7ab8000f29ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:59.791645 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdb7e4-9ac0-400b-a3db-7ab8000f29ac None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:59.791925 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdb7e4-9ac0-400b-a3db-7ab8000f29ac None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:59.792225 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdb7e4-9ac0-400b-a3db-7ab8000f29ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:59.792953 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cdb7e4-9ac0-400b-a3db-7ab8000f29ac None admin] RBAC: Adding query filter params (interface=admin, service_id=a922444f582f423a805812a42888c37a, region_id=RegionOne) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:03:59.793263 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cdb7e4-9ac0-400b-a3db-7ab8000f29ac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:59.794630 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cdb7e4-9ac0-400b-a3db-7ab8000f29ac None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:59.804815 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 501/985] 10.222.0.81 () {56 vars in 1249 bytes} [Tue Sep 6 21:03:59 2022] GET /identity/v3/endpoints?service_id=a922444f582f423a805812a42888c37a&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:03:59.805845 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdb7e4-9ac0-400b-a3db-7ab8000f29ac None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:59.826203 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:03:59.860922 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9bb91-e7ae-4fcd-9e31-5f7da08fb0b9 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:59.902149 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9293555-9b6f-41e2-9e0a-aedb823fb9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:59.903049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9293555-9b6f-41e2-9e0a-aedb823fb9ff None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:59.903299 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9293555-9b6f-41e2-9e0a-aedb823fb9ff None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:59.903574 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9293555-9b6f-41e2-9e0a-aedb823fb9ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:59.910213 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdb7e4-9ac0-400b-a3db-7ab8000f29ac None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:03:59.912404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9293555-9b6f-41e2-9e0a-aedb823fb9ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:59.915016 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9293555-9b6f-41e2-9e0a-aedb823fb9ff None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:59.929875 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-e9293555-9b6f-41e2-9e0a-aedb823fb9ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:59.929875 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:03:59.929875 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:03:59.929875 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:03:59.929875 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:03:59.929875 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:03:59.929875 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:03:59.929875 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:03:59.929875 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:03:59.929875 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:03:59.929875 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:03:59.929875 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:03:59.929875 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:03:59.929875 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:03:59.929875 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:03:59.930824 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:03:59.930824 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:03:59.930824 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:03:59.930824 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:03:59.930824 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:03:59.930824 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:03:59.930824 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:03:59.930824 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:03:59.930824 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:03:59.930824 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:03:59.930824 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:03:59.930824 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:03:59.930824 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:03:59.930824 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:03:59.930824 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:03:59.930824 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:03:59.930824 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:03:59.931776 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:03:59.931776 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:03:59.931776 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:03:59.931776 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:03:59.931776 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:03:59.931776 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:03:59.931776 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:03:59.931776 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:03:59.931776 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 485/986] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:03:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:03:59.937308 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9293555-9b6f-41e2-9e0a-aedb823fb9ff None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:03:59.949167 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98bd53a-0613-47b0-b788-2058d9a2ba66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:03:59.950145 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bd53a-0613-47b0-b788-2058d9a2ba66 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:03:59.950440 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bd53a-0613-47b0-b788-2058d9a2ba66 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:03:59.950719 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98bd53a-0613-47b0-b788-2058d9a2ba66 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:03:59.951646 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98bd53a-0613-47b0-b788-2058d9a2ba66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:03:59.953076 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98bd53a-0613-47b0-b788-2058d9a2ba66 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:03:59.960843 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 502/987] 10.222.0.81 () {56 vars in 1087 bytes} [Tue Sep 6 21:03:59 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:03:59.996799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:00.049799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9293555-9b6f-41e2-9e0a-aedb823fb9ff None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:00.087905 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43446ae-733c-4cb4-abb7-74c193c011af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:00.088581 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43446ae-733c-4cb4-abb7-74c193c011af None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:00.088864 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43446ae-733c-4cb4-abb7-74c193c011af None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:00.089142 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43446ae-733c-4cb4-abb7-74c193c011af None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:00.089941 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43446ae-733c-4cb4-abb7-74c193c011af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:00.090256 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43446ae-733c-4cb4-abb7-74c193c011af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:00.091742 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43446ae-733c-4cb4-abb7-74c193c011af None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:00.112369 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 486/988] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:03:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:04:00.115270 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98bd53a-0613-47b0-b788-2058d9a2ba66 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:00.215584 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:00.233242 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98bd53a-0613-47b0-b788-2058d9a2ba66 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:00.279153 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2500c1b9-7df4-4401-a296-9bbfeab77d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:00.279774 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500c1b9-7df4-4401-a296-9bbfeab77d21 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:00.280055 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500c1b9-7df4-4401-a296-9bbfeab77d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:00.280362 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2500c1b9-7df4-4401-a296-9bbfeab77d21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:00.281093 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500c1b9-7df4-4401-a296-9bbfeab77d21 None admin] RBAC: Adding query filter params (role.id=10d5d25768bd401b86eabfddb1dadf98, scope.project.id=002e09339d4e49ce98434571d3b64248, user.id=0ba7376671a24d35a920e0ec3290472b) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:00.281462 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500c1b9-7df4-4401-a296-9bbfeab77d21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:00.282903 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2500c1b9-7df4-4401-a296-9bbfeab77d21 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:00.292498 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 503/989] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:04:00 2022] GET /identity/v3/role_assignments?user.id=0ba7376671a24d35a920e0ec3290472b&scope.project.id=002e09339d4e49ce98434571d3b64248&role.id=10d5d25768bd401b86eabfddb1dadf98 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:01.536947 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b733c-c285-432e-8127-a8489e326c6e None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:01.537959 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b733c-c285-432e-8127-a8489e326c6e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:01.538038 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59b733c-c285-432e-8127-a8489e326c6e None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:01.539756 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 487/990] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:04:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:04:01.544853 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca29fe-ecd4-4e25-8a99-b2beab3b81a0 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:01.545262 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca29fe-ecd4-4e25-8a99-b2beab3b81a0 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:01.545424 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca29fe-ecd4-4e25-8a99-b2beab3b81a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:01.565120 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-ffca29fe-ecd4-4e25-8a99-b2beab3b81a0 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:04:01.566300 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ffca29fe-ecd4-4e25-8a99-b2beab3b81a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:04:01.640445 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 504/991] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:04:01 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:04:01.907751 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b733c-c285-432e-8127-a8489e326c6e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:02.047237 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59b733c-c285-432e-8127-a8489e326c6e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:02.064288 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:02.089519 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422594ed-4622-44b6-a5b4-a2f735139b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:02.090305 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422594ed-4622-44b6-a5b4-a2f735139b37 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:02.090583 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422594ed-4622-44b6-a5b4-a2f735139b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:02.090855 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422594ed-4622-44b6-a5b4-a2f735139b37 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:02.091451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422594ed-4622-44b6-a5b4-a2f735139b37 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:02.093088 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422594ed-4622-44b6-a5b4-a2f735139b37 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:02.104210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-422594ed-4622-44b6-a5b4-a2f735139b37 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 21:04:02.104210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:02.104210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 21:04:02.104210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 21:04:02.104210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 21:04:02.104210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 21:04:02.104210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 21:04:02.104210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:04:02.104210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 21:04:02.104210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:04:02.104210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 21:04:02.104210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:04:02.104210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:02.104210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:04:02.104210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:04:02.104210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:04:02.104210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:04:02.105364 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:04:02.105364 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:04:02.105364 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:04:02.105364 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:04:02.105364 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:04:02.105364 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:04:02.105364 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 21:04:02.105364 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 21:04:02.105364 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 21:04:02.105364 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 21:04:02.105364 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:04:02.105364 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:04:02.105364 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:04:02.105364 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:04:02.105364 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:04:02.105364 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:04:02.106228 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:04:02.106228 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:04:02.106228 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:04:02.106228 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:04:02.106228 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:04:02.106228 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:04:02.106228 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:04:02.106228 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:04:02.106228 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:04:02.106228 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:04:02.106228 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 21:04:02.106228 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:04:02.106228 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 21:04:02.106228 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:04:02.106228 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 488/992] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:04:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:04:02.113172 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca29fe-ecd4-4e25-8a99-b2beab3b81a0 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:02.147197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df978dd6-362d-4ba2-95fb-1fc17e023803 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:02.147492 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df978dd6-362d-4ba2-95fb-1fc17e023803 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:02.147912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df978dd6-362d-4ba2-95fb-1fc17e023803 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:02.149412 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 489/993] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:04:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:04:02.154838 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cb1aa-30ac-402b-aed4-4e1a2eb149a8 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:02.155121 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cb1aa-30ac-402b-aed4-4e1a2eb149a8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:02.155406 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407cb1aa-30ac-402b-aed4-4e1a2eb149a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:02.183260 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-407cb1aa-30ac-402b-aed4-4e1a2eb149a8 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:04:02.184393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-407cb1aa-30ac-402b-aed4-4e1a2eb149a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:04:02.209135 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:02.234587 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca29fe-ecd4-4e25-8a99-b2beab3b81a0 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:02.260014 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 490/994] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:04:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 21:04:02.276805 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50164cb-663c-41d9-a523-aca858f36756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:02.277426 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50164cb-663c-41d9-a523-aca858f36756 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:02.277710 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50164cb-663c-41d9-a523-aca858f36756 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:02.277988 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50164cb-663c-41d9-a523-aca858f36756 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:02.278622 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50164cb-663c-41d9-a523-aca858f36756 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:02.278929 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50164cb-663c-41d9-a523-aca858f36756 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:02.280339 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50164cb-663c-41d9-a523-aca858f36756 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:02.285309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 505/995] 10.222.0.81 () {56 vars in 1112 bytes} [Tue Sep 6 21:04:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:02.291061 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cb1aa-30ac-402b-aed4-4e1a2eb149a8 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:02.405999 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407cb1aa-30ac-402b-aed4-4e1a2eb149a8 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:02.414851 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:02.444183 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b04d11e-3dfe-4e13-85d8-73374f2e7463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:02.444715 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04d11e-3dfe-4e13-85d8-73374f2e7463 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:02.444999 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04d11e-3dfe-4e13-85d8-73374f2e7463 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:02.445274 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04d11e-3dfe-4e13-85d8-73374f2e7463 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:02.445907 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04d11e-3dfe-4e13-85d8-73374f2e7463 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:02.446215 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04d11e-3dfe-4e13-85d8-73374f2e7463 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:02.447579 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b04d11e-3dfe-4e13-85d8-73374f2e7463 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:02.457274 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 491/996] 10.222.0.81 () {56 vars in 1112 bytes} [Tue Sep 6 21:04:02 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:02.458542 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50164cb-663c-41d9-a523-aca858f36756 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:02.483181 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8d6c7-3480-44ca-b516-484329e5810b None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:02.483470 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8d6c7-3480-44ca-b516-484329e5810b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:02.483774 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8d6c7-3480-44ca-b516-484329e5810b None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:02.485323 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 492/997] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:04:02.490254 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350292da-c514-40d3-8f8a-1935f2e9a19e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:02.490600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350292da-c514-40d3-8f8a-1935f2e9a19e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:02.490880 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350292da-c514-40d3-8f8a-1935f2e9a19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:02.509721 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-350292da-c514-40d3-8f8a-1935f2e9a19e None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:04:02.510826 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-350292da-c514-40d3-8f8a-1935f2e9a19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:04:02.570203 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50164cb-663c-41d9-a523-aca858f36756 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:02.586103 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 493/998] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:04:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 21:04:02.586979 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350292da-c514-40d3-8f8a-1935f2e9a19e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:02.613431 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672b3cf-5468-40fb-a594-ee3515a69ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:02.614051 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672b3cf-5468-40fb-a594-ee3515a69ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:02.614334 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672b3cf-5468-40fb-a594-ee3515a69ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:02.614608 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672b3cf-5468-40fb-a594-ee3515a69ff9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:02.615345 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a672b3cf-5468-40fb-a594-ee3515a69ff9 None admin] RBAC: Adding query filter params (interface=public, service_id=dd0be57f28c443559b8b50495eca6602, region_id=RegionOne) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:02.615656 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a672b3cf-5468-40fb-a594-ee3515a69ff9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:02.617072 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a672b3cf-5468-40fb-a594-ee3515a69ff9 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:02.623291 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 506/999] 10.222.0.81 () {56 vars in 1251 bytes} [Tue Sep 6 21:04:02 2022] GET /identity/v3/endpoints?service_id=dd0be57f28c443559b8b50495eca6602&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:02.629158 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672b3cf-5468-40fb-a594-ee3515a69ff9 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:02.634770 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:02.718127 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:02.722701 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350292da-c514-40d3-8f8a-1935f2e9a19e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:02.773603 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473bfa6-9a5a-4099-8e2f-298e1a5a505b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:02.774418 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473bfa6-9a5a-4099-8e2f-298e1a5a505b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:02.774710 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473bfa6-9a5a-4099-8e2f-298e1a5a505b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:02.774981 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b473bfa6-9a5a-4099-8e2f-298e1a5a505b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:02.775579 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b473bfa6-9a5a-4099-8e2f-298e1a5a505b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:02.777395 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b473bfa6-9a5a-4099-8e2f-298e1a5a505b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:02.783705 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672b3cf-5468-40fb-a594-ee3515a69ff9 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:02.786988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-b473bfa6-9a5a-4099-8e2f-298e1a5a505b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 21:04:02.786988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:02.786988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 21:04:02.786988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 21:04:02.786988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 21:04:02.786988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 21:04:02.786988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 21:04:02.786988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:04:02.786988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 21:04:02.786988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:04:02.786988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 21:04:02.786988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:04:02.786988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:02.786988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:04:02.786988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:04:02.786988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:04:02.786988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:04:02.788052 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:04:02.788052 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:04:02.788052 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:04:02.788052 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:04:02.788052 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:04:02.788052 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:04:02.788052 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 21:04:02.788052 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 21:04:02.788052 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 21:04:02.788052 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 21:04:02.788052 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:04:02.788052 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:04:02.788052 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:04:02.788052 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:04:02.788052 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:04:02.788052 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:04:02.789231 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:04:02.789231 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:04:02.789231 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:04:02.789231 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:04:02.789231 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:04:02.789231 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:04:02.789231 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:04:02.789231 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:04:02.789231 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:04:02.789231 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:04:02.789231 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 21:04:02.789231 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:04:02.789231 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 06 21:04:02.789231 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:04:02.789231 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 494/1000] 10.222.0.81 () {56 vars in 1126 bytes} [Tue Sep 6 21:04:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:04:02.794471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473bfa6-9a5a-4099-8e2f-298e1a5a505b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:02.830123 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169db63-9d7a-4f9a-a885-010191e129b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:02.830747 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169db63-9d7a-4f9a-a885-010191e129b9 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:02.831133 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169db63-9d7a-4f9a-a885-010191e129b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:02.831434 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169db63-9d7a-4f9a-a885-010191e129b9 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:02.832013 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169db63-9d7a-4f9a-a885-010191e129b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:02.833438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169db63-9d7a-4f9a-a885-010191e129b9 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:02.852215 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 507/1001] 10.222.0.81 () {56 vars in 1087 bytes} [Tue Sep 6 21:04:02 2022] GET /identity/v3/services => generated 1727 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:04:02.855651 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169db63-9d7a-4f9a-a885-010191e129b9 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:02.934484 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:02.939153 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b473bfa6-9a5a-4099-8e2f-298e1a5a505b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:02.977529 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169db63-9d7a-4f9a-a885-010191e129b9 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:02.978552 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed248b6-25a8-4c12-98e0-64e43b5057f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:02.979456 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed248b6-25a8-4c12-98e0-64e43b5057f9 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:02.979740 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed248b6-25a8-4c12-98e0-64e43b5057f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:02.980950 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed248b6-25a8-4c12-98e0-64e43b5057f9 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:02.981611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed248b6-25a8-4c12-98e0-64e43b5057f9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:02.981921 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed248b6-25a8-4c12-98e0-64e43b5057f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:02.983328 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed248b6-25a8-4c12-98e0-64e43b5057f9 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:02.994656 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 495/1002] 10.222.0.81 () {56 vars in 1122 bytes} [Tue Sep 6 21:04:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:04:02.995845 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed248b6-25a8-4c12-98e0-64e43b5057f9 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:03.016211 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf5976-567b-48ee-9a0c-b8704b5c2344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:03.016862 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf5976-567b-48ee-9a0c-b8704b5c2344 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:03.017135 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf5976-567b-48ee-9a0c-b8704b5c2344 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:03.017406 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf5976-567b-48ee-9a0c-b8704b5c2344 None admin] PATH_INFO: `/v3/services/image` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:03.017995 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf5976-567b-48ee-9a0c-b8704b5c2344 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:03.019366 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf5976-567b-48ee-9a0c-b8704b5c2344 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:03.029775 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-feaf5976-567b-48ee-9a0c-b8704b5c2344 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 21:04:03.029775 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:03.029775 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 21:04:03.029775 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 21:04:03.029775 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 21:04:03.029775 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 21:04:03.029775 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 21:04:03.029775 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:04:03.029775 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 21:04:03.029775 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:04:03.029775 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 21:04:03.029775 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:04:03.029775 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:03.029775 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:04:03.029775 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:04:03.029775 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:04:03.029775 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:04:03.030813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:04:03.030813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:04:03.030813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:04:03.030813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:04:03.030813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:04:03.030813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:04:03.030813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 21:04:03.030813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 21:04:03.030813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 21:04:03.030813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 21:04:03.030813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:04:03.030813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:04:03.030813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:04:03.030813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:04:03.030813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:04:03.030813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:04:03.031665 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:04:03.031665 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:04:03.031665 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:04:03.031665 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:04:03.031665 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:04:03.031665 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:04:03.031665 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:04:03.031665 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:04:03.031665 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:04:03.031665 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:04:03.031665 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 21:04:03.031665 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:04:03.031665 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 21:04:03.031665 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:04:03.032549 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:03.032628 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 508/1003] 10.222.0.81 () {56 vars in 1105 bytes} [Tue Sep 6 21:04:02 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:04:03.037146 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf5976-567b-48ee-9a0c-b8704b5c2344 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:03.111688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed248b6-25a8-4c12-98e0-64e43b5057f9 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:03.149024 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d8a97-c533-4a9d-8012-fa8fa89aac6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:03.149636 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d8a97-c533-4a9d-8012-fa8fa89aac6c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:03.149922 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d8a97-c533-4a9d-8012-fa8fa89aac6c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:03.150195 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774d8a97-c533-4a9d-8012-fa8fa89aac6c None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:03.150828 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d8a97-c533-4a9d-8012-fa8fa89aac6c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:03.151132 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d8a97-c533-4a9d-8012-fa8fa89aac6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:03.152519 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774d8a97-c533-4a9d-8012-fa8fa89aac6c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:03.152928 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf5976-567b-48ee-9a0c-b8704b5c2344 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:03.157567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 496/1004] 10.222.0.81 () {56 vars in 1122 bytes} [Tue Sep 6 21:04:02 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:04:03.163082 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d8a97-c533-4a9d-8012-fa8fa89aac6c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:03.186894 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:03.192262 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3b3f4-391d-4dc1-93ca-c665d88ff428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:03.192926 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3b3f4-391d-4dc1-93ca-c665d88ff428 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:03.193152 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3b3f4-391d-4dc1-93ca-c665d88ff428 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:03.193485 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e3b3f4-391d-4dc1-93ca-c665d88ff428 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:03.194607 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3b3f4-391d-4dc1-93ca-c665d88ff428 None admin] RBAC: Adding query filter params (name=image) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:03.194915 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3b3f4-391d-4dc1-93ca-c665d88ff428 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:03.196414 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e3b3f4-391d-4dc1-93ca-c665d88ff428 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:03.201167 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 509/1005] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:04:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:03.207172 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3b3f4-391d-4dc1-93ca-c665d88ff428 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:03.264088 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:03.277053 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774d8a97-c533-4a9d-8012-fa8fa89aac6c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:03.319732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7f4c0-933d-4bfd-a6b5-908cf973b62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:03.320483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7f4c0-933d-4bfd-a6b5-908cf973b62e None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:03.320758 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7f4c0-933d-4bfd-a6b5-908cf973b62e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:03.321026 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7f4c0-933d-4bfd-a6b5-908cf973b62e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:03.321693 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7f4c0-933d-4bfd-a6b5-908cf973b62e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:03.323043 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7f4c0-933d-4bfd-a6b5-908cf973b62e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:03.335965 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e3b3f4-391d-4dc1-93ca-c665d88ff428 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:03.372559 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdffad25-893e-46db-b7bd-80390b61cb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:03.373568 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffad25-893e-46db-b7bd-80390b61cb42 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:03.374096 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffad25-893e-46db-b7bd-80390b61cb42 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:03.374580 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdffad25-893e-46db-b7bd-80390b61cb42 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:03.375679 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdffad25-893e-46db-b7bd-80390b61cb42 None admin] RBAC: Adding query filter params (type=image) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:03.376242 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdffad25-893e-46db-b7bd-80390b61cb42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:03.378716 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdffad25-893e-46db-b7bd-80390b61cb42 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:03.396677 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 510/1006] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:04:03 2022] GET /identity/v3/services?type=image => generated 122 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:04:03.404168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 497/1007] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:04:03 2022] POST /identity/v3/endpoints => generated 325 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:04:05.069737 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71edbb28-f94e-49c2-9c27-15dc3adb85bd None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:05.070394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71edbb28-f94e-49c2-9c27-15dc3adb85bd None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:05.070394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71edbb28-f94e-49c2-9c27-15dc3adb85bd None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:05.071779 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 511/1008] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:04:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:04:05.077643 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252cb4c-d726-4b17-b9de-a9318f6aae22 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:05.078342 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252cb4c-d726-4b17-b9de-a9318f6aae22 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:05.078342 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252cb4c-d726-4b17-b9de-a9318f6aae22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:05.102888 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-5252cb4c-d726-4b17-b9de-a9318f6aae22 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:04:05.106387 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5252cb4c-d726-4b17-b9de-a9318f6aae22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:04:05.194576 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 498/1009] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:04:05 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 21:04:05.462259 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71edbb28-f94e-49c2-9c27-15dc3adb85bd None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:05.531466 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:05.575788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71edbb28-f94e-49c2-9c27-15dc3adb85bd None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:05.600345 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ba4d1-cc35-46fa-8885-c730e2986f9b None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:05.602834 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ba4d1-cc35-46fa-8885-c730e2986f9b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:05.603184 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17ba4d1-cc35-46fa-8885-c730e2986f9b None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:05.605050 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 499/1010] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:04:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:04:05.609557 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263d0d8-b02e-4749-9ef0-a89e31f5f4a1 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:05.609841 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263d0d8-b02e-4749-9ef0-a89e31f5f4a1 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:05.610115 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0263d0d8-b02e-4749-9ef0-a89e31f5f4a1 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:05.611439 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 500/1011] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:04:05.612692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460ac61-5e4a-4fb7-8684-c8c5f85db0a5 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:05.612917 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460ac61-5e4a-4fb7-8684-c8c5f85db0a5 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:05.613193 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460ac61-5e4a-4fb7-8684-c8c5f85db0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:05.615802 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca61f1-9bc0-4c31-9642-c4c6f5d68ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:05.616762 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca61f1-9bc0-4c31-9642-c4c6f5d68ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:05.617044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca61f1-9bc0-4c31-9642-c4c6f5d68ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:05.617316 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca61f1-9bc0-4c31-9642-c4c6f5d68ae9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:05.617893 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca61f1-9bc0-4c31-9642-c4c6f5d68ae9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:05.619251 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca61f1-9bc0-4c31-9642-c4c6f5d68ae9 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:05.628688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-3dca61f1-9bc0-4c31-9642-c4c6f5d68ae9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 21:04:05.628688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:05.628688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 21:04:05.628688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 21:04:05.628688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 21:04:05.628688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 21:04:05.628688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 21:04:05.628688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:04:05.628688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 21:04:05.628688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:04:05.628688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 21:04:05.628688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:04:05.628688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:05.628688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:04:05.628688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:04:05.628688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:04:05.628688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:04:05.629873 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:04:05.629873 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:04:05.629873 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:04:05.629873 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:04:05.629873 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:04:05.629873 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:04:05.629873 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 21:04:05.629873 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 21:04:05.629873 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 21:04:05.629873 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 21:04:05.629873 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:04:05.629873 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:04:05.629873 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:04:05.629873 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:04:05.629873 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:04:05.629873 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:04:05.630956 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:04:05.630956 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:04:05.630956 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:04:05.630956 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:04:05.630956 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:04:05.630956 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:04:05.630956 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:04:05.630956 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:04:05.630956 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:04:05.630956 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:04:05.630956 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 21:04:05.630956 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:04:05.630956 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 06 21:04:05.630956 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:04:05.632496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-2460ac61-5e4a-4fb7-8684-c8c5f85db0a5 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:04:05.633577 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2460ac61-5e4a-4fb7-8684-c8c5f85db0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:04:05.635463 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 512/1012] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:04:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:04:05.636792 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbba28-2159-4c4c-8c77-f79cb2e96d09 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:05.637074 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbba28-2159-4c4c-8c77-f79cb2e96d09 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:05.637351 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbba28-2159-4c4c-8c77-f79cb2e96d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:05.655557 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-b7fbba28-2159-4c4c-8c77-f79cb2e96d09 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:04:05.656793 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b7fbba28-2159-4c4c-8c77-f79cb2e96d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:04:05.705407 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 501/1013] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:04:05 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:04:05.706272 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460ac61-5e4a-4fb7-8684-c8c5f85db0a5 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:05.717234 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:05.736580 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 513/1014] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:04:05 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:04:05.814586 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460ac61-5e4a-4fb7-8684-c8c5f85db0a5 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:05.850173 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1de16e-b163-4a6c-a118-8b99149c7f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:05.851032 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1de16e-b163-4a6c-a118-8b99149c7f1b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:05.851483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1de16e-b163-4a6c-a118-8b99149c7f1b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:05.851909 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1de16e-b163-4a6c-a118-8b99149c7f1b None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:05.852742 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1de16e-b163-4a6c-a118-8b99149c7f1b None admin] RBAC: Adding query filter params (name=compute) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:05.858710 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1de16e-b163-4a6c-a118-8b99149c7f1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:05.858710 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1de16e-b163-4a6c-a118-8b99149c7f1b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:05.859857 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 502/1015] 10.222.0.81 () {56 vars in 1112 bytes} [Tue Sep 6 21:04:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:05.865396 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbba28-2159-4c4c-8c77-f79cb2e96d09 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:05.924557 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:05.974751 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fbba28-2159-4c4c-8c77-f79cb2e96d09 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:05.979896 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1de16e-b163-4a6c-a118-8b99149c7f1b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:06.016076 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105aa9c-5ae7-404a-9706-0dd6199678f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:06.017577 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105aa9c-5ae7-404a-9706-0dd6199678f2 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:06.017577 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105aa9c-5ae7-404a-9706-0dd6199678f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:06.017577 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105aa9c-5ae7-404a-9706-0dd6199678f2 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:06.017876 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105aa9c-5ae7-404a-9706-0dd6199678f2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:06.018178 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105aa9c-5ae7-404a-9706-0dd6199678f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:06.019982 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105aa9c-5ae7-404a-9706-0dd6199678f2 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:06.025356 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 514/1016] 10.222.0.81 () {56 vars in 1112 bytes} [Tue Sep 6 21:04:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:06.026040 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105aa9c-5ae7-404a-9706-0dd6199678f2 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:06.061435 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:06.093503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1de16e-b163-4a6c-a118-8b99149c7f1b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:06.130566 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1d368-e769-4ce2-94d1-b1fc95c8511e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:06.131699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1d368-e769-4ce2-94d1-b1fc95c8511e None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:06.131977 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1d368-e769-4ce2-94d1-b1fc95c8511e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:06.132286 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1d368-e769-4ce2-94d1-b1fc95c8511e None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:06.132976 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b1d368-e769-4ce2-94d1-b1fc95c8511e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:06.134330 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b1d368-e769-4ce2-94d1-b1fc95c8511e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:06.136892 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105aa9c-5ae7-404a-9706-0dd6199678f2 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:06.154424 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:06.171188 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb524e-57e2-4585-ae4b-47c8c7229383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:06.171817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb524e-57e2-4585-ae4b-47c8c7229383 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:06.172120 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb524e-57e2-4585-ae4b-47c8c7229383 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:06.172396 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abb524e-57e2-4585-ae4b-47c8c7229383 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:06.173506 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb524e-57e2-4585-ae4b-47c8c7229383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:06.174938 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abb524e-57e2-4585-ae4b-47c8c7229383 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:06.176532 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 515/1017] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:04:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:06.177346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb524e-57e2-4585-ae4b-47c8c7229383 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:06.233875 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 503/1018] 10.222.0.81 () {60 vars in 1141 bytes} [Tue Sep 6 21:04:05 2022] POST /identity/v3/services => generated 242 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:04:06.234756 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1d368-e769-4ce2-94d1-b1fc95c8511e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:06.305367 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abb524e-57e2-4585-ae4b-47c8c7229383 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:06.363530 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbb535-ff53-4b4f-936b-7afedea7c7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:06.364284 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbb535-ff53-4b4f-936b-7afedea7c7da None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:06.364565 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbb535-ff53-4b4f-936b-7afedea7c7da None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:06.364836 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbb535-ff53-4b4f-936b-7afedea7c7da None admin] PATH_INFO: `/v3/endpoints` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:06.366055 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfbb535-ff53-4b4f-936b-7afedea7c7da None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:06.367608 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfbb535-ff53-4b4f-936b-7afedea7c7da None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:06.384985 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1d368-e769-4ce2-94d1-b1fc95c8511e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:06.420136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:06.425295 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d54a536-4fbd-46ac-a684-f81e4f79b939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:06.425912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54a536-4fbd-46ac-a684-f81e4f79b939 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:06.426190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54a536-4fbd-46ac-a684-f81e4f79b939 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:06.426468 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d54a536-4fbd-46ac-a684-f81e4f79b939 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:06.429662 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d54a536-4fbd-46ac-a684-f81e4f79b939 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:06.429662 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d54a536-4fbd-46ac-a684-f81e4f79b939 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:06.451322 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 516/1019] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:04:06 2022] POST /identity/v3/endpoints => generated 334 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:04:06.501993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 504/1020] 10.222.0.81 () {60 vars in 1141 bytes} [Tue Sep 6 21:04:06 2022] POST /identity/v3/projects => generated 311 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:04:08.438741 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15209279-757b-4c0a-98ee-67107b8233e3 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:08.439301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15209279-757b-4c0a-98ee-67107b8233e3 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:08.439301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15209279-757b-4c0a-98ee-67107b8233e3 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:08.440838 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 517/1021] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:04:08.446075 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072caea9-fae5-4386-aab2-63d161e68817 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:08.446470 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072caea9-fae5-4386-aab2-63d161e68817 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:08.446651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072caea9-fae5-4386-aab2-63d161e68817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:08.465315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-072caea9-fae5-4386-aab2-63d161e68817 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:04:08.466516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-072caea9-fae5-4386-aab2-63d161e68817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:04:08.542415 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 505/1022] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:04:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:04:08.726893 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0836b08-bffb-4058-bc37-bb5633406f9d None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:08.727217 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0836b08-bffb-4058-bc37-bb5633406f9d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:08.727443 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0836b08-bffb-4058-bc37-bb5633406f9d None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:08.728946 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 518/1023] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:04:08.733912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1086f1a-909d-43ab-b003-6e6c6b39cefc None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:08.734202 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1086f1a-909d-43ab-b003-6e6c6b39cefc None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:08.734477 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1086f1a-909d-43ab-b003-6e6c6b39cefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:08.752881 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d1086f1a-909d-43ab-b003-6e6c6b39cefc None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:04:08.754477 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d1086f1a-909d-43ab-b003-6e6c6b39cefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:04:08.794959 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a6c6f-0fa8-40fe-99d6-a778146957e4 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:08.795153 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a6c6f-0fa8-40fe-99d6-a778146957e4 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:08.795431 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a6c6f-0fa8-40fe-99d6-a778146957e4 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:08.796939 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 519/1024] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:04:08.801741 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54cf4b-ace7-457e-b5ec-77bfd4dc6265 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:08.802034 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54cf4b-ace7-457e-b5ec-77bfd4dc6265 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:08.802312 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da54cf4b-ace7-457e-b5ec-77bfd4dc6265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:08.822125 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-da54cf4b-ace7-457e-b5ec-77bfd4dc6265 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:04:08.823363 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-da54cf4b-ace7-457e-b5ec-77bfd4dc6265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:04:08.828043 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 506/1025] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:04:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:04:08.828935 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1086f1a-909d-43ab-b003-6e6c6b39cefc None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:08.857951 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:08.871865 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:08.899775 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 520/1026] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:04:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 21:04:08.935018 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1086f1a-909d-43ab-b003-6e6c6b39cefc None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:08.977267 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913af38-84c3-4030-b412-739c016cec98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:08.977906 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913af38-84c3-4030-b412-739c016cec98 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:08.978185 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913af38-84c3-4030-b412-739c016cec98 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:08.978457 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913af38-84c3-4030-b412-739c016cec98 None admin] PATH_INFO: `/v3/services/image` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:08.979033 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913af38-84c3-4030-b412-739c016cec98 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:08.980417 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913af38-84c3-4030-b412-739c016cec98 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:08.989602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-3913af38-84c3-4030-b412-739c016cec98 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 21:04:08.989602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:08.989602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 21:04:08.989602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 21:04:08.989602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 21:04:08.989602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 21:04:08.989602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 21:04:08.989602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:04:08.989602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 21:04:08.989602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:04:08.989602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 21:04:08.989602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:04:08.989602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:08.989602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:04:08.989602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:04:08.989602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:04:08.989602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:04:08.994840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:04:08.994840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:04:08.994840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:04:08.994840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:04:08.994840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:04:08.994840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:04:08.994840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 21:04:08.994840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 21:04:08.994840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 21:04:08.994840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 21:04:08.994840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:04:08.994840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:04:08.994840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:04:08.994840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:04:08.994840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:04:08.994840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:04:08.995689 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:04:08.995689 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:04:08.995689 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:04:08.995689 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:04:08.995689 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:04:08.995689 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:04:08.995689 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:04:08.995689 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:04:08.995689 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:04:08.995689 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:04:08.995689 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 21:04:08.995689 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:04:08.995689 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 21:04:08.995689 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:04:08.995689 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 507/1027] 10.222.0.81 () {56 vars in 1105 bytes} [Tue Sep 6 21:04:08 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:04:08.997052 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54cf4b-ace7-457e-b5ec-77bfd4dc6265 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:09.103102 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913af38-84c3-4030-b412-739c016cec98 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:09.113162 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da54cf4b-ace7-457e-b5ec-77bfd4dc6265 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:09.154906 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83cdb2-2dee-4f8b-8c93-75eeac12b044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:09.155525 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83cdb2-2dee-4f8b-8c93-75eeac12b044 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:09.155805 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83cdb2-2dee-4f8b-8c93-75eeac12b044 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:09.156079 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa83cdb2-2dee-4f8b-8c93-75eeac12b044 None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:09.156732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83cdb2-2dee-4f8b-8c93-75eeac12b044 None admin] RBAC: Adding query filter params (name=image) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:09.157038 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83cdb2-2dee-4f8b-8c93-75eeac12b044 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:09.158409 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa83cdb2-2dee-4f8b-8c93-75eeac12b044 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:09.168409 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 521/1028] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:04:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:09.169610 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83cdb2-2dee-4f8b-8c93-75eeac12b044 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:09.202041 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:09.225244 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913af38-84c3-4030-b412-739c016cec98 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:09.227520 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:09.259452 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ad719-9cb2-44ed-a543-ffe228d3ae36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:09.260087 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ad719-9cb2-44ed-a543-ffe228d3ae36 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:09.260392 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ad719-9cb2-44ed-a543-ffe228d3ae36 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:09.260666 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281ad719-9cb2-44ed-a543-ffe228d3ae36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:09.261766 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ad719-9cb2-44ed-a543-ffe228d3ae36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:09.263401 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281ad719-9cb2-44ed-a543-ffe228d3ae36 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:09.266009 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 508/1029] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:04:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:04:09.266824 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ad719-9cb2-44ed-a543-ffe228d3ae36 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:09.280716 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa83cdb2-2dee-4f8b-8c93-75eeac12b044 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:09.315344 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640903c-c1c8-4d4b-9ef5-eb6d0e63a39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:09.315996 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640903c-c1c8-4d4b-9ef5-eb6d0e63a39a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:09.316303 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640903c-c1c8-4d4b-9ef5-eb6d0e63a39a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:09.316661 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b640903c-c1c8-4d4b-9ef5-eb6d0e63a39a None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:09.317180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b640903c-c1c8-4d4b-9ef5-eb6d0e63a39a None admin] RBAC: Adding query filter params (type=image) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:09.317484 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b640903c-c1c8-4d4b-9ef5-eb6d0e63a39a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:09.319545 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b640903c-c1c8-4d4b-9ef5-eb6d0e63a39a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:09.326763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 522/1030] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:04:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:04:09.327523 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640903c-c1c8-4d4b-9ef5-eb6d0e63a39a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:09.376669 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281ad719-9cb2-44ed-a543-ffe228d3ae36 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:09.415337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5340d99-69cd-49c7-b729-5d21c2dc20d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:09.415967 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5340d99-69cd-49c7-b729-5d21c2dc20d6 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:09.416279 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5340d99-69cd-49c7-b729-5d21c2dc20d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:09.416562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5340d99-69cd-49c7-b729-5d21c2dc20d6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:09.426639 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5340d99-69cd-49c7-b729-5d21c2dc20d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:04:09.432034 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-b5340d99-69cd-49c7-b729-5d21c2dc20d6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 21:04:09.432034 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:09.432034 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:04:09.432034 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:04:09.432034 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:04:09.432034 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:04:09.432034 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:04:09.432034 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:04:09.432034 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:04:09.432034 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:04:09.432034 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:04:09.432034 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:04:09.432034 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:04:09.432034 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:04:09.432034 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:04:09.432034 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:04:09.433071 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:04:09.433071 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:04:09.433071 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:04:09.433071 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:04:09.433071 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:04:09.433071 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:04:09.433071 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:04:09.433071 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:04:09.433071 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:04:09.433071 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:04:09.433071 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:04:09.433071 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:04:09.433071 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:04:09.433071 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:04:09.433071 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:04:09.433071 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:04:09.433951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:04:09.433951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:04:09.433951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:04:09.433951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:04:09.433951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:04:09.433951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:04:09.433951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:04:09.433951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:04:09.433951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:04:09.433951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:04:09.433951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 21:04:09.433951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:04:09.434664 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:09.436248 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 509/1031] 10.222.0.81 () {56 vars in 1120 bytes} [Tue Sep 6 21:04:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:04:09.437241 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5340d99-69cd-49c7-b729-5d21c2dc20d6 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:09.443257 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b640903c-c1c8-4d4b-9ef5-eb6d0e63a39a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:09.469803 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:09.479864 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cde955-d79c-4678-889d-3aed28538c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:09.480499 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cde955-d79c-4678-889d-3aed28538c39 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:09.480787 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cde955-d79c-4678-889d-3aed28538c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:09.481050 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cde955-d79c-4678-889d-3aed28538c39 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:09.481697 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cde955-d79c-4678-889d-3aed28538c39 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:09.483122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cde955-d79c-4678-889d-3aed28538c39 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:09.540625 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5340d99-69cd-49c7-b729-5d21c2dc20d6 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:09.574285 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1ed19-a8d3-45df-9484-37b1debf8c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:09.574890 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1ed19-a8d3-45df-9484-37b1debf8c3a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:09.575174 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1ed19-a8d3-45df-9484-37b1debf8c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:09.575454 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b1ed19-a8d3-45df-9484-37b1debf8c3a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:09.576181 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1ed19-a8d3-45df-9484-37b1debf8c3a None admin] RBAC: Adding query filter params (interface=public, service_id=a4563b2ed1b048668585a9b5d237ee74, region_id=RegionOne) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:09.576498 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1ed19-a8d3-45df-9484-37b1debf8c3a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:09.577863 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b1ed19-a8d3-45df-9484-37b1debf8c3a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:09.583367 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 510/1032] 10.222.0.81 () {56 vars in 1251 bytes} [Tue Sep 6 21:04:09 2022] GET /identity/v3/endpoints?service_id=a4563b2ed1b048668585a9b5d237ee74&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:09.583911 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1ed19-a8d3-45df-9484-37b1debf8c3a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:09.588639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 523/1033] 10.222.0.81 () {60 vars in 1132 bytes} [Tue Sep 6 21:04:09 2022] POST /identity/v3/users => generated 285 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:04:09.592929 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cde955-d79c-4678-889d-3aed28538c39 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:09.700626 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:09.706463 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b1ed19-a8d3-45df-9484-37b1debf8c3a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:09.711719 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cde955-d79c-4678-889d-3aed28538c39 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:09.751614 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b8413-67e3-456e-8024-9bb11678070b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:09.752282 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b8413-67e3-456e-8024-9bb11678070b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:09.752575 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b8413-67e3-456e-8024-9bb11678070b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:09.752849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b8413-67e3-456e-8024-9bb11678070b None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:09.753529 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b8413-67e3-456e-8024-9bb11678070b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:09.753842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b8413-67e3-456e-8024-9bb11678070b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:09.755245 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b8413-67e3-456e-8024-9bb11678070b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:09.765497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 511/1034] 10.222.0.81 () {56 vars in 1115 bytes} [Tue Sep 6 21:04:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:09.771327 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b8413-67e3-456e-8024-9bb11678070b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:09.781674 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26e4e1-37ea-43e6-a77b-30a4efc1986e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:09.782305 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26e4e1-37ea-43e6-a77b-30a4efc1986e None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:09.782584 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26e4e1-37ea-43e6-a77b-30a4efc1986e None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:09.782859 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb26e4e1-37ea-43e6-a77b-30a4efc1986e None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:09.783832 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb26e4e1-37ea-43e6-a77b-30a4efc1986e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:09.785627 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb26e4e1-37ea-43e6-a77b-30a4efc1986e None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:09.794099 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 524/1035] 10.222.0.81 () {56 vars in 1087 bytes} [Tue Sep 6 21:04:09 2022] GET /identity/v3/services => generated 1957 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:04:09.900412 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b8413-67e3-456e-8024-9bb11678070b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:09.937903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad71b5-7070-49e8-8082-e6491c1f68cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:09.938554 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad71b5-7070-49e8-8082-e6491c1f68cf None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:09.938901 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad71b5-7070-49e8-8082-e6491c1f68cf None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:09.939212 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad71b5-7070-49e8-8082-e6491c1f68cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:09.951860 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad71b5-7070-49e8-8082-e6491c1f68cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:09.953294 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad71b5-7070-49e8-8082-e6491c1f68cf None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:09.969606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-66ad71b5-7070-49e8-8082-e6491c1f68cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:04:09.969606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:09.969606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:04:09.969606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:04:09.969606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:04:09.969606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:04:09.969606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:04:09.969606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:04:09.969606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:04:09.969606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:04:09.969606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:04:09.969606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:04:09.969606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:04:09.969606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:04:09.969606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:04:09.969606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:04:09.970777 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:04:09.970777 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:04:09.970777 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:04:09.970777 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:04:09.970777 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:04:09.970777 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:04:09.970777 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:04:09.970777 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:04:09.970777 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:04:09.970777 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:04:09.970777 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:04:09.970777 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:04:09.970777 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:04:09.970777 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:04:09.970777 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:04:09.970777 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:04:09.970777 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:04:09.971697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:04:09.971697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:04:09.971697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:04:09.971697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 512/1036] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:04:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:04:09.977226 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26e4e1-37ea-43e6-a77b-30a4efc1986e None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:09.998448 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:10.088843 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb26e4e1-37ea-43e6-a77b-30a4efc1986e None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:10.124244 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82101afa-9b2a-4da6-be24-15ae1a07c83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:10.124846 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82101afa-9b2a-4da6-be24-15ae1a07c83b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:10.125122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82101afa-9b2a-4da6-be24-15ae1a07c83b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:10.125391 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82101afa-9b2a-4da6-be24-15ae1a07c83b None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:10.126122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82101afa-9b2a-4da6-be24-15ae1a07c83b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:10.126421 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82101afa-9b2a-4da6-be24-15ae1a07c83b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:10.127781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82101afa-9b2a-4da6-be24-15ae1a07c83b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:10.144182 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 525/1037] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:10.146027 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad71b5-7070-49e8-8082-e6491c1f68cf None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:10.161440 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:10.259152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad71b5-7070-49e8-8082-e6491c1f68cf None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:10.305637 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217ce73-85e9-4fdd-8f81-e9367f515f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:10.306303 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217ce73-85e9-4fdd-8f81-e9367f515f11 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:10.306549 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217ce73-85e9-4fdd-8f81-e9367f515f11 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:10.306820 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6217ce73-85e9-4fdd-8f81-e9367f515f11 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:10.314888 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217ce73-85e9-4fdd-8f81-e9367f515f11 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:10.316369 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6217ce73-85e9-4fdd-8f81-e9367f515f11 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:10.328370 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-6217ce73-85e9-4fdd-8f81-e9367f515f11 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 21:04:10.328370 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:10.328370 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:04:10.328370 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:04:10.328370 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:04:10.328370 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:04:10.328370 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:04:10.328370 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:04:10.328370 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:04:10.328370 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:04:10.328370 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:04:10.328370 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:04:10.328370 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:04:10.328370 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:04:10.328370 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:04:10.328370 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:04:10.329368 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:04:10.329368 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:04:10.329368 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:04:10.329368 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:04:10.329368 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:04:10.329368 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:04:10.329368 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:04:10.329368 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:04:10.329368 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:04:10.329368 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:04:10.329368 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:04:10.329368 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:04:10.329368 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:04:10.329368 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:04:10.329368 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:04:10.329368 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:04:10.329368 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:04:10.329368 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:04:10.330773 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:04:10.330773 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:04:10.330773 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:04:10.330773 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:04:10.330773 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:04:10.330773 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:04:10.330773 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:04:10.330773 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:04:10.330773 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 21:04:10.330773 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:04:10.332463 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 513/1038] 10.222.0.81 () {56 vars in 1093 bytes} [Tue Sep 6 21:04:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:04:10.335705 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82101afa-9b2a-4da6-be24-15ae1a07c83b None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:10.416450 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:10.439213 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82101afa-9b2a-4da6-be24-15ae1a07c83b None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:10.474728 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344132c-8059-4f6b-aeb7-f6685905f76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:10.475394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344132c-8059-4f6b-aeb7-f6685905f76c None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:10.475656 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344132c-8059-4f6b-aeb7-f6685905f76c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:10.475865 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344132c-8059-4f6b-aeb7-f6685905f76c None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:10.476607 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344132c-8059-4f6b-aeb7-f6685905f76c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:10.476913 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344132c-8059-4f6b-aeb7-f6685905f76c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:10.478328 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344132c-8059-4f6b-aeb7-f6685905f76c None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:10.496122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 526/1039] 10.222.0.81 () {56 vars in 1133 bytes} [Tue Sep 6 21:04:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:10.501939 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217ce73-85e9-4fdd-8f81-e9367f515f11 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:10.577024 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:10.609833 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6217ce73-85e9-4fdd-8f81-e9367f515f11 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:10.647359 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20d381-40c9-4b7e-bcc5-69f578e09b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:10.647954 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20d381-40c9-4b7e-bcc5-69f578e09b00 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:10.648263 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20d381-40c9-4b7e-bcc5-69f578e09b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:10.648537 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20d381-40c9-4b7e-bcc5-69f578e09b00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:10.719618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20d381-40c9-4b7e-bcc5-69f578e09b00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:10.721088 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20d381-40c9-4b7e-bcc5-69f578e09b00 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:10.791530 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:10.823961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 514/1040] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:04:10 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 21:04:10.829931 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344132c-8059-4f6b-aeb7-f6685905f76c None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:10.940652 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344132c-8059-4f6b-aeb7-f6685905f76c None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:10.978299 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632156fa-5a3f-447a-80f2-b67f50f84f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:10.978935 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632156fa-5a3f-447a-80f2-b67f50f84f49 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:10.979209 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632156fa-5a3f-447a-80f2-b67f50f84f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:10.979478 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632156fa-5a3f-447a-80f2-b67f50f84f49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:10.981480 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:10.990738 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632156fa-5a3f-447a-80f2-b67f50f84f49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:10.995741 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632156fa-5a3f-447a-80f2-b67f50f84f49 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:11.008694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-632156fa-5a3f-447a-80f2-b67f50f84f49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:04:11.008694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:11.008694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:04:11.008694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:04:11.008694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:04:11.008694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:04:11.008694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:04:11.008694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:04:11.008694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:04:11.008694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:04:11.008694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:04:11.008694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:04:11.008694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:04:11.008694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:04:11.008694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:04:11.008694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:04:11.009740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:04:11.009740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:04:11.009740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:04:11.009740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:04:11.009740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:04:11.009740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:04:11.009740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:04:11.009740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:04:11.009740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:04:11.009740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:04:11.009740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:04:11.009740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:04:11.009740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:04:11.009740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:04:11.009740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:04:11.009740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:04:11.009740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:04:11.010677 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:04:11.010677 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:04:11.010677 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:04:11.010677 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 527/1041] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:04:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:04:11.016599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20d381-40c9-4b7e-bcc5-69f578e09b00 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:11.118786 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20d381-40c9-4b7e-bcc5-69f578e09b00 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:11.158958 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b479a3-140b-4bf3-9304-e57ab27f43f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:11.159637 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b479a3-140b-4bf3-9304-e57ab27f43f8 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:11.159915 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b479a3-140b-4bf3-9304-e57ab27f43f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:11.160228 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b479a3-140b-4bf3-9304-e57ab27f43f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:11.160863 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b479a3-140b-4bf3-9304-e57ab27f43f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:11.161233 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b479a3-140b-4bf3-9304-e57ab27f43f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:11.162752 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b479a3-140b-4bf3-9304-e57ab27f43f8 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:11.174261 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 515/1042] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:11.179817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632156fa-5a3f-447a-80f2-b67f50f84f49 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:11.301470 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632156fa-5a3f-447a-80f2-b67f50f84f49 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:11.335797 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc22d33-2eda-4d1f-9215-10117c96e0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:11.336450 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc22d33-2eda-4d1f-9215-10117c96e0ab None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:11.336726 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc22d33-2eda-4d1f-9215-10117c96e0ab None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:11.336998 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc22d33-2eda-4d1f-9215-10117c96e0ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:11.343536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc22d33-2eda-4d1f-9215-10117c96e0ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:11.345010 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc22d33-2eda-4d1f-9215-10117c96e0ab None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:11.356243 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-cfc22d33-2eda-4d1f-9215-10117c96e0ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:04:11.356243 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:11.356243 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:04:11.356243 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:04:11.356243 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:04:11.356243 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:04:11.356243 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:04:11.356243 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:04:11.356243 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:04:11.356243 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:04:11.356243 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:04:11.356243 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:04:11.356243 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:04:11.356243 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:04:11.356243 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:04:11.357200 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:04:11.357200 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:04:11.357200 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:04:11.357200 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:04:11.357200 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:04:11.357200 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:04:11.357200 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:04:11.357200 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:04:11.357200 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:04:11.357200 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:04:11.357200 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:04:11.357200 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:04:11.357200 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:04:11.357200 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:04:11.357200 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:04:11.357200 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:04:11.357200 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:04:11.358191 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:04:11.358191 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:04:11.358191 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:04:11.358191 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:04:11.358191 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:04:11.358191 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:04:11.358191 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:04:11.358191 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:04:11.363872 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 528/1043] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:04:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:04:11.364030 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b479a3-140b-4bf3-9304-e57ab27f43f8 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:11.401138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:11.487713 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b479a3-140b-4bf3-9304-e57ab27f43f8 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:11.525332 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6544cc62-42cb-4947-9596-9e6be0d7ad59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:11.526640 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544cc62-42cb-4947-9596-9e6be0d7ad59 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:11.527165 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544cc62-42cb-4947-9596-9e6be0d7ad59 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:11.527591 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6544cc62-42cb-4947-9596-9e6be0d7ad59 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:11.528507 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544cc62-42cb-4947-9596-9e6be0d7ad59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:11.528965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544cc62-42cb-4947-9596-9e6be0d7ad59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:11.530630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6544cc62-42cb-4947-9596-9e6be0d7ad59 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:11.545951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 516/1044] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:04:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:11.552562 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc22d33-2eda-4d1f-9215-10117c96e0ab None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:11.606080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:11.664050 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc22d33-2eda-4d1f-9215-10117c96e0ab None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:11.703398 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa46d0-9fbe-4c02-9ac9-4f7306f8ed8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:11.704091 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa46d0-9fbe-4c02-9ac9-4f7306f8ed8a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:11.705009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa46d0-9fbe-4c02-9ac9-4f7306f8ed8a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:11.705009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa46d0-9fbe-4c02-9ac9-4f7306f8ed8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:11.705295 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa46d0-9fbe-4c02-9ac9-4f7306f8ed8a None admin] RBAC: Adding query filter params (role.id=10d5d25768bd401b86eabfddb1dadf98, scope.project.id=002e09339d4e49ce98434571d3b64248, user.id=4441d8fea57f401a96fb8cbd2b501059) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:11.705647 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa46d0-9fbe-4c02-9ac9-4f7306f8ed8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:11.706994 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa46d0-9fbe-4c02-9ac9-4f7306f8ed8a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:11.720145 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 529/1045] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:04:11 2022] GET /identity/v3/role_assignments?user.id=4441d8fea57f401a96fb8cbd2b501059&scope.project.id=002e09339d4e49ce98434571d3b64248&role.id=10d5d25768bd401b86eabfddb1dadf98 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:11.914230 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5b880-0026-45ff-aa9c-39969b54427b None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:11.914555 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5b880-0026-45ff-aa9c-39969b54427b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:11.914748 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5b880-0026-45ff-aa9c-39969b54427b None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:11.916427 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 517/1046] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:04:11.922246 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5faaad-00bc-4ec1-99c4-d1faf5ae6d29 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:11.922541 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5faaad-00bc-4ec1-99c4-d1faf5ae6d29 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:11.922822 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5faaad-00bc-4ec1-99c4-d1faf5ae6d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:11.941284 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-8e5faaad-00bc-4ec1-99c4-d1faf5ae6d29 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:04:11.942474 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8e5faaad-00bc-4ec1-99c4-d1faf5ae6d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:04:12.010475 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9ba08-b07b-413d-91ff-94edadaf5b6f None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:12.010798 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9ba08-b07b-413d-91ff-94edadaf5b6f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:12.011028 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9ba08-b07b-413d-91ff-94edadaf5b6f None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:12.012398 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 518/1047] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:04:12.015182 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 530/1048] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:04:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:04:12.017458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c7347-ae8c-4440-a231-ba295558d3a2 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:12.017744 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c7347-ae8c-4440-a231-ba295558d3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:12.018016 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c7347-ae8c-4440-a231-ba295558d3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:12.037000 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-571c7347-ae8c-4440-a231-ba295558d3a2 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:04:12.038218 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-571c7347-ae8c-4440-a231-ba295558d3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:04:12.107579 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 519/1049] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:04:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:04:12.285418 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5faaad-00bc-4ec1-99c4-d1faf5ae6d29 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:12.329492 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:12.375940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c7347-ae8c-4440-a231-ba295558d3a2 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:12.399821 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:12.401529 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5faaad-00bc-4ec1-99c4-d1faf5ae6d29 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:12.441129 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb00a3e-77f4-4175-93a4-af219231a52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:12.442448 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb00a3e-77f4-4175-93a4-af219231a52a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:12.442945 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb00a3e-77f4-4175-93a4-af219231a52a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:12.443377 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb00a3e-77f4-4175-93a4-af219231a52a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:12.456080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb00a3e-77f4-4175-93a4-af219231a52a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:04:12.462314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-fbb00a3e-77f4-4175-93a4-af219231a52a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:04:12.462314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:12.462314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:04:12.462314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:04:12.462314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:04:12.462314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:04:12.462314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:04:12.462314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:04:12.462314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:04:12.462314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:04:12.462314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:04:12.462314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:04:12.462314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:04:12.462314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:04:12.462314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:04:12.462314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:04:12.463287 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:04:12.463287 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:04:12.463287 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:04:12.463287 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:04:12.463287 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:04:12.463287 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:04:12.463287 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:04:12.463287 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:04:12.463287 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:04:12.463287 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:04:12.463287 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:04:12.463287 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:04:12.463287 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:04:12.463287 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:04:12.463287 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:04:12.463287 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:04:12.464208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:04:12.464208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:04:12.464208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:04:12.464208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:04:12.464208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:04:12.464208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:04:12.464208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:04:12.464208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:04:12.464208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:04:12.464208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:04:12.464208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:04:12.464208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:04:12.464208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 531/1050] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:04:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:04:12.469452 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb00a3e-77f4-4175-93a4-af219231a52a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:12.485700 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c7347-ae8c-4440-a231-ba295558d3a2 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:12.524188 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e205667-fa61-4d66-ab6d-5c5ea98fddcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:12.524737 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e205667-fa61-4d66-ab6d-5c5ea98fddcf None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:12.525025 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e205667-fa61-4d66-ab6d-5c5ea98fddcf None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:12.525300 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e205667-fa61-4d66-ab6d-5c5ea98fddcf None admin] PATH_INFO: `/v3/services/image` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:12.525884 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e205667-fa61-4d66-ab6d-5c5ea98fddcf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:12.527254 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e205667-fa61-4d66-ab6d-5c5ea98fddcf None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:12.536373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-3e205667-fa61-4d66-ab6d-5c5ea98fddcf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 21:04:12.536373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:12.536373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 21:04:12.536373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 21:04:12.536373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 21:04:12.536373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 21:04:12.536373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 21:04:12.536373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:04:12.536373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 21:04:12.536373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:04:12.536373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 21:04:12.536373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:04:12.536373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:12.536373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:04:12.536373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:04:12.536373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:04:12.536373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:04:12.537949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:04:12.537949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:04:12.537949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:04:12.537949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:04:12.537949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:04:12.537949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:04:12.537949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 21:04:12.537949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 21:04:12.537949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 21:04:12.537949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 21:04:12.537949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:04:12.537949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:04:12.537949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:04:12.537949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:04:12.537949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:04:12.537949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:04:12.539078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:04:12.539078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:04:12.539078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:04:12.539078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:04:12.539078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:04:12.539078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:04:12.539078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:04:12.539078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:04:12.539078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:04:12.539078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:04:12.539078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 21:04:12.539078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:04:12.539078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 06 21:04:12.539078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:04:12.539078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 520/1051] 10.222.0.81 () {56 vars in 1105 bytes} [Tue Sep 6 21:04:12 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:04:12.544404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e205667-fa61-4d66-ab6d-5c5ea98fddcf None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:12.582324 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:12.585272 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb00a3e-77f4-4175-93a4-af219231a52a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:12.627138 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d327c-77c0-4745-b3b0-3805287c6b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:12.627761 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d327c-77c0-4745-b3b0-3805287c6b9f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:12.628044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d327c-77c0-4745-b3b0-3805287c6b9f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:12.628444 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d327c-77c0-4745-b3b0-3805287c6b9f None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:12.629018 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d327c-77c0-4745-b3b0-3805287c6b9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:12.629324 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d327c-77c0-4745-b3b0-3805287c6b9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:12.630742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9d327c-77c0-4745-b3b0-3805287c6b9f None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:12.640046 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 532/1052] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:04:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:04:12.646064 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d327c-77c0-4745-b3b0-3805287c6b9f None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:12.655555 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:12.678959 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e205667-fa61-4d66-ab6d-5c5ea98fddcf None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:12.714443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1fdd8-f6c4-41d8-b41f-900af4ef67bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:12.715158 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1fdd8-f6c4-41d8-b41f-900af4ef67bb None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:12.715562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1fdd8-f6c4-41d8-b41f-900af4ef67bb None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:12.715837 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a1fdd8-f6c4-41d8-b41f-900af4ef67bb None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:12.716564 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1fdd8-f6c4-41d8-b41f-900af4ef67bb None admin] RBAC: Adding query filter params (name=image) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:12.716956 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1fdd8-f6c4-41d8-b41f-900af4ef67bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:12.718384 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a1fdd8-f6c4-41d8-b41f-900af4ef67bb None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:12.723538 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 521/1053] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:04:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:12.729868 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1fdd8-f6c4-41d8-b41f-900af4ef67bb None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:12.763535 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d327c-77c0-4745-b3b0-3805287c6b9f None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:12.803209 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5c518-b9d1-4e1a-a87c-ef3e5fa44a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:12.803850 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5c518-b9d1-4e1a-a87c-ef3e5fa44a22 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:12.804146 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5c518-b9d1-4e1a-a87c-ef3e5fa44a22 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:12.804502 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5c518-b9d1-4e1a-a87c-ef3e5fa44a22 None admin] PATH_INFO: `/v3/users/534f9b9d11894004a0f67266ad6ad91b` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:12.822437 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc5c518-b9d1-4e1a-a87c-ef3e5fa44a22 None admin] RBAC: Authorizing `identity:get_user(user_id=534f9b9d11894004a0f67266ad6ad91b)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:12.823894 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc5c518-b9d1-4e1a-a87c-ef3e5fa44a22 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:12.825640 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 533/1054] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:04:12 2022] GET /identity/v3/users/534f9b9d11894004a0f67266ad6ad91b => generated 285 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:04:12.831449 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5c518-b9d1-4e1a-a87c-ef3e5fa44a22 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:12.852126 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a1fdd8-f6c4-41d8-b41f-900af4ef67bb None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:12.858212 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:12.889994 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e4f86-4d18-4a39-80a3-7bf69055cef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:12.890614 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e4f86-4d18-4a39-80a3-7bf69055cef1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:12.890902 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e4f86-4d18-4a39-80a3-7bf69055cef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:12.891194 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e4f86-4d18-4a39-80a3-7bf69055cef1 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:12.891838 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e4f86-4d18-4a39-80a3-7bf69055cef1 None admin] RBAC: Adding query filter params (type=image) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:12.892166 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e4f86-4d18-4a39-80a3-7bf69055cef1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:12.893539 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e4f86-4d18-4a39-80a3-7bf69055cef1 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:12.899466 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 522/1055] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:04:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:04:12.905172 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e4f86-4d18-4a39-80a3-7bf69055cef1 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:12.921343 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:12.946293 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5c518-b9d1-4e1a-a87c-ef3e5fa44a22 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:12.983914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4babd-9b10-4e1f-9417-e801b3bb1949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:12.984580 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4babd-9b10-4e1f-9417-e801b3bb1949 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:12.984861 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4babd-9b10-4e1f-9417-e801b3bb1949 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:12.985134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b4babd-9b10-4e1f-9417-e801b3bb1949 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:13.013175 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e4f86-4d18-4a39-80a3-7bf69055cef1 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:13.050151 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170bef81-ab25-496a-806b-d0f082ca1615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:13.051116 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bef81-ab25-496a-806b-d0f082ca1615 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:13.051580 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bef81-ab25-496a-806b-d0f082ca1615 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:13.052081 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170bef81-ab25-496a-806b-d0f082ca1615 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:13.053082 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170bef81-ab25-496a-806b-d0f082ca1615 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:13.054851 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170bef81-ab25-496a-806b-d0f082ca1615 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:13.059027 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4babd-9b10-4e1f-9417-e801b3bb1949 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:13.060711 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b4babd-9b10-4e1f-9417-e801b3bb1949 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:13.082011 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:13.159313 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 534/1056] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:04:12 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 06 21:04:13.166762 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4babd-9b10-4e1f-9417-e801b3bb1949 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:13.169055 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 523/1057] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:04:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:04:13.296724 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b4babd-9b10-4e1f-9417-e801b3bb1949 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:13.320629 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:13.348945 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67aecd-590c-40c8-86b2-c3159907255c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:13.349434 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67aecd-590c-40c8-86b2-c3159907255c None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:13.349711 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67aecd-590c-40c8-86b2-c3159907255c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:13.349979 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67aecd-590c-40c8-86b2-c3159907255c None admin] PATH_INFO: `/v3/projects/82c5ccb1a7eb49be86cba168ea7a6afe` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:13.351405 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67aecd-590c-40c8-86b2-c3159907255c None admin] RBAC: Authorizing `identity:get_project(project_id=82c5ccb1a7eb49be86cba168ea7a6afe)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:13.352796 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67aecd-590c-40c8-86b2-c3159907255c None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:13.354551 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 535/1058] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:04:13 2022] GET /identity/v3/projects/82c5ccb1a7eb49be86cba168ea7a6afe => generated 311 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:04:13.360949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170bef81-ab25-496a-806b-d0f082ca1615 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:13.433507 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:13.481486 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170bef81-ab25-496a-806b-d0f082ca1615 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:13.518210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6acd74-0650-42db-b04d-505b369ff91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:13.518819 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6acd74-0650-42db-b04d-505b369ff91d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:13.519097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6acd74-0650-42db-b04d-505b369ff91d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:13.519369 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6acd74-0650-42db-b04d-505b369ff91d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:13.520121 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6acd74-0650-42db-b04d-505b369ff91d None admin] RBAC: Adding query filter params (role.id=fe9661f095094dd0931e0b96a1d6ef74, scope.project.id=82c5ccb1a7eb49be86cba168ea7a6afe, user.id=534f9b9d11894004a0f67266ad6ad91b) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:13.520435 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6acd74-0650-42db-b04d-505b369ff91d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:13.522481 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6acd74-0650-42db-b04d-505b369ff91d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:13.528698 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 524/1059] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:04:13 2022] GET /identity/v3/role_assignments?user.id=534f9b9d11894004a0f67266ad6ad91b&scope.project.id=82c5ccb1a7eb49be86cba168ea7a6afe&role.id=fe9661f095094dd0931e0b96a1d6ef74 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:13.929426 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17889bd9-d3d0-43e4-9f1d-dac2f554a117 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:13.929962 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17889bd9-d3d0-43e4-9f1d-dac2f554a117 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:13.930233 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17889bd9-d3d0-43e4-9f1d-dac2f554a117 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:13.931638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 536/1060] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:04:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:04:13.937026 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a3695-0d5a-4146-9d61-3ba1aac59f00 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:13.937320 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a3695-0d5a-4146-9d61-3ba1aac59f00 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:13.937598 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a3695-0d5a-4146-9d61-3ba1aac59f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:13.960792 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-360a3695-0d5a-4146-9d61-3ba1aac59f00 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:04:13.962013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-360a3695-0d5a-4146-9d61-3ba1aac59f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:04:14.035030 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 525/1061] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:04:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:04:14.305129 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17889bd9-d3d0-43e4-9f1d-dac2f554a117 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:14.413832 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17889bd9-d3d0-43e4-9f1d-dac2f554a117 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:14.449238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638342ed-edc2-488a-93b8-5b7e212f0c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:14.449907 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638342ed-edc2-488a-93b8-5b7e212f0c70 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:14.450197 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638342ed-edc2-488a-93b8-5b7e212f0c70 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:14.450470 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638342ed-edc2-488a-93b8-5b7e212f0c70 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:14.462147 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638342ed-edc2-488a-93b8-5b7e212f0c70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:04:14.467038 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-638342ed-edc2-488a-93b8-5b7e212f0c70 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 21:04:14.467038 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:14.467038 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:04:14.467038 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:04:14.467038 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:04:14.467038 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:04:14.467038 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:04:14.467038 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:04:14.467038 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:04:14.467038 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:04:14.467038 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:04:14.467038 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:04:14.467038 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:04:14.467038 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:04:14.467038 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:04:14.467038 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:04:14.468129 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:04:14.468129 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:04:14.468129 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:04:14.468129 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:04:14.468129 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:04:14.468129 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:04:14.468129 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:04:14.468129 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:04:14.468129 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:04:14.468129 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:04:14.468129 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:04:14.468129 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:04:14.468129 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:04:14.468129 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:04:14.468129 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:04:14.468129 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:04:14.468995 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:04:14.468995 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:04:14.468995 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:04:14.468995 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:04:14.468995 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:04:14.468995 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:04:14.468995 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:04:14.468995 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:04:14.468995 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:04:14.468995 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:04:14.468995 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 21:04:14.468995 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:04:14.470406 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 537/1062] 10.222.0.81 () {56 vars in 1120 bytes} [Tue Sep 6 21:04:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:04:14.474314 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a3695-0d5a-4146-9d61-3ba1aac59f00 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:14.543490 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:14.581694 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a3695-0d5a-4146-9d61-3ba1aac59f00 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:14.619163 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab305824-5046-4cfd-bcb9-a7b0a12b7cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:14.619768 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab305824-5046-4cfd-bcb9-a7b0a12b7cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:14.620046 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab305824-5046-4cfd-bcb9-a7b0a12b7cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:14.620345 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab305824-5046-4cfd-bcb9-a7b0a12b7cd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:14.621005 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab305824-5046-4cfd-bcb9-a7b0a12b7cd2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:14.621307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab305824-5046-4cfd-bcb9-a7b0a12b7cd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:14.622816 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab305824-5046-4cfd-bcb9-a7b0a12b7cd2 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:14.635882 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 526/1063] 10.222.0.81 () {56 vars in 1115 bytes} [Tue Sep 6 21:04:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:14.637256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638342ed-edc2-488a-93b8-5b7e212f0c70 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:14.687442 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:14.749384 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638342ed-edc2-488a-93b8-5b7e212f0c70 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:14.788632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299d9bb-328a-451d-afb7-5d295a4ab91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:14.789278 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299d9bb-328a-451d-afb7-5d295a4ab91d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:14.789562 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299d9bb-328a-451d-afb7-5d295a4ab91d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:14.789837 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299d9bb-328a-451d-afb7-5d295a4ab91d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:14.800818 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299d9bb-328a-451d-afb7-5d295a4ab91d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:14.802244 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299d9bb-328a-451d-afb7-5d295a4ab91d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:14.817659 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-f299d9bb-328a-451d-afb7-5d295a4ab91d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:04:14.817659 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:14.817659 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:04:14.817659 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:04:14.817659 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:04:14.817659 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:04:14.817659 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:04:14.817659 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:04:14.817659 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:04:14.817659 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:04:14.817659 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:04:14.817659 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:04:14.817659 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:04:14.817659 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:04:14.817659 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:04:14.817659 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:04:14.819230 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:04:14.819230 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:04:14.819230 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:04:14.819230 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:04:14.819230 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:04:14.819230 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:04:14.819230 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:04:14.819230 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:04:14.819230 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:04:14.819230 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:04:14.819230 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:04:14.819230 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:04:14.819230 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:04:14.819230 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:04:14.819230 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:04:14.819230 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:04:14.819230 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:04:14.820234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:04:14.820234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:04:14.820234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:04:14.820234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 538/1064] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:04:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:04:14.826488 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab305824-5046-4cfd-bcb9-a7b0a12b7cd2 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:14.935109 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab305824-5046-4cfd-bcb9-a7b0a12b7cd2 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:14.959612 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:14.971340 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090943ed-dd6f-4afa-b0ce-8e3c1d598ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:14.971958 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090943ed-dd6f-4afa-b0ce-8e3c1d598ecb None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:14.972269 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090943ed-dd6f-4afa-b0ce-8e3c1d598ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:14.972541 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090943ed-dd6f-4afa-b0ce-8e3c1d598ecb None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:14.973179 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090943ed-dd6f-4afa-b0ce-8e3c1d598ecb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:14.973484 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090943ed-dd6f-4afa-b0ce-8e3c1d598ecb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:14.974861 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090943ed-dd6f-4afa-b0ce-8e3c1d598ecb None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:14.991445 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 527/1065] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:14.992789 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299d9bb-328a-451d-afb7-5d295a4ab91d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:15.094093 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:15.101011 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299d9bb-328a-451d-afb7-5d295a4ab91d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:15.141213 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38aec34-3899-420e-9c37-fad3e8da12f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:15.141850 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38aec34-3899-420e-9c37-fad3e8da12f8 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:15.142127 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38aec34-3899-420e-9c37-fad3e8da12f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:15.142400 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38aec34-3899-420e-9c37-fad3e8da12f8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:15.150180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38aec34-3899-420e-9c37-fad3e8da12f8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:15.151701 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38aec34-3899-420e-9c37-fad3e8da12f8 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:15.164290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-f38aec34-3899-420e-9c37-fad3e8da12f8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 21:04:15.164290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:15.164290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:04:15.164290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:04:15.164290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:04:15.164290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:04:15.164290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:04:15.164290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:04:15.164290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:04:15.164290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:04:15.164290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:04:15.164290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:04:15.164290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:04:15.164290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:04:15.164290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:04:15.164290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:04:15.165297 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:04:15.165297 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:04:15.165297 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:04:15.165297 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:04:15.165297 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:04:15.165297 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:04:15.165297 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:04:15.165297 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:04:15.165297 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:04:15.165297 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:04:15.165297 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:04:15.165297 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:04:15.165297 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:04:15.165297 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:04:15.165297 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:04:15.165297 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:04:15.165297 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:04:15.165297 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:04:15.166333 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:04:15.166333 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:04:15.166333 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:04:15.166333 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:04:15.166333 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:04:15.166333 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:04:15.166333 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:04:15.166333 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:04:15.166333 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 21:04:15.166333 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:04:15.168444 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 539/1066] 10.222.0.81 () {56 vars in 1093 bytes} [Tue Sep 6 21:04:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:04:15.171270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090943ed-dd6f-4afa-b0ce-8e3c1d598ecb None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:15.287991 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090943ed-dd6f-4afa-b0ce-8e3c1d598ecb None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:15.330547 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb70ef-41a8-440e-beba-2e1f086fec53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:15.331171 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb70ef-41a8-440e-beba-2e1f086fec53 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:15.331455 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb70ef-41a8-440e-beba-2e1f086fec53 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:15.331791 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb70ef-41a8-440e-beba-2e1f086fec53 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:15.332559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb70ef-41a8-440e-beba-2e1f086fec53 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:15.332918 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb70ef-41a8-440e-beba-2e1f086fec53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:15.334423 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb70ef-41a8-440e-beba-2e1f086fec53 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:15.357730 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 528/1067] 10.222.0.81 () {56 vars in 1133 bytes} [Tue Sep 6 21:04:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:15.358556 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38aec34-3899-420e-9c37-fad3e8da12f8 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:15.405192 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59881f8-56ad-4f01-b8bd-0c404bdd07b1 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:15.405497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59881f8-56ad-4f01-b8bd-0c404bdd07b1 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:15.405754 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59881f8-56ad-4f01-b8bd-0c404bdd07b1 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:15.407343 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 529/1068] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:04:15.413077 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83d49b-bad2-4c0e-9a86-e89203f05f25 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:15.413264 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83d49b-bad2-4c0e-9a86-e89203f05f25 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:15.413967 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b83d49b-bad2-4c0e-9a86-e89203f05f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:15.433738 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-2b83d49b-bad2-4c0e-9a86-e89203f05f25 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:04:15.434938 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2b83d49b-bad2-4c0e-9a86-e89203f05f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:04:15.473847 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:15.482555 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38aec34-3899-420e-9c37-fad3e8da12f8 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:15.507210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 530/1069] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:04:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 21:04:15.520631 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8609dd-6b2f-4ee9-9d5d-66b68f63cb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:15.521276 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8609dd-6b2f-4ee9-9d5d-66b68f63cb2e None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:15.521556 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8609dd-6b2f-4ee9-9d5d-66b68f63cb2e None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:15.521827 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8609dd-6b2f-4ee9-9d5d-66b68f63cb2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:15.533616 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8609dd-6b2f-4ee9-9d5d-66b68f63cb2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:15.535051 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8609dd-6b2f-4ee9-9d5d-66b68f63cb2e None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:15.550763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-aa8609dd-6b2f-4ee9-9d5d-66b68f63cb2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:04:15.550763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:15.550763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:04:15.550763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:04:15.550763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:04:15.550763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:04:15.550763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:04:15.550763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:04:15.550763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:04:15.550763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:04:15.550763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:04:15.550763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:04:15.550763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:04:15.550763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:04:15.550763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:04:15.550763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:04:15.551800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:04:15.551800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:04:15.551800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:04:15.551800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:04:15.551800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:04:15.551800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:04:15.551800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:04:15.551800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:04:15.551800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:04:15.551800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:04:15.551800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:04:15.551800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:04:15.551800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:04:15.551800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:04:15.551800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:04:15.551800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:04:15.551800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:04:15.553932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:04:15.553932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:04:15.553932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:04:15.554612 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 540/1070] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:04:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:04:15.560697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83d49b-bad2-4c0e-9a86-e89203f05f25 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:15.683675 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b83d49b-bad2-4c0e-9a86-e89203f05f25 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:15.718703 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581063f8-5caa-4db7-bcd8-521db385cf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:15.719319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581063f8-5caa-4db7-bcd8-521db385cf23 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:15.719601 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581063f8-5caa-4db7-bcd8-521db385cf23 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:15.719874 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581063f8-5caa-4db7-bcd8-521db385cf23 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:15.720552 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581063f8-5caa-4db7-bcd8-521db385cf23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:15.720857 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581063f8-5caa-4db7-bcd8-521db385cf23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:15.722220 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581063f8-5caa-4db7-bcd8-521db385cf23 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:15.734573 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 531/1071] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:04:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:15.741080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8609dd-6b2f-4ee9-9d5d-66b68f63cb2e None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:15.742905 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6ee20-71d6-486e-8072-66949ffbfb56 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:15.743200 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6ee20-71d6-486e-8072-66949ffbfb56 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:15.743519 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6ee20-71d6-486e-8072-66949ffbfb56 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:15.746208 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 532/1072] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:04:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:04:15.751781 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0af2fb-8797-4aad-a42f-f9c8f4b1dbd1 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:15.752071 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0af2fb-8797-4aad-a42f-f9c8f4b1dbd1 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:15.752377 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0af2fb-8797-4aad-a42f-f9c8f4b1dbd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:15.753169 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:15.771461 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-4d0af2fb-8797-4aad-a42f-f9c8f4b1dbd1 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:04:15.776228 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4d0af2fb-8797-4aad-a42f-f9c8f4b1dbd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:04:15.800699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:15.843886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 533/1073] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:04:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 21:04:15.845070 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0af2fb-8797-4aad-a42f-f9c8f4b1dbd1 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:15.852534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8609dd-6b2f-4ee9-9d5d-66b68f63cb2e None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:15.893315 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3315206-cd8c-4c63-99fc-28e0804f446b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:15.893964 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3315206-cd8c-4c63-99fc-28e0804f446b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:15.894232 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3315206-cd8c-4c63-99fc-28e0804f446b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:15.894512 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3315206-cd8c-4c63-99fc-28e0804f446b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:15.902573 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3315206-cd8c-4c63-99fc-28e0804f446b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:15.904031 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3315206-cd8c-4c63-99fc-28e0804f446b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:15.917508 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-f3315206-cd8c-4c63-99fc-28e0804f446b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:04:15.917508 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:15.917508 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:04:15.917508 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:04:15.917508 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:04:15.917508 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:04:15.917508 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:04:15.917508 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:04:15.917508 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:04:15.917508 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:04:15.917508 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:04:15.917508 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:04:15.917508 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:04:15.917508 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:04:15.917508 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:04:15.918662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:04:15.918662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:04:15.918662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:04:15.918662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:04:15.918662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:04:15.918662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:04:15.918662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:04:15.918662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:04:15.918662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:04:15.918662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:04:15.918662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:04:15.918662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:04:15.918662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:04:15.918662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:04:15.918662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:04:15.918662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:04:15.918662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:04:15.919660 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:04:15.919660 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:04:15.919660 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:04:15.919660 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:04:15.919660 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:04:15.919660 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:04:15.919660 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:04:15.919660 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:04:15.923664 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 541/1074] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:04:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:04:15.924579 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3315206-cd8c-4c63-99fc-28e0804f446b None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:15.967200 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0af2fb-8797-4aad-a42f-f9c8f4b1dbd1 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:16.000486 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:16.009643 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13866159-ff85-4082-b53c-590a4eda907c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:16.019582 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13866159-ff85-4082-b53c-590a4eda907c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:16.019582 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13866159-ff85-4082-b53c-590a4eda907c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:16.019582 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13866159-ff85-4082-b53c-590a4eda907c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:16.038226 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3315206-cd8c-4c63-99fc-28e0804f446b None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:16.045912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:16.074742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f415031-ba56-445f-9cdb-0aefb000d1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:16.075362 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f415031-ba56-445f-9cdb-0aefb000d1a0 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:16.075643 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f415031-ba56-445f-9cdb-0aefb000d1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:16.075912 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f415031-ba56-445f-9cdb-0aefb000d1a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:16.076634 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f415031-ba56-445f-9cdb-0aefb000d1a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:16.076942 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f415031-ba56-445f-9cdb-0aefb000d1a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:16.078384 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f415031-ba56-445f-9cdb-0aefb000d1a0 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:16.088186 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13866159-ff85-4082-b53c-590a4eda907c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:16.090169 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13866159-ff85-4082-b53c-590a4eda907c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:16.091880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 542/1075] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:04:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:16.097623 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f415031-ba56-445f-9cdb-0aefb000d1a0 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:16.201366 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f415031-ba56-445f-9cdb-0aefb000d1a0 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:16.202257 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 534/1076] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:04:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 21:04:16.203126 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13866159-ff85-4082-b53c-590a4eda907c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:16.233530 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:16.244440 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd773c0-6a5f-4df7-a2d3-8f5a87e07024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:16.247764 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd773c0-6a5f-4df7-a2d3-8f5a87e07024 None admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:16.247764 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd773c0-6a5f-4df7-a2d3-8f5a87e07024 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:16.247764 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd773c0-6a5f-4df7-a2d3-8f5a87e07024 None admin] PATH_INFO: `/v3/projects/002e09339d4e49ce98434571d3b64248/users/4441d8fea57f401a96fb8cbd2b501059/roles/10d5d25768bd401b86eabfddb1dadf98` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:16.247764 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd773c0-6a5f-4df7-a2d3-8f5a87e07024 None admin] RBAC: Authorizing `identity:create_grant(project_id=002e09339d4e49ce98434571d3b64248, user_id=4441d8fea57f401a96fb8cbd2b501059, role_id=10d5d25768bd401b86eabfddb1dadf98)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:16.249298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd773c0-6a5f-4df7-a2d3-8f5a87e07024 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:16.279980 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:16.317479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13866159-ff85-4082-b53c-590a4eda907c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:16.354932 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413334ea-1f76-48ab-b4e1-0cd36fdab420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:16.355583 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413334ea-1f76-48ab-b4e1-0cd36fdab420 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:16.355859 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413334ea-1f76-48ab-b4e1-0cd36fdab420 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:16.356147 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413334ea-1f76-48ab-b4e1-0cd36fdab420 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:16.366397 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413334ea-1f76-48ab-b4e1-0cd36fdab420 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:04:16.371138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-413334ea-1f76-48ab-b4e1-0cd36fdab420 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:04:16.371138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:16.371138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:04:16.371138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:04:16.371138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:04:16.371138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:04:16.371138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:04:16.371138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:04:16.371138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:04:16.371138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:04:16.371138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:04:16.371138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:04:16.371138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:04:16.371138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:04:16.371138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:04:16.371138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:04:16.372324 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:04:16.372324 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:04:16.372324 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:04:16.372324 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:04:16.372324 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:04:16.372324 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:04:16.372324 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:04:16.372324 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:04:16.372324 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:04:16.372324 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:04:16.372324 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:04:16.372324 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:04:16.372324 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:04:16.372324 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:04:16.372324 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:04:16.372324 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:04:16.373535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:04:16.373535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:04:16.373535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:04:16.373535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:04:16.373535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:04:16.373535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:04:16.373535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:04:16.373535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:04:16.373535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:04:16.373535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:04:16.373535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:04:16.373535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:04:16.373535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 535/1077] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:04:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:04:16.373535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413334ea-1f76-48ab-b4e1-0cd36fdab420 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:16.383355 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 543/1078] 10.222.0.81 () {58 vars in 1439 bytes} [Tue Sep 6 21:04:16 2022] PUT /identity/v3/projects/002e09339d4e49ce98434571d3b64248/users/4441d8fea57f401a96fb8cbd2b501059/roles/10d5d25768bd401b86eabfddb1dadf98 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:04:16.384338 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd773c0-6a5f-4df7-a2d3-8f5a87e07024 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:16.497000 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413334ea-1f76-48ab-b4e1-0cd36fdab420 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:16.523509 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd773c0-6a5f-4df7-a2d3-8f5a87e07024 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:16.523899 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:16.538281 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b691c5-8cbc-4add-8662-e352591f2113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:16.539294 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b691c5-8cbc-4add-8662-e352591f2113 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:16.539583 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b691c5-8cbc-4add-8662-e352591f2113 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:16.539855 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b691c5-8cbc-4add-8662-e352591f2113 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:16.551738 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b691c5-8cbc-4add-8662-e352591f2113 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:16.553935 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b691c5-8cbc-4add-8662-e352591f2113 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:16.567782 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d948245-8d9c-4f3e-9566-13c6a34a7d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:16.568988 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d948245-8d9c-4f3e-9566-13c6a34a7d69 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:16.569294 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d948245-8d9c-4f3e-9566-13c6a34a7d69 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:16.569568 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d948245-8d9c-4f3e-9566-13c6a34a7d69 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:16.570260 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d948245-8d9c-4f3e-9566-13c6a34a7d69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:16.570587 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d948245-8d9c-4f3e-9566-13c6a34a7d69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:16.572008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d948245-8d9c-4f3e-9566-13c6a34a7d69 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:16.573744 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-95b691c5-8cbc-4add-8662-e352591f2113 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:04:16.573744 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:16.573744 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:04:16.573744 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:04:16.573744 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:04:16.573744 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:04:16.573744 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:04:16.573744 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:04:16.573744 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:04:16.573744 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:04:16.573744 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:04:16.573744 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:04:16.573744 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:04:16.573744 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:04:16.573744 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:04:16.573744 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:04:16.575049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:04:16.575049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:04:16.575049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:04:16.575049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:04:16.575049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:04:16.575049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:04:16.575049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:04:16.575049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:04:16.575049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:04:16.575049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:04:16.575049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:04:16.575049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:04:16.575049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:04:16.575049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:04:16.575049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:04:16.575049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:04:16.575049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:04:16.576599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:04:16.576599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:04:16.576599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:04:16.576599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 536/1079] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:04:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:04:16.581745 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 544/1080] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:04:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:16.582034 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b691c5-8cbc-4add-8662-e352591f2113 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:16.588035 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d948245-8d9c-4f3e-9566-13c6a34a7d69 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:16.645127 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:16.687646 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b691c5-8cbc-4add-8662-e352591f2113 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:16.699450 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d948245-8d9c-4f3e-9566-13c6a34a7d69 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:16.723170 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b8e6e-5af3-4697-87e2-cb7219fe8e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:16.723871 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b8e6e-5af3-4697-87e2-cb7219fe8e84 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:16.724825 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b8e6e-5af3-4697-87e2-cb7219fe8e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:16.725236 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b8e6e-5af3-4697-87e2-cb7219fe8e84 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:16.725869 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b8e6e-5af3-4697-87e2-cb7219fe8e84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:16.726176 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b8e6e-5af3-4697-87e2-cb7219fe8e84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:16.727529 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b8e6e-5af3-4697-87e2-cb7219fe8e84 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:16.737449 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6682a-9763-4e02-8bf5-6f8083652315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:16.738084 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6682a-9763-4e02-8bf5-6f8083652315 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:16.738359 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6682a-9763-4e02-8bf5-6f8083652315 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:16.738631 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6682a-9763-4e02-8bf5-6f8083652315 None admin] PATH_INFO: `/v3/users/534f9b9d11894004a0f67266ad6ad91b` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:16.739792 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6682a-9763-4e02-8bf5-6f8083652315 None admin] RBAC: Authorizing `identity:get_user(user_id=534f9b9d11894004a0f67266ad6ad91b)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:16.747083 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 537/1081] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:16.747332 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6682a-9763-4e02-8bf5-6f8083652315 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:16.747332 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 545/1082] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:04:16 2022] GET /identity/v3/users/534f9b9d11894004a0f67266ad6ad91b => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:04:16.748746 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b8e6e-5af3-4697-87e2-cb7219fe8e84 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:16.789337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:16.865235 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b8e6e-5af3-4697-87e2-cb7219fe8e84 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:16.906169 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4332d194-58b9-42a9-a490-a416cc4aa3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:16.906982 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332d194-58b9-42a9-a490-a416cc4aa3c5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:16.907367 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332d194-58b9-42a9-a490-a416cc4aa3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:16.907747 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4332d194-58b9-42a9-a490-a416cc4aa3c5 None admin] PATH_INFO: `/v3/projects/82c5ccb1a7eb49be86cba168ea7a6afe` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:16.909075 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332d194-58b9-42a9-a490-a416cc4aa3c5 None admin] RBAC: Authorizing `identity:get_project(project_id=82c5ccb1a7eb49be86cba168ea7a6afe)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:16.910722 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4332d194-58b9-42a9-a490-a416cc4aa3c5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:16.918202 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 538/1083] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:04:16 2022] GET /identity/v3/projects/82c5ccb1a7eb49be86cba168ea7a6afe => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:16.919422 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6682a-9763-4e02-8bf5-6f8083652315 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:17.032291 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6682a-9763-4e02-8bf5-6f8083652315 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:17.053938 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:17.072948 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6948b-c24e-4678-99c6-97a4d63069ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:17.073700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6948b-c24e-4678-99c6-97a4d63069ea None admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:17.073985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6948b-c24e-4678-99c6-97a4d63069ea None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:17.074262 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6948b-c24e-4678-99c6-97a4d63069ea None admin] PATH_INFO: `/v3/projects/82c5ccb1a7eb49be86cba168ea7a6afe/users/534f9b9d11894004a0f67266ad6ad91b/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:17.076399 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f6948b-c24e-4678-99c6-97a4d63069ea None admin] RBAC: Authorizing `identity:create_grant(project_id=82c5ccb1a7eb49be86cba168ea7a6afe, user_id=534f9b9d11894004a0f67266ad6ad91b, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:17.077835 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f6948b-c24e-4678-99c6-97a4d63069ea None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:17.147180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 546/1084] 10.222.0.81 () {58 vars in 1439 bytes} [Tue Sep 6 21:04:16 2022] PUT /identity/v3/projects/82c5ccb1a7eb49be86cba168ea7a6afe/users/534f9b9d11894004a0f67266ad6ad91b/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:04:18.577463 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb3325-5395-4b53-ae51-68833217bd09 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:18.578041 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb3325-5395-4b53-ae51-68833217bd09 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:18.578041 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb3325-5395-4b53-ae51-68833217bd09 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:18.579353 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 539/1085] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:04:18.584533 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea3b0f-44b6-4f03-9a13-43c6dc9d146c None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:18.584952 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea3b0f-44b6-4f03-9a13-43c6dc9d146c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:18.585084 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea3b0f-44b6-4f03-9a13-43c6dc9d146c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:18.603915 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-94ea3b0f-44b6-4f03-9a13-43c6dc9d146c None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:04:18.605117 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-94ea3b0f-44b6-4f03-9a13-43c6dc9d146c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:04:18.673847 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 547/1086] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:04:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:04:18.943019 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb3325-5395-4b53-ae51-68833217bd09 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:19.045809 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb3325-5395-4b53-ae51-68833217bd09 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:19.047326 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:19.079906 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c8539-a43d-4dce-8a7f-60a18413f0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:19.080550 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c8539-a43d-4dce-8a7f-60a18413f0bf None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:19.080828 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c8539-a43d-4dce-8a7f-60a18413f0bf None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:19.081098 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c8539-a43d-4dce-8a7f-60a18413f0bf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:19.091862 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694c8539-a43d-4dce-8a7f-60a18413f0bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:04:19.096728 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-694c8539-a43d-4dce-8a7f-60a18413f0bf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 21:04:19.096728 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:19.096728 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:04:19.096728 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:04:19.096728 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:04:19.096728 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:04:19.096728 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:04:19.096728 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:04:19.096728 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:04:19.096728 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:04:19.096728 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:04:19.096728 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:04:19.096728 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:04:19.096728 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:04:19.096728 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:04:19.096728 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:04:19.097687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:04:19.097687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:04:19.097687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:04:19.097687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:04:19.097687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:04:19.097687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:04:19.097687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:04:19.097687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:04:19.097687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:04:19.097687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:04:19.097687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:04:19.097687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:04:19.097687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:04:19.097687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:04:19.097687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:04:19.097687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:04:19.098581 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:04:19.098581 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:04:19.098581 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:04:19.098581 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:04:19.098581 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:04:19.098581 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:04:19.098581 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:04:19.098581 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:04:19.098581 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:04:19.098581 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:04:19.098581 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 06 21:04:19.098581 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:04:19.098581 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 540/1087] 10.222.0.81 () {56 vars in 1120 bytes} [Tue Sep 6 21:04:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:04:19.104467 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea3b0f-44b6-4f03-9a13-43c6dc9d146c None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:19.209100 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea3b0f-44b6-4f03-9a13-43c6dc9d146c None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:19.218227 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:19.242078 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d9a59d-1e8b-4382-85ff-5b40a1877acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:19.242691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9a59d-1e8b-4382-85ff-5b40a1877acf None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:19.242977 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9a59d-1e8b-4382-85ff-5b40a1877acf None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:19.243253 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d9a59d-1e8b-4382-85ff-5b40a1877acf None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:19.244323 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9a59d-1e8b-4382-85ff-5b40a1877acf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:19.244323 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9a59d-1e8b-4382-85ff-5b40a1877acf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:19.246486 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d9a59d-1e8b-4382-85ff-5b40a1877acf None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:19.254765 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 548/1088] 10.222.0.81 () {56 vars in 1115 bytes} [Tue Sep 6 21:04:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:19.261170 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c8539-a43d-4dce-8a7f-60a18413f0bf None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:19.282017 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e387ca-a768-47f9-94ac-5d0625086cc9 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:19.282316 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e387ca-a768-47f9-94ac-5d0625086cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:19.282598 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e387ca-a768-47f9-94ac-5d0625086cc9 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:19.283934 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 549/1089] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:04:19.289702 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951a8d4-3d0e-4414-a38a-22634de76aa0 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:19.290132 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951a8d4-3d0e-4414-a38a-22634de76aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:19.290412 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b951a8d4-3d0e-4414-a38a-22634de76aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:19.308412 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-b951a8d4-3d0e-4414-a38a-22634de76aa0 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:04:19.309618 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b951a8d4-3d0e-4414-a38a-22634de76aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:04:19.363226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c8539-a43d-4dce-8a7f-60a18413f0bf None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:19.376073 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 550/1090] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:04:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 21:04:19.397985 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83047abe-64a5-41e0-837a-c7bfae674929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:19.398623 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83047abe-64a5-41e0-837a-c7bfae674929 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:19.398906 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83047abe-64a5-41e0-837a-c7bfae674929 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:19.399183 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83047abe-64a5-41e0-837a-c7bfae674929 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:19.409734 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83047abe-64a5-41e0-837a-c7bfae674929 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:19.411188 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83047abe-64a5-41e0-837a-c7bfae674929 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:19.425721 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-83047abe-64a5-41e0-837a-c7bfae674929 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:04:19.425721 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:19.425721 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:04:19.425721 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:04:19.425721 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:04:19.425721 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:04:19.425721 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:04:19.425721 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:04:19.425721 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:04:19.425721 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:04:19.425721 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:04:19.425721 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:04:19.425721 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:04:19.425721 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:04:19.425721 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:04:19.425721 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:04:19.426692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:04:19.426692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:04:19.426692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:04:19.426692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:04:19.426692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:04:19.426692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:04:19.426692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:04:19.426692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:04:19.426692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:04:19.426692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:04:19.426692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:04:19.426692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:04:19.426692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:04:19.426692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:04:19.426692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:04:19.426692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:04:19.426692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:04:19.427999 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:04:19.427999 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:04:19.427999 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:04:19.427999 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 541/1091] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:04:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:04:19.433507 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951a8d4-3d0e-4414-a38a-22634de76aa0 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:19.531999 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:19.534904 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b951a8d4-3d0e-4414-a38a-22634de76aa0 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:19.569002 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ad42e-291f-490a-ab52-eea4125f9095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:19.569600 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ad42e-291f-490a-ab52-eea4125f9095 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:19.569875 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ad42e-291f-490a-ab52-eea4125f9095 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:19.570144 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ad42e-291f-490a-ab52-eea4125f9095 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:19.570771 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ad42e-291f-490a-ab52-eea4125f9095 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:19.571074 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ad42e-291f-490a-ab52-eea4125f9095 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:19.572512 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ad42e-291f-490a-ab52-eea4125f9095 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:19.583491 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 551/1092] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:19.589232 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83047abe-64a5-41e0-837a-c7bfae674929 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:19.606124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:19.644525 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ad42e-291f-490a-ab52-eea4125f9095 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:19.694167 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83047abe-64a5-41e0-837a-c7bfae674929 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:19.727454 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b0739-208d-4ee9-9a63-70808273f9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:19.728074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b0739-208d-4ee9-9a63-70808273f9d4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:19.728381 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b0739-208d-4ee9-9a63-70808273f9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:19.728653 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b0739-208d-4ee9-9a63-70808273f9d4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:19.735505 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b0739-208d-4ee9-9a63-70808273f9d4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:19.736961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b0739-208d-4ee9-9a63-70808273f9d4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:19.744737 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ad42e-291f-490a-ab52-eea4125f9095 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:19.749297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-675b0739-208d-4ee9-9a63-70808273f9d4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 06 21:04:19.749297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:19.749297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:04:19.749297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:04:19.749297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:04:19.749297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:04:19.749297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:04:19.749297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:04:19.749297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:04:19.749297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:04:19.749297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:04:19.749297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:04:19.749297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:04:19.749297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:04:19.749297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:04:19.749297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:04:19.755123 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:04:19.755123 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:04:19.755123 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:04:19.755123 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:04:19.755123 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:04:19.755123 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:04:19.755123 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:04:19.755123 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:04:19.755123 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:04:19.755123 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:04:19.755123 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:04:19.755123 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:04:19.755123 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:04:19.755123 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:04:19.755123 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:04:19.755123 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:04:19.755123 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:04:19.755123 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:04:19.756910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:04:19.756910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:04:19.756910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:04:19.756910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:04:19.756910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:04:19.756910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:04:19.756910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:04:19.756910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:04:19.756910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 06 21:04:19.756910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:04:19.756910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 542/1093] 10.222.0.81 () {56 vars in 1093 bytes} [Tue Sep 6 21:04:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:04:19.756910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b0739-208d-4ee9-9a63-70808273f9d4 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:19.779399 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0f960-bf89-49d0-9a14-3bf68faa3a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:19.780084 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0f960-bf89-49d0-9a14-3bf68faa3a00 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:19.780457 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0f960-bf89-49d0-9a14-3bf68faa3a00 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:19.780728 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0f960-bf89-49d0-9a14-3bf68faa3a00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:19.791788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d0f960-bf89-49d0-9a14-3bf68faa3a00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:04:19.796499 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-63d0f960-bf89-49d0-9a14-3bf68faa3a00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:04:19.796499 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:19.796499 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:04:19.796499 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:04:19.796499 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:04:19.796499 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:04:19.796499 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:04:19.796499 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:04:19.796499 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:04:19.796499 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:04:19.796499 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:04:19.796499 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:04:19.796499 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:04:19.796499 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:04:19.796499 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:04:19.796499 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:04:19.797487 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:04:19.797487 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:04:19.797487 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:04:19.797487 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:04:19.797487 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:04:19.797487 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:04:19.797487 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:04:19.797487 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:04:19.797487 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:04:19.797487 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:04:19.797487 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:04:19.797487 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:04:19.797487 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:04:19.797487 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:04:19.797487 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:04:19.797487 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:04:19.798462 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:04:19.798462 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:04:19.798462 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:04:19.798462 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:04:19.798462 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:04:19.798462 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:04:19.798462 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:04:19.798462 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:04:19.798462 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:04:19.798462 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:04:19.798462 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:04:19.798462 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:04:19.798462 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 552/1094] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:04:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:04:19.804239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0f960-bf89-49d0-9a14-3bf68faa3a00 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:19.826428 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:19.833139 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:19.858194 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b0739-208d-4ee9-9a63-70808273f9d4 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:19.892979 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e2ce0-09ea-42bd-bfea-6faa12c5f4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:19.893589 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e2ce0-09ea-42bd-bfea-6faa12c5f4ff None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:19.893873 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e2ce0-09ea-42bd-bfea-6faa12c5f4ff None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:19.894143 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e2ce0-09ea-42bd-bfea-6faa12c5f4ff None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:19.894868 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e2ce0-09ea-42bd-bfea-6faa12c5f4ff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:19.895172 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e2ce0-09ea-42bd-bfea-6faa12c5f4ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:19.896628 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e2ce0-09ea-42bd-bfea-6faa12c5f4ff None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:19.908595 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0f960-bf89-49d0-9a14-3bf68faa3a00 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:19.914343 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 543/1095] 10.222.0.81 () {56 vars in 1133 bytes} [Tue Sep 6 21:04:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:04:19.920016 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e2ce0-09ea-42bd-bfea-6faa12c5f4ff None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:19.948677 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68eb74-6535-468d-8e9d-85ddfd235652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:19.949298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68eb74-6535-468d-8e9d-85ddfd235652 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:19.949582 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68eb74-6535-468d-8e9d-85ddfd235652 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:19.949859 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68eb74-6535-468d-8e9d-85ddfd235652 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:19.950545 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68eb74-6535-468d-8e9d-85ddfd235652 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:19.950849 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68eb74-6535-468d-8e9d-85ddfd235652 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:19.952248 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68eb74-6535-468d-8e9d-85ddfd235652 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:19.960528 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 553/1096] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:04:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:04:19.966382 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68eb74-6535-468d-8e9d-85ddfd235652 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:20.021438 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e2ce0-09ea-42bd-bfea-6faa12c5f4ff None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:20.048979 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:20.051385 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:20.057020 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966da687-6b67-4dea-b08b-ecfc26879e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:20.057631 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966da687-6b67-4dea-b08b-ecfc26879e7d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:20.057966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966da687-6b67-4dea-b08b-ecfc26879e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:20.058186 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966da687-6b67-4dea-b08b-ecfc26879e7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:20.067497 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68eb74-6535-468d-8e9d-85ddfd235652 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:20.103071 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921af62f-409f-4670-a22c-efaaaaa03d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:20.103709 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921af62f-409f-4670-a22c-efaaaaa03d33 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:20.103993 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921af62f-409f-4670-a22c-efaaaaa03d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:20.104299 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921af62f-409f-4670-a22c-efaaaaa03d33 None admin] PATH_INFO: `/v3/users/534f9b9d11894004a0f67266ad6ad91b` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:20.105523 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921af62f-409f-4670-a22c-efaaaaa03d33 None admin] RBAC: Authorizing `identity:get_user(user_id=534f9b9d11894004a0f67266ad6ad91b)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:20.106978 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921af62f-409f-4670-a22c-efaaaaa03d33 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:20.108632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 554/1097] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:04:19 2022] GET /identity/v3/users/534f9b9d11894004a0f67266ad6ad91b => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:04:20.114282 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921af62f-409f-4670-a22c-efaaaaa03d33 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:20.131546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966da687-6b67-4dea-b08b-ecfc26879e7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:20.133031 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966da687-6b67-4dea-b08b-ecfc26879e7d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:20.212779 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921af62f-409f-4670-a22c-efaaaaa03d33 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:20.232795 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 544/1098] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:04:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 06 21:04:20.238448 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966da687-6b67-4dea-b08b-ecfc26879e7d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:20.248127 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad35b4-2002-48b5-8e9b-c36ab4a0bfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:20.248753 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad35b4-2002-48b5-8e9b-c36ab4a0bfde None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:20.249034 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad35b4-2002-48b5-8e9b-c36ab4a0bfde None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:20.249305 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baad35b4-2002-48b5-8e9b-c36ab4a0bfde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:20.268204 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:20.272216 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:20.323499 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baad35b4-2002-48b5-8e9b-c36ab4a0bfde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:20.324889 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baad35b4-2002-48b5-8e9b-c36ab4a0bfde None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:20.337924 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966da687-6b67-4dea-b08b-ecfc26879e7d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:20.374693 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092a694-8aed-475b-b496-4a518aa3a706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:20.375325 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092a694-8aed-475b-b496-4a518aa3a706 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:20.375604 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092a694-8aed-475b-b496-4a518aa3a706 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:20.375874 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092a694-8aed-475b-b496-4a518aa3a706 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:20.386003 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a092a694-8aed-475b-b496-4a518aa3a706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:20.387599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a092a694-8aed-475b-b496-4a518aa3a706 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:20.402567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-a092a694-8aed-475b-b496-4a518aa3a706 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:04:20.402567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:20.402567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:04:20.402567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:04:20.402567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:04:20.402567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:04:20.402567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:04:20.402567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:04:20.402567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:04:20.402567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:04:20.402567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:04:20.402567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:04:20.402567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:04:20.402567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:04:20.402567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:04:20.402567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:04:20.403603 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:04:20.403603 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:04:20.403603 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:04:20.403603 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:04:20.403603 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:04:20.403603 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:04:20.403603 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:04:20.403603 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:04:20.403603 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:04:20.403603 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:04:20.403603 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:04:20.403603 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:04:20.403603 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:04:20.403603 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:04:20.403603 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:04:20.403603 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:04:20.403603 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:04:20.404750 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:04:20.404750 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:04:20.404750 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:04:20.404750 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 545/1099] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:04:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:04:20.409319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092a694-8aed-475b-b496-4a518aa3a706 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:20.425078 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 555/1100] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:04:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 06 21:04:20.431081 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad35b4-2002-48b5-8e9b-c36ab4a0bfde None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:20.480111 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:20.492351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:20.507432 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092a694-8aed-475b-b496-4a518aa3a706 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:20.533236 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baad35b4-2002-48b5-8e9b-c36ab4a0bfde None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:20.541944 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c3b3b-0732-4fd3-bd24-16bdbb33d889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:20.542632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c3b3b-0732-4fd3-bd24-16bdbb33d889 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:20.542909 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c3b3b-0732-4fd3-bd24-16bdbb33d889 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:20.543182 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1c3b3b-0732-4fd3-bd24-16bdbb33d889 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:20.543812 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c3b3b-0732-4fd3-bd24-16bdbb33d889 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:20.544141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c3b3b-0732-4fd3-bd24-16bdbb33d889 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:20.545488 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1c3b3b-0732-4fd3-bd24-16bdbb33d889 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:20.557192 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 546/1101] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:04:20.565779 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c3b3b-0732-4fd3-bd24-16bdbb33d889 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:20.571527 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79478a2-b644-46dd-b94c-c3d6ab46abc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:20.572207 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79478a2-b644-46dd-b94c-c3d6ab46abc7 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:20.572491 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79478a2-b644-46dd-b94c-c3d6ab46abc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:20.572765 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79478a2-b644-46dd-b94c-c3d6ab46abc7 None admin] PATH_INFO: `/v3/projects/82c5ccb1a7eb49be86cba168ea7a6afe` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:20.573939 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79478a2-b644-46dd-b94c-c3d6ab46abc7 None admin] RBAC: Authorizing `identity:get_project(project_id=82c5ccb1a7eb49be86cba168ea7a6afe)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:20.575452 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79478a2-b644-46dd-b94c-c3d6ab46abc7 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:20.577121 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 556/1102] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:04:20 2022] GET /identity/v3/projects/82c5ccb1a7eb49be86cba168ea7a6afe => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:04:20.583064 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79478a2-b644-46dd-b94c-c3d6ab46abc7 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:20.666909 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1c3b3b-0732-4fd3-bd24-16bdbb33d889 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:20.683589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79478a2-b644-46dd-b94c-c3d6ab46abc7 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:20.700970 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e329e2-c618-47da-89c4-145070d46ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:20.701593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e329e2-c618-47da-89c4-145070d46ddb None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:20.701869 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e329e2-c618-47da-89c4-145070d46ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:20.702136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e329e2-c618-47da-89c4-145070d46ddb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:20.704855 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:20.709291 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e329e2-c618-47da-89c4-145070d46ddb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:20.710746 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e329e2-c618-47da-89c4-145070d46ddb None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:20.719549 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c4951-daca-4225-8417-1d5ee3614805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:20.720182 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c4951-daca-4225-8417-1d5ee3614805 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:20.720465 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c4951-daca-4225-8417-1d5ee3614805 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:20.720737 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c4951-daca-4225-8417-1d5ee3614805 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:20.721451 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c4951-daca-4225-8417-1d5ee3614805 None admin] RBAC: Adding query filter params (role.id=fe9661f095094dd0931e0b96a1d6ef74, scope.project.id=82c5ccb1a7eb49be86cba168ea7a6afe, user.id=534f9b9d11894004a0f67266ad6ad91b) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:20.721757 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c4951-daca-4225-8417-1d5ee3614805 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:20.722182 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-71e329e2-c618-47da-89c4-145070d46ddb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:04:20.722182 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:20.722182 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:04:20.722182 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:04:20.722182 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:04:20.722182 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:04:20.722182 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:04:20.722182 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:04:20.722182 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:04:20.722182 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:04:20.722182 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:04:20.722182 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:04:20.722182 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:04:20.722182 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:04:20.722182 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:04:20.723209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:04:20.723209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:04:20.723209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:04:20.723209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:04:20.723209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:04:20.723209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:04:20.723209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:04:20.723209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:04:20.723209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:04:20.723209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:04:20.723209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:04:20.723209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:04:20.723209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:04:20.723209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:04:20.723209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:04:20.723209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:04:20.723209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:04:20.724151 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:04:20.724151 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:04:20.724151 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:04:20.724151 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:04:20.724151 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:04:20.724151 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:04:20.724151 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:04:20.724151 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:04:20.724601 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c4951-daca-4225-8417-1d5ee3614805 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:20.724680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 547/1103] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:04:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:04:20.729190 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 557/1104] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:04:20 2022] GET /identity/v3/role_assignments?user.id=534f9b9d11894004a0f67266ad6ad91b&scope.project.id=82c5ccb1a7eb49be86cba168ea7a6afe&role.id=fe9661f095094dd0931e0b96a1d6ef74 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:04:20.729336 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e329e2-c618-47da-89c4-145070d46ddb None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:20.733156 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:20.838433 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e329e2-c618-47da-89c4-145070d46ddb None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:20.882728 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48feaaa3-aa81-478d-b683-73bd5a83ed38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:20.883357 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48feaaa3-aa81-478d-b683-73bd5a83ed38 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:20.883637 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48feaaa3-aa81-478d-b683-73bd5a83ed38 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:20.883911 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48feaaa3-aa81-478d-b683-73bd5a83ed38 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:20.884642 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48feaaa3-aa81-478d-b683-73bd5a83ed38 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:20.884951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48feaaa3-aa81-478d-b683-73bd5a83ed38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:20.886396 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48feaaa3-aa81-478d-b683-73bd5a83ed38 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:20.900132 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 548/1105] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:04:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:04:20.906439 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c4951-daca-4225-8417-1d5ee3614805 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:21.006521 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c4951-daca-4225-8417-1d5ee3614805 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:21.039756 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8ec2a0-feae-464e-941e-aea5fd43a181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:21.040379 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ec2a0-feae-464e-941e-aea5fd43a181 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:21.040658 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ec2a0-feae-464e-941e-aea5fd43a181 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:21.040927 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8ec2a0-feae-464e-941e-aea5fd43a181 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:21.041642 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ec2a0-feae-464e-941e-aea5fd43a181 None admin] RBAC: Adding query filter params (role.id=10d5d25768bd401b86eabfddb1dadf98, scope.project.id=002e09339d4e49ce98434571d3b64248, user.id=4441d8fea57f401a96fb8cbd2b501059) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:21.041950 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ec2a0-feae-464e-941e-aea5fd43a181 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:21.043368 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8ec2a0-feae-464e-941e-aea5fd43a181 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:21.049287 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 558/1106] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:04:20 2022] GET /identity/v3/role_assignments?user.id=4441d8fea57f401a96fb8cbd2b501059&scope.project.id=002e09339d4e49ce98434571d3b64248&role.id=10d5d25768bd401b86eabfddb1dadf98 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:22.922083 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c617317-d743-495b-9e21-21638ce00930 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:22.922622 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c617317-d743-495b-9e21-21638ce00930 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:22.922622 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c617317-d743-495b-9e21-21638ce00930 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:22.923958 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 549/1107] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:04:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:04:22.929264 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b86b24-c627-44ed-bcf1-31aa09d54e90 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:22.929677 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b86b24-c627-44ed-bcf1-31aa09d54e90 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:22.929816 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b86b24-c627-44ed-bcf1-31aa09d54e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:22.948527 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-92b86b24-c627-44ed-bcf1-31aa09d54e90 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:04:22.949717 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-92b86b24-c627-44ed-bcf1-31aa09d54e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:04:22.990766 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:23.015131 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 559/1108] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:04:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:04:23.285577 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c617317-d743-495b-9e21-21638ce00930 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:23.348535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:23.386287 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c617317-d743-495b-9e21-21638ce00930 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:23.419446 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c678d57c-ee0a-41e8-bec7-115f9008d745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:23.420057 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678d57c-ee0a-41e8-bec7-115f9008d745 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:23.420359 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678d57c-ee0a-41e8-bec7-115f9008d745 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:23.420631 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678d57c-ee0a-41e8-bec7-115f9008d745 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:23.421719 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c678d57c-ee0a-41e8-bec7-115f9008d745 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:23.423129 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c678d57c-ee0a-41e8-bec7-115f9008d745 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:23.424690 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 550/1109] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:04:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:23.430959 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b86b24-c627-44ed-bcf1-31aa09d54e90 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:23.526427 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b86b24-c627-44ed-bcf1-31aa09d54e90 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:23.563891 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb59ad-16c1-489b-8884-fda4c326c855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:23.564521 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb59ad-16c1-489b-8884-fda4c326c855 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:23.564798 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb59ad-16c1-489b-8884-fda4c326c855 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:23.565067 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb59ad-16c1-489b-8884-fda4c326c855 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:23.565715 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb59ad-16c1-489b-8884-fda4c326c855 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:23.567133 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb59ad-16c1-489b-8884-fda4c326c855 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:23.682924 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 560/1110] 10.222.0.81 () {60 vars in 1132 bytes} [Tue Sep 6 21:04:23 2022] POST /identity/v3/users => generated 286 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:04:25.881974 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6537ae-fc15-4fa2-8916-848e452ee263 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:25.882555 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6537ae-fc15-4fa2-8916-848e452ee263 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:25.882555 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6537ae-fc15-4fa2-8916-848e452ee263 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:25.883852 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 551/1111] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:04:25.889183 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a57a02-abdb-431d-b56f-86b888300ef6 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:25.889606 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a57a02-abdb-431d-b56f-86b888300ef6 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:25.889729 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a57a02-abdb-431d-b56f-86b888300ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:25.908699 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f8a57a02-abdb-431d-b56f-86b888300ef6 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:04:25.909878 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f8a57a02-abdb-431d-b56f-86b888300ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:04:25.935708 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:25.977230 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 561/1112] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:04:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:04:26.247159 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6537ae-fc15-4fa2-8916-848e452ee263 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:26.347363 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6537ae-fc15-4fa2-8916-848e452ee263 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:26.375849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:26.380184 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a491e7-db57-41fd-9048-63eb9421fe39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:26.381301 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a491e7-db57-41fd-9048-63eb9421fe39 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:26.381581 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a491e7-db57-41fd-9048-63eb9421fe39 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:26.381852 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a491e7-db57-41fd-9048-63eb9421fe39 None admin] PATH_INFO: `/v3/roles/c1dd3aa5113d434ab8306e2453a5ba6a` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:26.383235 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a491e7-db57-41fd-9048-63eb9421fe39 None admin] RBAC: Authorizing `identity:get_role(role_id=c1dd3aa5113d434ab8306e2453a5ba6a)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:26.384620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a491e7-db57-41fd-9048-63eb9421fe39 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:26.385933 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 552/1113] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:04:26 2022] GET /identity/v3/roles/c1dd3aa5113d434ab8306e2453a5ba6a => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:26.391843 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a57a02-abdb-431d-b56f-86b888300ef6 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:26.487235 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a57a02-abdb-431d-b56f-86b888300ef6 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:26.520719 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cd208-7698-4d78-82da-a9079dd9a7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:26.521290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cd208-7698-4d78-82da-a9079dd9a7fa None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:26.521572 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cd208-7698-4d78-82da-a9079dd9a7fa None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:26.521844 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586cd208-7698-4d78-82da-a9079dd9a7fa None admin] PATH_INFO: `/v3/users/a0e966cabb4b4bd3b3d51a1128ae7c0c` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:26.534373 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cd208-7698-4d78-82da-a9079dd9a7fa None admin] RBAC: Authorizing `identity:get_user(user_id=a0e966cabb4b4bd3b3d51a1128ae7c0c)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:26.535817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586cd208-7698-4d78-82da-a9079dd9a7fa None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:26.537460 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 562/1114] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:04:26 2022] GET /identity/v3/users/a0e966cabb4b4bd3b3d51a1128ae7c0c => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:26.543697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a491e7-db57-41fd-9048-63eb9421fe39 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:26.640928 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a491e7-db57-41fd-9048-63eb9421fe39 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:26.674935 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4d854-6e4f-4ea1-a20a-e4252cf61a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:26.675509 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4d854-6e4f-4ea1-a20a-e4252cf61a46 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:26.675789 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4d854-6e4f-4ea1-a20a-e4252cf61a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:26.676062 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4d854-6e4f-4ea1-a20a-e4252cf61a46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:26.738908 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:26.741150 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4d854-6e4f-4ea1-a20a-e4252cf61a46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:26.742586 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4d854-6e4f-4ea1-a20a-e4252cf61a46 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:26.838301 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 553/1115] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:04:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 21:04:26.844244 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cd208-7698-4d78-82da-a9079dd9a7fa None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:26.865339 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:26.941108 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586cd208-7698-4d78-82da-a9079dd9a7fa None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:26.974434 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ec246-2078-43c3-a575-ac98f571b4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:26.975056 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ec246-2078-43c3-a575-ac98f571b4b9 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:26.975334 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ec246-2078-43c3-a575-ac98f571b4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:26.975606 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ec246-2078-43c3-a575-ac98f571b4b9 None admin] PATH_INFO: `/v3/projects/82c5ccb1a7eb49be86cba168ea7a6afe` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:26.976698 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ec246-2078-43c3-a575-ac98f571b4b9 None admin] RBAC: Authorizing `identity:get_project(project_id=82c5ccb1a7eb49be86cba168ea7a6afe)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:26.978129 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ec246-2078-43c3-a575-ac98f571b4b9 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:26.979746 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 563/1116] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:04:26 2022] GET /identity/v3/projects/82c5ccb1a7eb49be86cba168ea7a6afe => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:26.986462 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4d854-6e4f-4ea1-a20a-e4252cf61a46 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:27.079959 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:27.082884 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4d854-6e4f-4ea1-a20a-e4252cf61a46 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:27.116167 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1cf532-103b-4708-9afa-0adaba551fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:27.116703 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1cf532-103b-4708-9afa-0adaba551fde None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:27.116978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1cf532-103b-4708-9afa-0adaba551fde None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:27.117246 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1cf532-103b-4708-9afa-0adaba551fde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:27.117954 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1cf532-103b-4708-9afa-0adaba551fde None admin] RBAC: Adding query filter params (role.id=c1dd3aa5113d434ab8306e2453a5ba6a, scope.project.id=82c5ccb1a7eb49be86cba168ea7a6afe, user.id=a0e966cabb4b4bd3b3d51a1128ae7c0c) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:27.118254 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1cf532-103b-4708-9afa-0adaba551fde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:27.119657 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1cf532-103b-4708-9afa-0adaba551fde None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:27.124874 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 554/1117] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:04:26 2022] GET /identity/v3/role_assignments?user.id=a0e966cabb4b4bd3b3d51a1128ae7c0c&scope.project.id=82c5ccb1a7eb49be86cba168ea7a6afe&role.id=c1dd3aa5113d434ab8306e2453a5ba6a => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:29.233728 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca9ef0-9b85-4bd3-bde5-c1f346cb6c2d None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:29.234270 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca9ef0-9b85-4bd3-bde5-c1f346cb6c2d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:29.234270 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca9ef0-9b85-4bd3-bde5-c1f346cb6c2d None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:29.235597 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 564/1118] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:04:29.241237 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd0ab0-914b-49c4-9938-52185cb9f1fd None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:29.241677 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd0ab0-914b-49c4-9938-52185cb9f1fd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:29.241769 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd0ab0-914b-49c4-9938-52185cb9f1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:29.259770 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-25cd0ab0-914b-49c4-9938-52185cb9f1fd None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:04:29.260988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-25cd0ab0-914b-49c4-9938-52185cb9f1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:04:29.326647 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 555/1119] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:04:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:04:29.595333 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca9ef0-9b85-4bd3-bde5-c1f346cb6c2d None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:29.684012 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:29.697586 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca9ef0-9b85-4bd3-bde5-c1f346cb6c2d None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:29.730111 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22dc7b-82a3-40df-a5b4-843240fd19bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:29.730728 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22dc7b-82a3-40df-a5b4-843240fd19bb None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:29.731011 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22dc7b-82a3-40df-a5b4-843240fd19bb None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:29.731290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c22dc7b-82a3-40df-a5b4-843240fd19bb None admin] PATH_INFO: `/v3/roles/c1dd3aa5113d434ab8306e2453a5ba6a` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:29.732687 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22dc7b-82a3-40df-a5b4-843240fd19bb None admin] RBAC: Authorizing `identity:get_role(role_id=c1dd3aa5113d434ab8306e2453a5ba6a)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:29.734060 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c22dc7b-82a3-40df-a5b4-843240fd19bb None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:29.735366 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 565/1120] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:04:29 2022] GET /identity/v3/roles/c1dd3aa5113d434ab8306e2453a5ba6a => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:29.741306 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd0ab0-914b-49c4-9938-52185cb9f1fd None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:29.843382 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:29.849810 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd0ab0-914b-49c4-9938-52185cb9f1fd None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:29.883454 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b20fca-50d1-4e93-9890-4a7a6d58742f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:29.884088 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b20fca-50d1-4e93-9890-4a7a6d58742f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:29.884393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b20fca-50d1-4e93-9890-4a7a6d58742f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:29.884670 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b20fca-50d1-4e93-9890-4a7a6d58742f None admin] PATH_INFO: `/v3/users/a0e966cabb4b4bd3b3d51a1128ae7c0c` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:29.885788 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b20fca-50d1-4e93-9890-4a7a6d58742f None admin] RBAC: Authorizing `identity:get_user(user_id=a0e966cabb4b4bd3b3d51a1128ae7c0c)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:29.887210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b20fca-50d1-4e93-9890-4a7a6d58742f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:29.888826 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 556/1121] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:04:29 2022] GET /identity/v3/users/a0e966cabb4b4bd3b3d51a1128ae7c0c => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:29.895048 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22dc7b-82a3-40df-a5b4-843240fd19bb None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:29.991702 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c22dc7b-82a3-40df-a5b4-843240fd19bb None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:30.026461 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda42855-7af3-41d1-aacd-c3c0173fb08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:30.027091 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda42855-7af3-41d1-aacd-c3c0173fb08f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:30.027367 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda42855-7af3-41d1-aacd-c3c0173fb08f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:30.027637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda42855-7af3-41d1-aacd-c3c0173fb08f None admin] PATH_INFO: `/v3/projects/82c5ccb1a7eb49be86cba168ea7a6afe` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:30.028755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda42855-7af3-41d1-aacd-c3c0173fb08f None admin] RBAC: Authorizing `identity:get_project(project_id=82c5ccb1a7eb49be86cba168ea7a6afe)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:30.030184 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda42855-7af3-41d1-aacd-c3c0173fb08f None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:30.031800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 566/1122] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:04:29 2022] GET /identity/v3/projects/82c5ccb1a7eb49be86cba168ea7a6afe => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:30.037941 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b20fca-50d1-4e93-9890-4a7a6d58742f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:30.134412 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b20fca-50d1-4e93-9890-4a7a6d58742f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:30.167303 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736428c-1d25-44d0-91c4-fc494b1851c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:30.168125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736428c-1d25-44d0-91c4-fc494b1851c7 None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:30.168411 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736428c-1d25-44d0-91c4-fc494b1851c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:30.168683 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736428c-1d25-44d0-91c4-fc494b1851c7 None admin] PATH_INFO: `/v3/projects/82c5ccb1a7eb49be86cba168ea7a6afe/users/a0e966cabb4b4bd3b3d51a1128ae7c0c/roles/c1dd3aa5113d434ab8306e2453a5ba6a` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:30.170780 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736428c-1d25-44d0-91c4-fc494b1851c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=82c5ccb1a7eb49be86cba168ea7a6afe, user_id=a0e966cabb4b4bd3b3d51a1128ae7c0c, role_id=c1dd3aa5113d434ab8306e2453a5ba6a)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:30.172213 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736428c-1d25-44d0-91c4-fc494b1851c7 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:30.271970 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 557/1123] 10.222.0.81 () {58 vars in 1439 bytes} [Tue Sep 6 21:04:30 2022] PUT /identity/v3/projects/82c5ccb1a7eb49be86cba168ea7a6afe/users/a0e966cabb4b4bd3b3d51a1128ae7c0c/roles/c1dd3aa5113d434ab8306e2453a5ba6a => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:04:32.403924 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b175b-be38-45b5-8a50-bf6a1e611d2b None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:32.404482 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b175b-be38-45b5-8a50-bf6a1e611d2b None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:32.404656 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b175b-be38-45b5-8a50-bf6a1e611d2b None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:32.406036 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 567/1124] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:04:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:04:32.412178 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4303208-ad79-46c1-af23-bf276aa67eaf None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:32.412601 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4303208-ad79-46c1-af23-bf276aa67eaf None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:32.412726 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4303208-ad79-46c1-af23-bf276aa67eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:32.430717 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a4303208-ad79-46c1-af23-bf276aa67eaf None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:04:32.431888 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a4303208-ad79-46c1-af23-bf276aa67eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:04:32.448119 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:32.497849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 558/1125] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:04:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 21:04:32.765179 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b175b-be38-45b5-8a50-bf6a1e611d2b None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:32.791171 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:32.867260 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b175b-be38-45b5-8a50-bf6a1e611d2b None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:32.910732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23895d46-a121-48c7-9784-12c262c1d53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:32.911397 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23895d46-a121-48c7-9784-12c262c1d53f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:32.911673 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23895d46-a121-48c7-9784-12c262c1d53f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:32.911942 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23895d46-a121-48c7-9784-12c262c1d53f None admin] PATH_INFO: `/v3/roles/c1dd3aa5113d434ab8306e2453a5ba6a` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:32.913657 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23895d46-a121-48c7-9784-12c262c1d53f None admin] RBAC: Authorizing `identity:get_role(role_id=c1dd3aa5113d434ab8306e2453a5ba6a)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:32.915024 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23895d46-a121-48c7-9784-12c262c1d53f None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:32.916579 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 568/1126] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:04:32 2022] GET /identity/v3/roles/c1dd3aa5113d434ab8306e2453a5ba6a => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:32.922618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4303208-ad79-46c1-af23-bf276aa67eaf None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:33.019799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4303208-ad79-46c1-af23-bf276aa67eaf None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:33.053590 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b755e-8a82-47f7-b995-d9bcf80c914d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:33.054211 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b755e-8a82-47f7-b995-d9bcf80c914d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:33.054487 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b755e-8a82-47f7-b995-d9bcf80c914d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:33.054756 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b755e-8a82-47f7-b995-d9bcf80c914d None admin] PATH_INFO: `/v3/users/a0e966cabb4b4bd3b3d51a1128ae7c0c` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:33.055854 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b755e-8a82-47f7-b995-d9bcf80c914d None admin] RBAC: Authorizing `identity:get_user(user_id=a0e966cabb4b4bd3b3d51a1128ae7c0c)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:33.057292 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b755e-8a82-47f7-b995-d9bcf80c914d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:33.058849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 559/1127] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:04:32 2022] GET /identity/v3/users/a0e966cabb4b4bd3b3d51a1128ae7c0c => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:33.064771 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23895d46-a121-48c7-9784-12c262c1d53f None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:33.155881 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:33.164823 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23895d46-a121-48c7-9784-12c262c1d53f None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:33.198907 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487a1ad-7c97-4da1-82a7-472f5a66ddc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:33.199506 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487a1ad-7c97-4da1-82a7-472f5a66ddc9 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:33.199785 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487a1ad-7c97-4da1-82a7-472f5a66ddc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:33.200061 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4487a1ad-7c97-4da1-82a7-472f5a66ddc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:33.265579 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487a1ad-7c97-4da1-82a7-472f5a66ddc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:33.267428 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4487a1ad-7c97-4da1-82a7-472f5a66ddc9 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:33.355164 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:33.364085 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 569/1128] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:04:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 21:04:33.370731 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b755e-8a82-47f7-b995-d9bcf80c914d None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:33.392900 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:33.469639 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b755e-8a82-47f7-b995-d9bcf80c914d None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:33.501780 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db6c7d-5c4f-45e5-b82c-9321c41306d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:33.502399 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db6c7d-5c4f-45e5-b82c-9321c41306d5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:33.502676 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db6c7d-5c4f-45e5-b82c-9321c41306d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:33.502947 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db6c7d-5c4f-45e5-b82c-9321c41306d5 None admin] PATH_INFO: `/v3/projects/82c5ccb1a7eb49be86cba168ea7a6afe` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:33.504041 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db6c7d-5c4f-45e5-b82c-9321c41306d5 None admin] RBAC: Authorizing `identity:get_project(project_id=82c5ccb1a7eb49be86cba168ea7a6afe)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:33.506089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db6c7d-5c4f-45e5-b82c-9321c41306d5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:33.507696 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 560/1129] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:04:33 2022] GET /identity/v3/projects/82c5ccb1a7eb49be86cba168ea7a6afe => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:33.513881 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487a1ad-7c97-4da1-82a7-472f5a66ddc9 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:33.612334 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4487a1ad-7c97-4da1-82a7-472f5a66ddc9 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:33.647426 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f318a2-1ee7-4810-b3fd-7237808090d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:33.648028 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f318a2-1ee7-4810-b3fd-7237808090d8 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:33.648338 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f318a2-1ee7-4810-b3fd-7237808090d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:33.648614 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f318a2-1ee7-4810-b3fd-7237808090d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:33.649332 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f318a2-1ee7-4810-b3fd-7237808090d8 None admin] RBAC: Adding query filter params (role.id=c1dd3aa5113d434ab8306e2453a5ba6a, scope.project.id=82c5ccb1a7eb49be86cba168ea7a6afe, user.id=a0e966cabb4b4bd3b3d51a1128ae7c0c) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:33.649643 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f318a2-1ee7-4810-b3fd-7237808090d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:33.651075 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f318a2-1ee7-4810-b3fd-7237808090d8 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:33.656774 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 570/1130] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:04:33 2022] GET /identity/v3/role_assignments?user.id=a0e966cabb4b4bd3b3d51a1128ae7c0c&scope.project.id=82c5ccb1a7eb49be86cba168ea7a6afe&role.id=c1dd3aa5113d434ab8306e2453a5ba6a => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:35.840423 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba899bc-35a6-445c-85d7-8ebfb88418b7 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:35.840962 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba899bc-35a6-445c-85d7-8ebfb88418b7 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:35.840962 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba899bc-35a6-445c-85d7-8ebfb88418b7 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:35.842317 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 561/1131] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:04:35.847781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79535de3-f9ff-4b35-9d29-05d8ef366a54 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:35.848431 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79535de3-f9ff-4b35-9d29-05d8ef366a54 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:35.848431 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79535de3-f9ff-4b35-9d29-05d8ef366a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:35.867187 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-79535de3-f9ff-4b35-9d29-05d8ef366a54 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:04:35.868478 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-79535de3-f9ff-4b35-9d29-05d8ef366a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:04:35.919115 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:35.935104 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 571/1132] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:04:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:04:36.205000 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba899bc-35a6-445c-85d7-8ebfb88418b7 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:36.292598 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:36.305584 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba899bc-35a6-445c-85d7-8ebfb88418b7 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:36.338863 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75555c07-411d-400e-b646-b905564bb25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:36.339593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75555c07-411d-400e-b646-b905564bb25a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:36.339787 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75555c07-411d-400e-b646-b905564bb25a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:36.340013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75555c07-411d-400e-b646-b905564bb25a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:36.341225 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75555c07-411d-400e-b646-b905564bb25a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:36.342815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75555c07-411d-400e-b646-b905564bb25a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:36.344561 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 562/1133] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:04:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:04:36.350608 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79535de3-f9ff-4b35-9d29-05d8ef366a54 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:36.449093 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79535de3-f9ff-4b35-9d29-05d8ef366a54 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:36.482376 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a91e04-336a-4192-8007-beb281e6d5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:36.482913 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a91e04-336a-4192-8007-beb281e6d5cf None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:36.483194 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a91e04-336a-4192-8007-beb281e6d5cf None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:36.483494 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a91e04-336a-4192-8007-beb281e6d5cf None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:36.484162 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a91e04-336a-4192-8007-beb281e6d5cf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:36.485601 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a91e04-336a-4192-8007-beb281e6d5cf None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:36.608048 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 572/1134] 10.222.0.81 () {60 vars in 1141 bytes} [Tue Sep 6 21:04:36 2022] POST /identity/v3/projects => generated 311 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:04:38.771351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e9194-3fdd-4630-aa8d-c2d58436dd6e None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:38.771917 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e9194-3fdd-4630-aa8d-c2d58436dd6e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:38.771917 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e9194-3fdd-4630-aa8d-c2d58436dd6e None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:38.773245 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 563/1135] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:04:38.778448 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12ea8f-18f7-4acf-a5f0-98dfafcb9766 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:38.778820 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12ea8f-18f7-4acf-a5f0-98dfafcb9766 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:38.779009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12ea8f-18f7-4acf-a5f0-98dfafcb9766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:38.798395 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-6b12ea8f-18f7-4acf-a5f0-98dfafcb9766 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:04:38.799592 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6b12ea8f-18f7-4acf-a5f0-98dfafcb9766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:04:38.829091 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:38.868172 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 573/1136] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:04:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:04:39.137134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e9194-3fdd-4630-aa8d-c2d58436dd6e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:39.240840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e9194-3fdd-4630-aa8d-c2d58436dd6e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:39.274190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0621e-2d17-4520-913e-25be4833a753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:39.274816 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0621e-2d17-4520-913e-25be4833a753 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:39.275093 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0621e-2d17-4520-913e-25be4833a753 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:39.275451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0621e-2d17-4520-913e-25be4833a753 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:39.276614 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0621e-2d17-4520-913e-25be4833a753 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:39.278023 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0621e-2d17-4520-913e-25be4833a753 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:39.279559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 564/1137] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:04:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:39.285269 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12ea8f-18f7-4acf-a5f0-98dfafcb9766 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:39.381596 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12ea8f-18f7-4acf-a5f0-98dfafcb9766 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:39.414952 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0207876-558c-4f35-93b4-11172710758b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:39.415479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0207876-558c-4f35-93b4-11172710758b None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:39.415755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0207876-558c-4f35-93b4-11172710758b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:39.416025 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0207876-558c-4f35-93b4-11172710758b None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:39.416686 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0207876-558c-4f35-93b4-11172710758b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:39.418103 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0207876-558c-4f35-93b4-11172710758b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:39.517357 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 574/1138] 10.222.0.81 () {60 vars in 1132 bytes} [Tue Sep 6 21:04:39 2022] POST /identity/v3/users => generated 286 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:04:41.724036 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c713b1-2f4f-4acf-a0a0-2bdd654cb715 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:41.724626 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c713b1-2f4f-4acf-a0a0-2bdd654cb715 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:41.724719 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c713b1-2f4f-4acf-a0a0-2bdd654cb715 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:41.726021 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 565/1139] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:04:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:04:41.731173 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7cefb-6331-4786-8b14-be283872a5cd None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:41.731596 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7cefb-6331-4786-8b14-be283872a5cd None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:41.731713 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7cefb-6331-4786-8b14-be283872a5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:41.749602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-85b7cefb-6331-4786-8b14-be283872a5cd None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:04:41.750773 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-85b7cefb-6331-4786-8b14-be283872a5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:04:41.768086 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:41.816188 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 575/1140] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:04:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:04:42.086257 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c713b1-2f4f-4acf-a0a0-2bdd654cb715 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:42.110828 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:42.186473 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c713b1-2f4f-4acf-a0a0-2bdd654cb715 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:42.218833 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934f509-d73e-454e-9ad2-fb87fff3c635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:42.219443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934f509-d73e-454e-9ad2-fb87fff3c635 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:42.219730 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934f509-d73e-454e-9ad2-fb87fff3c635 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:42.220012 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934f509-d73e-454e-9ad2-fb87fff3c635 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:42.229705 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934f509-d73e-454e-9ad2-fb87fff3c635 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:04:42.234409 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-d934f509-d73e-454e-9ad2-fb87fff3c635 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:04:42.234409 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:42.234409 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:04:42.234409 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:04:42.234409 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:04:42.234409 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:04:42.234409 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:04:42.234409 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:04:42.234409 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:04:42.234409 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:04:42.234409 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:04:42.234409 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:04:42.234409 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:04:42.234409 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:04:42.234409 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:04:42.234409 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:04:42.235497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:04:42.235497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:04:42.235497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:04:42.235497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:04:42.235497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:04:42.235497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:04:42.235497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:04:42.235497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:04:42.235497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:04:42.235497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:04:42.235497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:04:42.235497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:04:42.235497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:04:42.235497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:04:42.235497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:04:42.235497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:04:42.236400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:04:42.236400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:04:42.236400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:04:42.236400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:04:42.236400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:04:42.236400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:04:42.236400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:04:42.236400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:04:42.236400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:04:42.236400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:04:42.236400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:04:42.236400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:04:42.236400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 566/1141] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:04:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:04:42.242131 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7cefb-6331-4786-8b14-be283872a5cd None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:42.342458 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7cefb-6331-4786-8b14-be283872a5cd None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:42.376196 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94920054-7296-4050-a5ce-a4eb12de3746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:42.376805 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94920054-7296-4050-a5ce-a4eb12de3746 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:42.377104 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94920054-7296-4050-a5ce-a4eb12de3746 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:42.377360 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94920054-7296-4050-a5ce-a4eb12de3746 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:42.378015 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94920054-7296-4050-a5ce-a4eb12de3746 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:42.378318 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94920054-7296-4050-a5ce-a4eb12de3746 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:42.380323 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94920054-7296-4050-a5ce-a4eb12de3746 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:42.388127 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 576/1142] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:04:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:42.394233 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934f509-d73e-454e-9ad2-fb87fff3c635 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:42.477652 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:42.494116 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934f509-d73e-454e-9ad2-fb87fff3c635 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:42.527956 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ea54e-1b80-4cbc-9165-592598fd615b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:42.528614 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ea54e-1b80-4cbc-9165-592598fd615b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:42.528896 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ea54e-1b80-4cbc-9165-592598fd615b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:42.529179 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743ea54e-1b80-4cbc-9165-592598fd615b None admin] PATH_INFO: `/v3/users/5c5539d2c41541c5aae118a1e5f2c9ec` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:42.542407 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ea54e-1b80-4cbc-9165-592598fd615b None admin] RBAC: Authorizing `identity:get_user(user_id=5c5539d2c41541c5aae118a1e5f2c9ec)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:42.543832 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743ea54e-1b80-4cbc-9165-592598fd615b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:42.545441 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 567/1143] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:04:42 2022] GET /identity/v3/users/5c5539d2c41541c5aae118a1e5f2c9ec => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:42.551245 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94920054-7296-4050-a5ce-a4eb12de3746 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:42.570155 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:42.650888 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94920054-7296-4050-a5ce-a4eb12de3746 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:42.684493 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957da6f-015c-46d7-a10b-cef649213c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:42.685087 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957da6f-015c-46d7-a10b-cef649213c57 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:42.685368 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957da6f-015c-46d7-a10b-cef649213c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:42.685635 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957da6f-015c-46d7-a10b-cef649213c57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:42.750198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957da6f-015c-46d7-a10b-cef649213c57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:42.751644 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957da6f-015c-46d7-a10b-cef649213c57 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:42.768604 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:42.851176 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 577/1144] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:04:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 21:04:42.857175 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ea54e-1b80-4cbc-9165-592598fd615b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:42.953383 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743ea54e-1b80-4cbc-9165-592598fd615b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:42.985713 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e0506-b64f-46d7-9c30-e26d4a8ab043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:42.986330 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e0506-b64f-46d7-9c30-e26d4a8ab043 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:42.986604 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e0506-b64f-46d7-9c30-e26d4a8ab043 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:42.986874 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e0506-b64f-46d7-9c30-e26d4a8ab043 None admin] PATH_INFO: `/v3/projects/bee7f0156a214f7aaf9e3b633ad215ab` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:42.988256 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e0506-b64f-46d7-9c30-e26d4a8ab043 None admin] RBAC: Authorizing `identity:get_project(project_id=bee7f0156a214f7aaf9e3b633ad215ab)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:42.989741 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e0506-b64f-46d7-9c30-e26d4a8ab043 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:42.991333 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 568/1145] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:04:42 2022] GET /identity/v3/projects/bee7f0156a214f7aaf9e3b633ad215ab => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:42.997853 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957da6f-015c-46d7-a10b-cef649213c57 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:43.094415 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957da6f-015c-46d7-a10b-cef649213c57 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:43.111324 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:43.128469 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b4aaa7-1630-401f-ab5e-eae640ca336b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:43.129064 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4aaa7-1630-401f-ab5e-eae640ca336b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:43.129339 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4aaa7-1630-401f-ab5e-eae640ca336b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:43.129633 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b4aaa7-1630-401f-ab5e-eae640ca336b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:43.130387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4aaa7-1630-401f-ab5e-eae640ca336b None admin] RBAC: Adding query filter params (role.id=fe9661f095094dd0931e0b96a1d6ef74, scope.project.id=bee7f0156a214f7aaf9e3b633ad215ab, user.id=5c5539d2c41541c5aae118a1e5f2c9ec) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:43.130690 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4aaa7-1630-401f-ab5e-eae640ca336b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:43.132181 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b4aaa7-1630-401f-ab5e-eae640ca336b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:43.137392 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 578/1146] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:04:42 2022] GET /identity/v3/role_assignments?user.id=5c5539d2c41541c5aae118a1e5f2c9ec&scope.project.id=bee7f0156a214f7aaf9e3b633ad215ab&role.id=fe9661f095094dd0931e0b96a1d6ef74 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:45.270610 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66fa81-bc7b-42a2-9083-8bdf648363d8 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:45.271045 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66fa81-bc7b-42a2-9083-8bdf648363d8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:45.271220 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e66fa81-bc7b-42a2-9083-8bdf648363d8 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:45.272644 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 569/1147] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:04:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:04:45.277785 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f7abe-e493-41ec-939a-41b3b6ed7dd8 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:45.278173 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f7abe-e493-41ec-939a-41b3b6ed7dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:45.278327 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f7abe-e493-41ec-939a-41b3b6ed7dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:45.297353 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-1d0f7abe-e493-41ec-939a-41b3b6ed7dd8 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:04:45.298520 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1d0f7abe-e493-41ec-939a-41b3b6ed7dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:04:45.363323 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 579/1148] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:04:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:04:45.639706 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66fa81-bc7b-42a2-9083-8bdf648363d8 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:45.654175 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:45.740465 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e66fa81-bc7b-42a2-9083-8bdf648363d8 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:45.773378 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff2165-1efe-4897-8bcd-1c2b79e3e9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:45.773994 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff2165-1efe-4897-8bcd-1c2b79e3e9ed None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:45.774270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff2165-1efe-4897-8bcd-1c2b79e3e9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:45.774544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff2165-1efe-4897-8bcd-1c2b79e3e9ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:45.784118 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ff2165-1efe-4897-8bcd-1c2b79e3e9ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:04:45.789130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-a3ff2165-1efe-4897-8bcd-1c2b79e3e9ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:04:45.789130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:45.789130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:04:45.789130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:04:45.789130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:04:45.789130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:04:45.789130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:04:45.789130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:04:45.789130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:04:45.789130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:04:45.789130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:04:45.789130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:04:45.789130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:04:45.789130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:04:45.789130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:04:45.789130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:04:45.790209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:04:45.790209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:04:45.790209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:04:45.790209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:04:45.790209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:04:45.790209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:04:45.790209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:04:45.790209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:04:45.790209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:04:45.790209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:04:45.790209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:04:45.790209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:04:45.790209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:04:45.790209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:04:45.790209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:04:45.790209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:04:45.791094 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:04:45.791094 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:04:45.791094 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:04:45.791094 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:04:45.791094 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:04:45.791094 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:04:45.791094 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:04:45.791094 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:04:45.791094 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:04:45.791094 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:04:45.791094 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:04:45.791094 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:04:45.791094 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 570/1149] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:04:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:04:45.796561 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f7abe-e493-41ec-939a-41b3b6ed7dd8 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:45.895377 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f7abe-e493-41ec-939a-41b3b6ed7dd8 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:45.905680 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:45.928980 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8bbeb-85e9-45b4-bdca-a7b684de3d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:45.929580 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8bbeb-85e9-45b4-bdca-a7b684de3d4b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:45.929857 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8bbeb-85e9-45b4-bdca-a7b684de3d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:45.930127 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8bbeb-85e9-45b4-bdca-a7b684de3d4b None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:45.930788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8bbeb-85e9-45b4-bdca-a7b684de3d4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:45.931076 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8bbeb-85e9-45b4-bdca-a7b684de3d4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:45.932581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8bbeb-85e9-45b4-bdca-a7b684de3d4b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:45.941149 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 580/1150] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:04:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:45.947942 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff2165-1efe-4897-8bcd-1c2b79e3e9ed None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:46.017828 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:46.048005 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ff2165-1efe-4897-8bcd-1c2b79e3e9ed None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:46.084035 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18ec52-d282-4f09-9531-ad349e0363d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:46.084718 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18ec52-d282-4f09-9531-ad349e0363d1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:46.085022 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18ec52-d282-4f09-9531-ad349e0363d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:46.085299 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18ec52-d282-4f09-9531-ad349e0363d1 None admin] PATH_INFO: `/v3/users/5c5539d2c41541c5aae118a1e5f2c9ec` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:46.086420 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18ec52-d282-4f09-9531-ad349e0363d1 None admin] RBAC: Authorizing `identity:get_user(user_id=5c5539d2c41541c5aae118a1e5f2c9ec)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:46.087846 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18ec52-d282-4f09-9531-ad349e0363d1 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:46.089479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 571/1151] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:04:45 2022] GET /identity/v3/users/5c5539d2c41541c5aae118a1e5f2c9ec => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:46.095356 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8bbeb-85e9-45b4-bdca-a7b684de3d4b None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:46.195944 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8bbeb-85e9-45b4-bdca-a7b684de3d4b None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:46.229835 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b81c45-aee6-497d-be07-5e3f68e4a2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:46.230462 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b81c45-aee6-497d-be07-5e3f68e4a2e1 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:46.230743 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b81c45-aee6-497d-be07-5e3f68e4a2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:46.231016 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b81c45-aee6-497d-be07-5e3f68e4a2e1 None admin] PATH_INFO: `/v3/projects/bee7f0156a214f7aaf9e3b633ad215ab` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:46.232136 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b81c45-aee6-497d-be07-5e3f68e4a2e1 None admin] RBAC: Authorizing `identity:get_project(project_id=bee7f0156a214f7aaf9e3b633ad215ab)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:46.233566 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b81c45-aee6-497d-be07-5e3f68e4a2e1 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:46.235178 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 581/1152] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:04:46 2022] GET /identity/v3/projects/bee7f0156a214f7aaf9e3b633ad215ab => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:46.241856 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18ec52-d282-4f09-9531-ad349e0363d1 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:46.342592 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18ec52-d282-4f09-9531-ad349e0363d1 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:46.375951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250897a6-e84d-4e88-9164-fe5bc8b4861e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:46.376632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250897a6-e84d-4e88-9164-fe5bc8b4861e None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:46.376913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250897a6-e84d-4e88-9164-fe5bc8b4861e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:46.377185 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250897a6-e84d-4e88-9164-fe5bc8b4861e None admin] PATH_INFO: `/v3/projects/bee7f0156a214f7aaf9e3b633ad215ab/users/5c5539d2c41541c5aae118a1e5f2c9ec/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:46.379086 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250897a6-e84d-4e88-9164-fe5bc8b4861e None admin] RBAC: Authorizing `identity:create_grant(project_id=bee7f0156a214f7aaf9e3b633ad215ab, user_id=5c5539d2c41541c5aae118a1e5f2c9ec, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:46.380600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250897a6-e84d-4e88-9164-fe5bc8b4861e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:46.483074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:46.488564 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 572/1153] 10.222.0.81 () {58 vars in 1439 bytes} [Tue Sep 6 21:04:46 2022] PUT /identity/v3/projects/bee7f0156a214f7aaf9e3b633ad215ab/users/5c5539d2c41541c5aae118a1e5f2c9ec/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:04:48.626173 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd617f-47c9-4baa-a077-3b5282cbddcf None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:48.626743 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd617f-47c9-4baa-a077-3b5282cbddcf None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:48.626743 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd617f-47c9-4baa-a077-3b5282cbddcf None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:48.628279 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 582/1154] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:04:48.634063 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb504a20-9c9a-4c9f-a921-a657fd6406b7 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:48.634529 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb504a20-9c9a-4c9f-a921-a657fd6406b7 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:48.634632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb504a20-9c9a-4c9f-a921-a657fd6406b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:48.653719 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-eb504a20-9c9a-4c9f-a921-a657fd6406b7 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:04:48.654919 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-eb504a20-9c9a-4c9f-a921-a657fd6406b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:04:48.740564 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 573/1155] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:04:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:04:49.011369 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd617f-47c9-4baa-a077-3b5282cbddcf None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:49.053738 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:49.109614 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd617f-47c9-4baa-a077-3b5282cbddcf None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:49.142482 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e766133-2bbc-4163-8ad1-709c1e4fae9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:49.143098 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e766133-2bbc-4163-8ad1-709c1e4fae9d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:49.143375 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e766133-2bbc-4163-8ad1-709c1e4fae9d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:49.143648 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e766133-2bbc-4163-8ad1-709c1e4fae9d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:49.154608 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e766133-2bbc-4163-8ad1-709c1e4fae9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:04:49.159320 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-6e766133-2bbc-4163-8ad1-709c1e4fae9d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:04:49.159320 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:49.159320 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:04:49.159320 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:04:49.159320 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:04:49.159320 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:04:49.159320 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:04:49.159320 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:04:49.159320 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:04:49.159320 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:04:49.159320 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:04:49.159320 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:04:49.159320 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:04:49.159320 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:04:49.159320 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:04:49.159320 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:04:49.160560 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:04:49.160560 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:04:49.160560 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:04:49.160560 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:04:49.160560 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:04:49.160560 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:04:49.160560 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:04:49.160560 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:04:49.160560 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:04:49.160560 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:04:49.160560 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:04:49.160560 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:04:49.160560 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:04:49.160560 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:04:49.160560 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:04:49.160560 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:04:49.162166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:04:49.162166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:04:49.162166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:04:49.162166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:04:49.162166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:04:49.162166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:04:49.162166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:04:49.162166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:04:49.162166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:04:49.162166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:04:49.162166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:04:49.162166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:04:49.162166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 583/1156] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:04:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:04:49.167327 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb504a20-9c9a-4c9f-a921-a657fd6406b7 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:49.263784 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb504a20-9c9a-4c9f-a921-a657fd6406b7 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:49.290537 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:49.297789 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e230cc-b58c-4b40-90db-b86558a0c732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:49.298391 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e230cc-b58c-4b40-90db-b86558a0c732 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:49.298668 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e230cc-b58c-4b40-90db-b86558a0c732 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:49.298938 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e230cc-b58c-4b40-90db-b86558a0c732 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:49.299584 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e230cc-b58c-4b40-90db-b86558a0c732 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:49.299883 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e230cc-b58c-4b40-90db-b86558a0c732 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:49.301505 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e230cc-b58c-4b40-90db-b86558a0c732 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:49.309850 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 574/1157] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:04:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:49.315800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e766133-2bbc-4163-8ad1-709c1e4fae9d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:49.408631 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:49.411887 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e766133-2bbc-4163-8ad1-709c1e4fae9d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:49.445255 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccc118-a973-4de1-88ad-81b51ac07e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:49.445867 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccc118-a973-4de1-88ad-81b51ac07e5a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:49.446145 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccc118-a973-4de1-88ad-81b51ac07e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:49.446414 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cccc118-a973-4de1-88ad-81b51ac07e5a None admin] PATH_INFO: `/v3/users/5c5539d2c41541c5aae118a1e5f2c9ec` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:49.447507 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccc118-a973-4de1-88ad-81b51ac07e5a None admin] RBAC: Authorizing `identity:get_user(user_id=5c5539d2c41541c5aae118a1e5f2c9ec)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:49.448961 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cccc118-a973-4de1-88ad-81b51ac07e5a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:49.450500 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 584/1158] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:04:49 2022] GET /identity/v3/users/5c5539d2c41541c5aae118a1e5f2c9ec => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:49.456315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e230cc-b58c-4b40-90db-b86558a0c732 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:49.553178 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e230cc-b58c-4b40-90db-b86558a0c732 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:49.585711 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dede9e-98a4-4fe8-bec7-756adc0066fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:49.586312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dede9e-98a4-4fe8-bec7-756adc0066fe None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:49.586595 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dede9e-98a4-4fe8-bec7-756adc0066fe None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:49.586871 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dede9e-98a4-4fe8-bec7-756adc0066fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:49.641317 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:49.651768 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dede9e-98a4-4fe8-bec7-756adc0066fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:49.655507 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dede9e-98a4-4fe8-bec7-756adc0066fe None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:49.747939 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 575/1159] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:04:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 21:04:49.753965 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccc118-a973-4de1-88ad-81b51ac07e5a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:49.851531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cccc118-a973-4de1-88ad-81b51ac07e5a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:49.886854 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3442f9-9842-4f05-9990-127fe2f78f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:49.887491 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3442f9-9842-4f05-9990-127fe2f78f02 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:49.887778 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3442f9-9842-4f05-9990-127fe2f78f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:49.888051 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3442f9-9842-4f05-9990-127fe2f78f02 None admin] PATH_INFO: `/v3/projects/bee7f0156a214f7aaf9e3b633ad215ab` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:49.889196 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3442f9-9842-4f05-9990-127fe2f78f02 None admin] RBAC: Authorizing `identity:get_project(project_id=bee7f0156a214f7aaf9e3b633ad215ab)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:49.890632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3442f9-9842-4f05-9990-127fe2f78f02 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:49.892359 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 585/1160] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:04:49 2022] GET /identity/v3/projects/bee7f0156a214f7aaf9e3b633ad215ab => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:49.899202 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dede9e-98a4-4fe8-bec7-756adc0066fe None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:49.987173 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:49.996068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dede9e-98a4-4fe8-bec7-756adc0066fe None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:50.029074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59faff-4fe4-4ed1-bd44-de8120034cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:50.029666 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59faff-4fe4-4ed1-bd44-de8120034cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:50.029946 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59faff-4fe4-4ed1-bd44-de8120034cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:50.030217 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59faff-4fe4-4ed1-bd44-de8120034cf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:50.030931 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59faff-4fe4-4ed1-bd44-de8120034cf4 None admin] RBAC: Adding query filter params (role.id=fe9661f095094dd0931e0b96a1d6ef74, scope.project.id=bee7f0156a214f7aaf9e3b633ad215ab, user.id=5c5539d2c41541c5aae118a1e5f2c9ec) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:50.031238 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59faff-4fe4-4ed1-bd44-de8120034cf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:50.032681 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59faff-4fe4-4ed1-bd44-de8120034cf4 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:50.038321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 576/1161] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:04:49 2022] GET /identity/v3/role_assignments?user.id=5c5539d2c41541c5aae118a1e5f2c9ec&scope.project.id=bee7f0156a214f7aaf9e3b633ad215ab&role.id=fe9661f095094dd0931e0b96a1d6ef74 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:52.196165 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48693c26-d7d1-4eed-a0c5-54cd8f37a227 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:52.196704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48693c26-d7d1-4eed-a0c5-54cd8f37a227 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:52.196704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48693c26-d7d1-4eed-a0c5-54cd8f37a227 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:52.198024 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 586/1162] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:04:52.203510 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d3268-3eb2-4d0b-b077-275006f79d19 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:52.203906 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d3268-3eb2-4d0b-b077-275006f79d19 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:52.204065 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d3268-3eb2-4d0b-b077-275006f79d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:52.222350 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-9e8d3268-3eb2-4d0b-b077-275006f79d19 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:04:52.223580 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9e8d3268-3eb2-4d0b-b077-275006f79d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:04:52.290027 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 577/1163] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:04:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:04:52.557143 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48693c26-d7d1-4eed-a0c5-54cd8f37a227 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:52.592977 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:52.659296 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48693c26-d7d1-4eed-a0c5-54cd8f37a227 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:52.693525 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c5a8e-b281-4f35-9f73-5de7627be9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:52.694131 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c5a8e-b281-4f35-9f73-5de7627be9be None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:52.694415 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c5a8e-b281-4f35-9f73-5de7627be9be None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:52.694693 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30c5a8e-b281-4f35-9f73-5de7627be9be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:52.762134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c5a8e-b281-4f35-9f73-5de7627be9be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:52.763578 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30c5a8e-b281-4f35-9f73-5de7627be9be None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:52.797157 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:52.860196 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 587/1164] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:04:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 21:04:52.865943 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d3268-3eb2-4d0b-b077-275006f79d19 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:52.948075 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:52.963869 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d3268-3eb2-4d0b-b077-275006f79d19 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:52.998989 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8639ba5-551f-4d58-93ce-e70b9d72347d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:52.999618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8639ba5-551f-4d58-93ce-e70b9d72347d None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:52.999979 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8639ba5-551f-4d58-93ce-e70b9d72347d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:53.000514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8639ba5-551f-4d58-93ce-e70b9d72347d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:53.009898 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8639ba5-551f-4d58-93ce-e70b9d72347d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:53.011452 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8639ba5-551f-4d58-93ce-e70b9d72347d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:53.028270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-b8639ba5-551f-4d58-93ce-e70b9d72347d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 06 21:04:53.028270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:53.028270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 06 21:04:53.028270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 06 21:04:53.028270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:04:53.028270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:04:53.028270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:04:53.028270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:04:53.028270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 06 21:04:53.028270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:04:53.028270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 21:04:53.028270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:04:53.028270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:04:53.028270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:04:53.028270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:04:53.028270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:04:53.028270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:04:53.029600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:04:53.029600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:04:53.029600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:04:53.029600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:04:53.029600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:04:53.029600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:04:53.029600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:04:53.029600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:04:53.029600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:04:53.029600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:04:53.029600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:04:53.029600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:04:53.029600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:04:53.029600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:04:53.029600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:04:53.029600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:04:53.030727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:04:53.030727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:04:53.030727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:04:53.030727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:04:53.030727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:04:53.030727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:04:53.030727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:04:53.030727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:04:53.030727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:04:53.030727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:04:53.030727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 06 21:04:53.030727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:04:53.030727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 06 21:04:53.030727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:04:53.030727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 578/1165] 10.222.0.81 () {56 vars in 1117 bytes} [Tue Sep 6 21:04:52 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:04:53.035378 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c5a8e-b281-4f35-9f73-5de7627be9be None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:53.134069 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30c5a8e-b281-4f35-9f73-5de7627be9be None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:53.166935 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9ac29-e715-4249-88d9-7b7c15187ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:53.167540 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9ac29-e715-4249-88d9-7b7c15187ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:53.167819 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9ac29-e715-4249-88d9-7b7c15187ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:53.168091 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9ac29-e715-4249-88d9-7b7c15187ce5 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:53.168798 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9ac29-e715-4249-88d9-7b7c15187ce5 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:04:53.169063 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9ac29-e715-4249-88d9-7b7c15187ce5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:53.170419 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9ac29-e715-4249-88d9-7b7c15187ce5 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:53.172783 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:53.177737 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 588/1166] 10.222.0.81 () {56 vars in 1115 bytes} [Tue Sep 6 21:04:53 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:55.302085 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed7812-46ce-4abe-9612-26b4d5e0020e None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:55.302576 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed7812-46ce-4abe-9612-26b4d5e0020e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:55.302669 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed7812-46ce-4abe-9612-26b4d5e0020e None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:55.303953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 579/1167] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:04:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:04:55.309073 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50288b3-1f85-435e-81b9-6944da4330a0 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:55.309550 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50288b3-1f85-435e-81b9-6944da4330a0 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:55.309678 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50288b3-1f85-435e-81b9-6944da4330a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:55.329391 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c50288b3-1f85-435e-81b9-6944da4330a0 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:04:55.330578 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c50288b3-1f85-435e-81b9-6944da4330a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:04:55.396037 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 589/1168] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:04:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:04:55.664553 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed7812-46ce-4abe-9612-26b4d5e0020e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:55.767117 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed7812-46ce-4abe-9612-26b4d5e0020e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:55.800910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472677d5-c3db-47f4-9696-de5ceccfbc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:55.802027 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472677d5-c3db-47f4-9696-de5ceccfbc7b None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:55.802406 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472677d5-c3db-47f4-9696-de5ceccfbc7b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:55.802634 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472677d5-c3db-47f4-9696-de5ceccfbc7b None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:55.803251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472677d5-c3db-47f4-9696-de5ceccfbc7b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:55.804639 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472677d5-c3db-47f4-9696-de5ceccfbc7b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:55.917536 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 580/1169] 10.222.0.81 () {60 vars in 1138 bytes} [Tue Sep 6 21:04:55 2022] POST /identity/v3/domains => generated 267 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:04:58.091987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12950032-947f-4272-90d2-749739d05899 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:58.092554 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12950032-947f-4272-90d2-749739d05899 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:58.092554 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12950032-947f-4272-90d2-749739d05899 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:58.093910 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 590/1170] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:04:58.099256 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179b332-3403-46c2-9eab-d95abdbadb97 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:58.099695 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179b332-3403-46c2-9eab-d95abdbadb97 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:58.099797 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179b332-3403-46c2-9eab-d95abdbadb97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:58.106921 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:58.118331 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8179b332-3403-46c2-9eab-d95abdbadb97 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:04:58.119543 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8179b332-3403-46c2-9eab-d95abdbadb97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:04:58.185487 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 581/1171] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:04:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:04:58.453660 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12950032-947f-4272-90d2-749739d05899 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:58.551927 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12950032-947f-4272-90d2-749739d05899 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:58.579067 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:58.585015 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52d88d-66b3-4215-ade4-c0b5d09c10c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:58.589512 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52d88d-66b3-4215-ade4-c0b5d09c10c6 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:58.589512 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52d88d-66b3-4215-ade4-c0b5d09c10c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:58.589512 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52d88d-66b3-4215-ade4-c0b5d09c10c6 None admin] PATH_INFO: `/v3/domains/f75d18c0b6eb42bf8dd42f60754a6ff1` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:58.596527 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52d88d-66b3-4215-ade4-c0b5d09c10c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f75d18c0b6eb42bf8dd42f60754a6ff1)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:58.598563 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d52d88d-66b3-4215-ade4-c0b5d09c10c6 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:58.600150 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 591/1172] 10.222.0.81 () {56 vars in 1183 bytes} [Tue Sep 6 21:04:58 2022] GET /identity/v3/domains/f75d18c0b6eb42bf8dd42f60754a6ff1 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:04:58.606132 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179b332-3403-46c2-9eab-d95abdbadb97 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:04:58.702229 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179b332-3403-46c2-9eab-d95abdbadb97 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:04:58.735425 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6b5637-fa6f-429c-b29f-7b7ab852650c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:04:58.735964 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b5637-fa6f-429c-b29f-7b7ab852650c None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:04:58.736274 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b5637-fa6f-429c-b29f-7b7ab852650c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:04:58.736551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6b5637-fa6f-429c-b29f-7b7ab852650c None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:04:58.737193 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b5637-fa6f-429c-b29f-7b7ab852650c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:04:58.738701 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6b5637-fa6f-429c-b29f-7b7ab852650c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:04:58.743157 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:04:58.837796 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 582/1173] 10.222.0.81 () {60 vars in 1141 bytes} [Tue Sep 6 21:04:58 2022] POST /identity/v3/projects => generated 361 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:05:01.036371 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d84b7-0a0e-437f-914d-008cd2e9082c None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:05:01.036910 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d84b7-0a0e-437f-914d-008cd2e9082c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:05:01.036910 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d84b7-0a0e-437f-914d-008cd2e9082c None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:05:01.038243 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 592/1174] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:05:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:05:01.043729 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b79ea-3747-4e04-ab02-3e67f726cd75 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:05:01.044157 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b79ea-3747-4e04-ab02-3e67f726cd75 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:05:01.044306 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b79ea-3747-4e04-ab02-3e67f726cd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:05:01.062335 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-b54b79ea-3747-4e04-ab02-3e67f726cd75 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:05:01.063543 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b54b79ea-3747-4e04-ab02-3e67f726cd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:05:01.130961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 583/1175] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:05:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 21:05:01.401582 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d84b7-0a0e-437f-914d-008cd2e9082c None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:05:01.506856 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d84b7-0a0e-437f-914d-008cd2e9082c None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:05:01.540076 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47876e-c144-44ea-86a5-4ca271e93cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:05:01.540721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47876e-c144-44ea-86a5-4ca271e93cec None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:05:01.540999 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47876e-c144-44ea-86a5-4ca271e93cec None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:05:01.541268 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47876e-c144-44ea-86a5-4ca271e93cec None admin] PATH_INFO: `/v3/domains/f75d18c0b6eb42bf8dd42f60754a6ff1` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:05:01.542369 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d47876e-c144-44ea-86a5-4ca271e93cec None admin] RBAC: Authorizing `identity:get_domain(domain_id=f75d18c0b6eb42bf8dd42f60754a6ff1)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:05:01.543795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d47876e-c144-44ea-86a5-4ca271e93cec None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:05:01.545377 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 593/1176] 10.222.0.81 () {56 vars in 1183 bytes} [Tue Sep 6 21:05:01 2022] GET /identity/v3/domains/f75d18c0b6eb42bf8dd42f60754a6ff1 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:05:01.551736 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b79ea-3747-4e04-ab02-3e67f726cd75 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:05:01.648080 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b79ea-3747-4e04-ab02-3e67f726cd75 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:05:01.664259 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:05:01.681602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b300d4-d071-41e4-afeb-7fa2da381363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:05:01.687074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b300d4-d071-41e4-afeb-7fa2da381363 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:05:01.687074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b300d4-d071-41e4-afeb-7fa2da381363 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:05:01.687074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b300d4-d071-41e4-afeb-7fa2da381363 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:05:01.687074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b300d4-d071-41e4-afeb-7fa2da381363 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:05:01.687074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b300d4-d071-41e4-afeb-7fa2da381363 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:05:01.802395 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 584/1177] 10.222.0.81 () {60 vars in 1132 bytes} [Tue Sep 6 21:05:01 2022] POST /identity/v3/users => generated 311 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:05:04.029424 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca8e8c-deb5-4351-aa47-06ce9994bb87 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:05:04.029968 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca8e8c-deb5-4351-aa47-06ce9994bb87 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:05:04.029968 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca8e8c-deb5-4351-aa47-06ce9994bb87 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:05:04.031370 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 594/1178] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:05:04.037477 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58331cbb-d25b-4d47-9f08-58210dc6c28c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:05:04.037954 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58331cbb-d25b-4d47-9f08-58210dc6c28c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:05:04.038093 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58331cbb-d25b-4d47-9f08-58210dc6c28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:05:04.056119 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-58331cbb-d25b-4d47-9f08-58210dc6c28c None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:05:04.061815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-58331cbb-d25b-4d47-9f08-58210dc6c28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:05:04.129806 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 585/1179] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:05:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:05:04.406456 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca8e8c-deb5-4351-aa47-06ce9994bb87 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:05:04.467689 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:05:04.516008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ca8e8c-deb5-4351-aa47-06ce9994bb87 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:05:04.552999 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa959f62-e500-4627-97a1-cd63bda1c502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:05:04.553621 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa959f62-e500-4627-97a1-cd63bda1c502 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:05:04.553899 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa959f62-e500-4627-97a1-cd63bda1c502 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:05:04.554170 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa959f62-e500-4627-97a1-cd63bda1c502 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:05:04.563890 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa959f62-e500-4627-97a1-cd63bda1c502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:05:04.569239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-fa959f62-e500-4627-97a1-cd63bda1c502 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:05:04.569239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:05:04.569239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:05:04.569239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:05:04.569239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:05:04.569239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:05:04.569239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:05:04.569239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:05:04.569239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:05:04.569239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:05:04.569239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:05:04.569239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:05:04.569239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:05:04.569239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:05:04.569239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:05:04.569239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:05:04.570340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:05:04.570340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:05:04.570340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:05:04.570340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:05:04.570340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:05:04.570340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:05:04.570340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:05:04.570340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:05:04.570340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:05:04.570340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:05:04.570340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:05:04.570340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:05:04.570340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:05:04.570340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:05:04.570340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:05:04.570340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:05:04.571214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:05:04.571214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:05:04.571214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:05:04.571214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:05:04.571214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:05:04.571214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:05:04.571214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:05:04.571214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:05:04.571214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:05:04.571214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:05:04.571214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:05:04.571214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:05:04.571214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 595/1180] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:05:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:05:04.576447 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58331cbb-d25b-4d47-9f08-58210dc6c28c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:05:04.673013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58331cbb-d25b-4d47-9f08-58210dc6c28c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:05:04.674451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:05:04.709398 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865b4d9-8b00-4f8d-8889-31764b2f02c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:05:04.710345 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865b4d9-8b00-4f8d-8889-31764b2f02c0 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:05:04.710877 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865b4d9-8b00-4f8d-8889-31764b2f02c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:05:04.711399 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865b4d9-8b00-4f8d-8889-31764b2f02c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:05:04.712459 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865b4d9-8b00-4f8d-8889-31764b2f02c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:05:04.712837 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865b4d9-8b00-4f8d-8889-31764b2f02c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:05:04.714316 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865b4d9-8b00-4f8d-8889-31764b2f02c0 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:05:04.722820 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 586/1181] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:05:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:05:04.731482 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa959f62-e500-4627-97a1-cd63bda1c502 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:05:04.842157 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa959f62-e500-4627-97a1-cd63bda1c502 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:05:04.860356 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:05:04.876966 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b904d8-6205-4c4c-b10b-9dbb78746786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:05:04.877593 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b904d8-6205-4c4c-b10b-9dbb78746786 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:05:04.877874 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b904d8-6205-4c4c-b10b-9dbb78746786 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:05:04.878146 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b904d8-6205-4c4c-b10b-9dbb78746786 None admin] PATH_INFO: `/v3/users/7ebd8309c5964165aad5973ee1553021` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:05:04.891091 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b904d8-6205-4c4c-b10b-9dbb78746786 None admin] RBAC: Authorizing `identity:get_user(user_id=7ebd8309c5964165aad5973ee1553021)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:05:04.892670 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b904d8-6205-4c4c-b10b-9dbb78746786 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:05:04.895168 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 596/1182] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:05:04 2022] GET /identity/v3/users/7ebd8309c5964165aad5973ee1553021 => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:05:04.900969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865b4d9-8b00-4f8d-8889-31764b2f02c0 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:05:05.001742 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865b4d9-8b00-4f8d-8889-31764b2f02c0 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:05:05.034583 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fdbf5f-84ef-414d-8a7f-23c4d8475cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:05:05.035228 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdbf5f-84ef-414d-8a7f-23c4d8475cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:05:05.035509 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdbf5f-84ef-414d-8a7f-23c4d8475cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:05:05.035780 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fdbf5f-84ef-414d-8a7f-23c4d8475cd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:05:05.065402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:05:05.101761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fdbf5f-84ef-414d-8a7f-23c4d8475cd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:05:05.103200 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fdbf5f-84ef-414d-8a7f-23c4d8475cd1 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:05:05.197492 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 587/1183] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:05:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 21:05:05.205597 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b904d8-6205-4c4c-b10b-9dbb78746786 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:05:05.305249 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b904d8-6205-4c4c-b10b-9dbb78746786 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:05:05.338376 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d2a50-b0e0-487d-8147-88b67bf38bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:05:05.339000 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d2a50-b0e0-487d-8147-88b67bf38bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:05:05.339280 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d2a50-b0e0-487d-8147-88b67bf38bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:05:05.339555 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d2a50-b0e0-487d-8147-88b67bf38bf5 None admin] PATH_INFO: `/v3/projects/2e8f3b4d200a4e4da5dd675b0aef9c22` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:05:05.340671 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45d2a50-b0e0-487d-8147-88b67bf38bf5 None admin] RBAC: Authorizing `identity:get_project(project_id=2e8f3b4d200a4e4da5dd675b0aef9c22)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:05:05.342099 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45d2a50-b0e0-487d-8147-88b67bf38bf5 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:05:05.343709 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 597/1184] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:05:05 2022] GET /identity/v3/projects/2e8f3b4d200a4e4da5dd675b0aef9c22 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:05:05.349918 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fdbf5f-84ef-414d-8a7f-23c4d8475cd1 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:05:05.411374 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:05:05.450091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fdbf5f-84ef-414d-8a7f-23c4d8475cd1 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:05:05.482053 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462fbe1-6d71-42e5-ad29-66ebc6ce0295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:05:05.482647 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462fbe1-6d71-42e5-ad29-66ebc6ce0295 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:05:05.482927 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462fbe1-6d71-42e5-ad29-66ebc6ce0295 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:05:05.483198 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462fbe1-6d71-42e5-ad29-66ebc6ce0295 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:05:05.483915 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462fbe1-6d71-42e5-ad29-66ebc6ce0295 None admin] RBAC: Adding query filter params (role.id=fe9661f095094dd0931e0b96a1d6ef74, scope.project.id=2e8f3b4d200a4e4da5dd675b0aef9c22, user.id=7ebd8309c5964165aad5973ee1553021) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:05:05.484258 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462fbe1-6d71-42e5-ad29-66ebc6ce0295 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:05:05.485678 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462fbe1-6d71-42e5-ad29-66ebc6ce0295 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:05:05.491861 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 588/1185] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:05:05 2022] GET /identity/v3/role_assignments?user.id=7ebd8309c5964165aad5973ee1553021&scope.project.id=2e8f3b4d200a4e4da5dd675b0aef9c22&role.id=fe9661f095094dd0931e0b96a1d6ef74 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:05:07.622193 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1a4b0-eb2d-4cc7-92de-6217346fb38a None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:05:07.622757 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1a4b0-eb2d-4cc7-92de-6217346fb38a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:05:07.622757 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1a4b0-eb2d-4cc7-92de-6217346fb38a None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:05:07.624071 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 598/1186] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:05:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:05:07.629778 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21889611-c12b-4e98-8adc-c283d7a02211 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:05:07.630221 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21889611-c12b-4e98-8adc-c283d7a02211 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:05:07.630316 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21889611-c12b-4e98-8adc-c283d7a02211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:05:07.648087 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-21889611-c12b-4e98-8adc-c283d7a02211 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:05:07.649429 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-21889611-c12b-4e98-8adc-c283d7a02211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:05:07.713675 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 589/1187] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:05:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 21:05:07.985387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1a4b0-eb2d-4cc7-92de-6217346fb38a None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:05:08.031303 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:05:08.085581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1a4b0-eb2d-4cc7-92de-6217346fb38a None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:05:08.119287 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eea48d-9706-4171-bf5a-f29037ee70a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:05:08.119908 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eea48d-9706-4171-bf5a-f29037ee70a3 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:05:08.120265 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eea48d-9706-4171-bf5a-f29037ee70a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:05:08.120543 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eea48d-9706-4171-bf5a-f29037ee70a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:05:08.130447 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eea48d-9706-4171-bf5a-f29037ee70a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:05:08.135252 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-23eea48d-9706-4171-bf5a-f29037ee70a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:05:08.135252 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:05:08.135252 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:05:08.135252 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:05:08.135252 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:05:08.135252 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:05:08.135252 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:05:08.135252 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:05:08.135252 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:05:08.135252 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:05:08.135252 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:05:08.135252 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:05:08.135252 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:05:08.135252 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:05:08.135252 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:05:08.135252 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:05:08.136354 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:05:08.136354 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:05:08.136354 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:05:08.136354 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:05:08.136354 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:05:08.136354 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:05:08.136354 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:05:08.136354 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:05:08.136354 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:05:08.136354 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:05:08.136354 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:05:08.136354 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:05:08.136354 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:05:08.136354 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:05:08.136354 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:05:08.136354 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:05:08.137247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:05:08.137247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:05:08.137247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:05:08.137247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:05:08.137247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:05:08.137247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:05:08.137247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:05:08.137247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:05:08.137247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:05:08.137247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:05:08.137247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:05:08.137247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:05:08.137247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 599/1188] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:05:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:05:08.142500 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21889611-c12b-4e98-8adc-c283d7a02211 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:05:08.198959 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:05:08.238983 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21889611-c12b-4e98-8adc-c283d7a02211 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:05:08.271875 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db30c74-6805-42a3-8e9f-4a9568260896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:05:08.272521 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db30c74-6805-42a3-8e9f-4a9568260896 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:05:08.272807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db30c74-6805-42a3-8e9f-4a9568260896 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:05:08.273081 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db30c74-6805-42a3-8e9f-4a9568260896 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:05:08.273765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db30c74-6805-42a3-8e9f-4a9568260896 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:05:08.274073 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db30c74-6805-42a3-8e9f-4a9568260896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:05:08.275423 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db30c74-6805-42a3-8e9f-4a9568260896 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:05:08.283396 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 590/1189] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:05:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:05:08.290079 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eea48d-9706-4171-bf5a-f29037ee70a3 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:05:08.389022 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eea48d-9706-4171-bf5a-f29037ee70a3 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:05:08.391310 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:05:08.423933 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9dd4b-8578-4557-99f2-6149ebca6ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:05:08.424581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9dd4b-8578-4557-99f2-6149ebca6ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:05:08.424862 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9dd4b-8578-4557-99f2-6149ebca6ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:05:08.425136 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9dd4b-8578-4557-99f2-6149ebca6ac6 None admin] PATH_INFO: `/v3/users/7ebd8309c5964165aad5973ee1553021` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:05:08.426248 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9dd4b-8578-4557-99f2-6149ebca6ac6 None admin] RBAC: Authorizing `identity:get_user(user_id=7ebd8309c5964165aad5973ee1553021)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:05:08.427674 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9dd4b-8578-4557-99f2-6149ebca6ac6 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:05:08.429280 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 600/1190] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:05:08 2022] GET /identity/v3/users/7ebd8309c5964165aad5973ee1553021 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:05:08.435079 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db30c74-6805-42a3-8e9f-4a9568260896 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:05:08.534408 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db30c74-6805-42a3-8e9f-4a9568260896 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:05:08.554814 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:05:08.568888 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bada9b-4962-4c56-8a35-0e4d5bd45422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:05:08.569517 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bada9b-4962-4c56-8a35-0e4d5bd45422 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:05:08.569797 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bada9b-4962-4c56-8a35-0e4d5bd45422 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:05:08.570072 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bada9b-4962-4c56-8a35-0e4d5bd45422 None admin] PATH_INFO: `/v3/projects/2e8f3b4d200a4e4da5dd675b0aef9c22` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:05:08.571166 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bada9b-4962-4c56-8a35-0e4d5bd45422 None admin] RBAC: Authorizing `identity:get_project(project_id=2e8f3b4d200a4e4da5dd675b0aef9c22)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:05:08.572708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bada9b-4962-4c56-8a35-0e4d5bd45422 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:05:08.574317 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 591/1191] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:05:08 2022] GET /identity/v3/projects/2e8f3b4d200a4e4da5dd675b0aef9c22 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:05:08.580283 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9dd4b-8578-4557-99f2-6149ebca6ac6 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:05:08.676905 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9dd4b-8578-4557-99f2-6149ebca6ac6 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:05:08.711061 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7dd3b8-082b-441f-8607-c575d3f8e0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:05:08.711710 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dd3b8-082b-441f-8607-c575d3f8e0d3 None admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:05:08.711986 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dd3b8-082b-441f-8607-c575d3f8e0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:05:08.712292 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7dd3b8-082b-441f-8607-c575d3f8e0d3 None admin] PATH_INFO: `/v3/projects/2e8f3b4d200a4e4da5dd675b0aef9c22/users/7ebd8309c5964165aad5973ee1553021/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:05:08.714138 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7dd3b8-082b-441f-8607-c575d3f8e0d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e8f3b4d200a4e4da5dd675b0aef9c22, user_id=7ebd8309c5964165aad5973ee1553021, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:05:08.715641 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7dd3b8-082b-441f-8607-c575d3f8e0d3 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:05:08.795970 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 601/1192] 10.222.0.81 () {58 vars in 1439 bytes} [Tue Sep 6 21:05:08 2022] PUT /identity/v3/projects/2e8f3b4d200a4e4da5dd675b0aef9c22/users/7ebd8309c5964165aad5973ee1553021/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:05:10.905139 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538745ff-14a6-4cdd-9abc-4fe688e73a23 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:05:10.905702 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538745ff-14a6-4cdd-9abc-4fe688e73a23 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:05:10.905702 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538745ff-14a6-4cdd-9abc-4fe688e73a23 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:05:10.907028 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 592/1193] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:05:10.912871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc94e82-5596-4966-96b0-e91cb3d0f80d None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:05:10.913298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc94e82-5596-4966-96b0-e91cb3d0f80d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:05:10.913664 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc94e82-5596-4966-96b0-e91cb3d0f80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:05:10.931927 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-fcc94e82-5596-4966-96b0-e91cb3d0f80d None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:05:10.933131 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-fcc94e82-5596-4966-96b0-e91cb3d0f80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:05:10.957525 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:05:10.997712 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 602/1194] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:05:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:05:11.285952 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538745ff-14a6-4cdd-9abc-4fe688e73a23 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:05:11.384537 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538745ff-14a6-4cdd-9abc-4fe688e73a23 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:05:11.417774 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be91e5c-6681-463c-ad89-28fc2c688980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:05:11.418396 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be91e5c-6681-463c-ad89-28fc2c688980 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:05:11.418678 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be91e5c-6681-463c-ad89-28fc2c688980 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:05:11.418950 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be91e5c-6681-463c-ad89-28fc2c688980 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:05:11.428614 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be91e5c-6681-463c-ad89-28fc2c688980 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:05:11.433373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-2be91e5c-6681-463c-ad89-28fc2c688980 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:05:11.433373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:05:11.433373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:05:11.433373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:05:11.433373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:05:11.433373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:05:11.433373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:05:11.433373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:05:11.433373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:05:11.433373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:05:11.433373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:05:11.433373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:05:11.433373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:05:11.433373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:05:11.433373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:05:11.433373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:05:11.434382 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:05:11.434382 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:05:11.434382 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:05:11.434382 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:05:11.434382 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:05:11.434382 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:05:11.434382 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:05:11.434382 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:05:11.434382 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:05:11.434382 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:05:11.434382 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:05:11.434382 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:05:11.434382 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:05:11.434382 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:05:11.434382 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:05:11.434382 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:05:11.435474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:05:11.435474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:05:11.435474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:05:11.435474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:05:11.435474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:05:11.435474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:05:11.435474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:05:11.435474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:05:11.435474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:05:11.435474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:05:11.435474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:05:11.435474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:05:11.435474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 593/1195] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:05:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:05:11.440516 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc94e82-5596-4966-96b0-e91cb3d0f80d None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:05:11.541268 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc94e82-5596-4966-96b0-e91cb3d0f80d None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:05:11.574431 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def4e3b-573d-4837-9236-ec7b11f6dea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:05:11.575042 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def4e3b-573d-4837-9236-ec7b11f6dea8 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:05:11.575323 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def4e3b-573d-4837-9236-ec7b11f6dea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:05:11.575597 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def4e3b-573d-4837-9236-ec7b11f6dea8 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:05:11.576291 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def4e3b-573d-4837-9236-ec7b11f6dea8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:05:11.576597 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def4e3b-573d-4837-9236-ec7b11f6dea8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:05:11.577993 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def4e3b-573d-4837-9236-ec7b11f6dea8 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:05:11.586464 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 603/1196] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:05:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:05:11.592518 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be91e5c-6681-463c-ad89-28fc2c688980 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:05:11.641321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:05:11.691660 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be91e5c-6681-463c-ad89-28fc2c688980 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:05:11.725431 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d6ee8-16b3-400c-87a1-d8fe696786d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:05:11.726053 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d6ee8-16b3-400c-87a1-d8fe696786d5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:05:11.726335 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d6ee8-16b3-400c-87a1-d8fe696786d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:05:11.726611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d6ee8-16b3-400c-87a1-d8fe696786d5 None admin] PATH_INFO: `/v3/users/7ebd8309c5964165aad5973ee1553021` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:05:11.727739 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d6ee8-16b3-400c-87a1-d8fe696786d5 None admin] RBAC: Authorizing `identity:get_user(user_id=7ebd8309c5964165aad5973ee1553021)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:05:11.729188 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d6ee8-16b3-400c-87a1-d8fe696786d5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:05:11.730764 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 594/1197] 10.222.0.81 () {56 vars in 1177 bytes} [Tue Sep 6 21:05:11 2022] GET /identity/v3/users/7ebd8309c5964165aad5973ee1553021 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:05:11.736723 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def4e3b-573d-4837-9236-ec7b11f6dea8 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:05:11.762570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:05:11.838647 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def4e3b-573d-4837-9236-ec7b11f6dea8 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:05:11.873581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690dbb4b-bb7c-487c-b6d5-2b045ef21708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:05:11.874187 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690dbb4b-bb7c-487c-b6d5-2b045ef21708 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:05:11.874467 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690dbb4b-bb7c-487c-b6d5-2b045ef21708 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:05:11.874739 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690dbb4b-bb7c-487c-b6d5-2b045ef21708 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:05:11.942217 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690dbb4b-bb7c-487c-b6d5-2b045ef21708 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:05:11.943684 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690dbb4b-bb7c-487c-b6d5-2b045ef21708 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:05:11.969648 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:05:12.050308 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 604/1198] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:05:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 21:05:12.056861 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d6ee8-16b3-400c-87a1-d8fe696786d5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:05:12.157334 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d6ee8-16b3-400c-87a1-d8fe696786d5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:05:12.174005 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:05:12.192540 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b63be4-2d55-4826-a990-48eab6b516d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:05:12.193286 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b63be4-2d55-4826-a990-48eab6b516d6 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:05:12.193582 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b63be4-2d55-4826-a990-48eab6b516d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:05:12.193854 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b63be4-2d55-4826-a990-48eab6b516d6 None admin] PATH_INFO: `/v3/projects/2e8f3b4d200a4e4da5dd675b0aef9c22` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:05:12.195049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b63be4-2d55-4826-a990-48eab6b516d6 None admin] RBAC: Authorizing `identity:get_project(project_id=2e8f3b4d200a4e4da5dd675b0aef9c22)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:05:12.196494 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b63be4-2d55-4826-a990-48eab6b516d6 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:05:12.198116 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 595/1199] 10.222.0.81 () {56 vars in 1186 bytes} [Tue Sep 6 21:05:12 2022] GET /identity/v3/projects/2e8f3b4d200a4e4da5dd675b0aef9c22 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:05:12.204571 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690dbb4b-bb7c-487c-b6d5-2b045ef21708 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:05:12.308731 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690dbb4b-bb7c-487c-b6d5-2b045ef21708 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:05:12.332592 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:05:12.342999 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d949b-e678-49e3-a42e-d4025234aa2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:05:12.343609 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d949b-e678-49e3-a42e-d4025234aa2a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:05:12.345051 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d949b-e678-49e3-a42e-d4025234aa2a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:05:12.345051 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d949b-e678-49e3-a42e-d4025234aa2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:05:12.345051 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d949b-e678-49e3-a42e-d4025234aa2a None admin] RBAC: Adding query filter params (role.id=fe9661f095094dd0931e0b96a1d6ef74, scope.project.id=2e8f3b4d200a4e4da5dd675b0aef9c22, user.id=7ebd8309c5964165aad5973ee1553021) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:05:12.345344 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d949b-e678-49e3-a42e-d4025234aa2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:05:12.346650 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d949b-e678-49e3-a42e-d4025234aa2a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:05:12.352442 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 605/1200] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:05:12 2022] GET /identity/v3/role_assignments?user.id=7ebd8309c5964165aad5973ee1553021&scope.project.id=2e8f3b4d200a4e4da5dd675b0aef9c22&role.id=fe9661f095094dd0931e0b96a1d6ef74 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:05:22.199956 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=8 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:05:22.355730 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=6 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:28.744567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba760d47-22b6-4e5a-9d69-ab14c6598ed9 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:28.745160 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba760d47-22b6-4e5a-9d69-ab14c6598ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:28.745160 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba760d47-22b6-4e5a-9d69-ab14c6598ed9 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:28.746839 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 596/1201] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:06:28.752509 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c510197-1e76-466d-ab2f-36252f3b578d None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:28.752972 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c510197-1e76-466d-ab2f-36252f3b578d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:28.753097 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c510197-1e76-466d-ab2f-36252f3b578d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:28.771679 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-1c510197-1e76-466d-ab2f-36252f3b578d None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:06:28.772964 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1c510197-1e76-466d-ab2f-36252f3b578d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:06:28.845512 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 606/1202] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:06:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:06:29.112348 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba760d47-22b6-4e5a-9d69-ab14c6598ed9 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:29.214185 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba760d47-22b6-4e5a-9d69-ab14c6598ed9 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:29.248691 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8e271-9e0d-4eef-87a3-4c7fcea35c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:29.249437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8e271-9e0d-4eef-87a3-4c7fcea35c3e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:29.249717 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8e271-9e0d-4eef-87a3-4c7fcea35c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:29.249984 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8e271-9e0d-4eef-87a3-4c7fcea35c3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:29.260730 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc8e271-9e0d-4eef-87a3-4c7fcea35c3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:29.262180 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc8e271-9e0d-4eef-87a3-4c7fcea35c3e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:29.279400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-4bc8e271-9e0d-4eef-87a3-4c7fcea35c3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:06:29.279400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:06:29.279400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:06:29.279400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:06:29.279400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:06:29.279400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:06:29.279400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:06:29.279400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:06:29.279400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:06:29.279400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:06:29.279400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:06:29.279400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:06:29.279400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:06:29.279400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:06:29.279400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:06:29.279400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:06:29.280961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:06:29.280961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:06:29.280961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:06:29.280961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:06:29.280961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:06:29.280961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:06:29.280961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:06:29.280961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:06:29.280961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:06:29.280961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:06:29.280961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:06:29.280961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:06:29.280961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:06:29.280961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:06:29.280961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:06:29.280961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:06:29.280961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:06:29.281957 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:06:29.281957 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:06:29.281957 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:06:29.281957 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 597/1203] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:06:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:06:29.285774 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c510197-1e76-466d-ab2f-36252f3b578d None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:29.386267 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c510197-1e76-466d-ab2f-36252f3b578d None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:29.415300 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:29.421695 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdf65a-d776-4da7-b1ad-9758e3f3f0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:29.422304 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdf65a-d776-4da7-b1ad-9758e3f3f0cf None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:29.422585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdf65a-d776-4da7-b1ad-9758e3f3f0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:29.422860 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdf65a-d776-4da7-b1ad-9758e3f3f0cf None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:29.423498 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdf65a-d776-4da7-b1ad-9758e3f3f0cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:29.423803 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdf65a-d776-4da7-b1ad-9758e3f3f0cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:29.425223 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdf65a-d776-4da7-b1ad-9758e3f3f0cf None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:29.436498 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 607/1204] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:06:29.442554 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8e271-9e0d-4eef-87a3-4c7fcea35c3e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:29.494760 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:29.541171 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8e271-9e0d-4eef-87a3-4c7fcea35c3e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:29.574563 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f029b-379a-4603-8c0c-296edc811b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:29.575250 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f029b-379a-4603-8c0c-296edc811b29 None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:29.575532 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f029b-379a-4603-8c0c-296edc811b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:29.575805 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f029b-379a-4603-8c0c-296edc811b29 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:29.576486 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f029b-379a-4603-8c0c-296edc811b29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:29.577896 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f029b-379a-4603-8c0c-296edc811b29 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:29.679861 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 598/1205] 10.222.0.81 () {60 vars in 1132 bytes} [Tue Sep 6 21:06:29 2022] POST /identity/v3/users => generated 251 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:06:31.886007 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090f8ab-a9e2-4954-a0de-59627fc20440 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:31.886693 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090f8ab-a9e2-4954-a0de-59627fc20440 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:31.886693 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090f8ab-a9e2-4954-a0de-59627fc20440 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:31.887996 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 608/1206] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:06:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:06:31.893604 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70674428-2132-4178-8954-e4c85b3150cd None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:31.894017 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70674428-2132-4178-8954-e4c85b3150cd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:31.894148 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70674428-2132-4178-8954-e4c85b3150cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:31.913066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-70674428-2132-4178-8954-e4c85b3150cd None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:06:31.914533 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-70674428-2132-4178-8954-e4c85b3150cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:06:31.981045 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 599/1207] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:06:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:06:32.253404 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090f8ab-a9e2-4954-a0de-59627fc20440 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:32.355311 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090f8ab-a9e2-4954-a0de-59627fc20440 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:32.389635 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af3db3-61b6-41c8-af63-b394bf342efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:32.390257 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af3db3-61b6-41c8-af63-b394bf342efc None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:32.390551 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af3db3-61b6-41c8-af63-b394bf342efc None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:32.390801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af3db3-61b6-41c8-af63-b394bf342efc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:32.400430 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af3db3-61b6-41c8-af63-b394bf342efc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:06:32.405075 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-16af3db3-61b6-41c8-af63-b394bf342efc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:06:32.405075 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:06:32.405075 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:06:32.405075 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:06:32.405075 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:06:32.405075 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:06:32.405075 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:06:32.405075 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:06:32.405075 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:06:32.405075 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:06:32.405075 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:06:32.405075 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:06:32.405075 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:06:32.405075 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:06:32.405075 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:06:32.405075 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:06:32.406197 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:06:32.406197 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:06:32.406197 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:06:32.406197 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:06:32.406197 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:06:32.406197 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:06:32.406197 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:06:32.406197 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:06:32.406197 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:06:32.406197 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:06:32.406197 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:06:32.406197 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:06:32.406197 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:06:32.406197 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:06:32.406197 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:06:32.406197 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:06:32.407250 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:06:32.407250 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:06:32.407250 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:06:32.407250 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:06:32.407250 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:06:32.407250 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:06:32.407250 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:06:32.407250 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:06:32.407250 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:06:32.407250 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:06:32.407250 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:06:32.407250 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:06:32.407250 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 609/1208] 10.222.0.81 () {56 vars in 1102 bytes} [Tue Sep 6 21:06:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:06:32.412385 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70674428-2132-4178-8954-e4c85b3150cd None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:32.454240 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:32.513285 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70674428-2132-4178-8954-e4c85b3150cd None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:32.548696 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da18dce-619b-4378-ab92-74b1ab63d5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:32.549916 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da18dce-619b-4378-ab92-74b1ab63d5b3 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:32.549916 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da18dce-619b-4378-ab92-74b1ab63d5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:32.549916 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da18dce-619b-4378-ab92-74b1ab63d5b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:32.550859 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da18dce-619b-4378-ab92-74b1ab63d5b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:32.550859 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da18dce-619b-4378-ab92-74b1ab63d5b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:32.552282 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da18dce-619b-4378-ab92-74b1ab63d5b3 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:32.561385 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 600/1209] 10.222.0.81 () {56 vars in 1103 bytes} [Tue Sep 6 21:06:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:06:32.567382 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af3db3-61b6-41c8-af63-b394bf342efc None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:32.619185 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:32.667783 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af3db3-61b6-41c8-af63-b394bf342efc None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:32.702338 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a922eb-8824-4def-b094-73ae7dfc3214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:32.702963 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a922eb-8824-4def-b094-73ae7dfc3214 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:32.703267 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a922eb-8824-4def-b094-73ae7dfc3214 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:32.703536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a922eb-8824-4def-b094-73ae7dfc3214 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:32.713424 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a922eb-8824-4def-b094-73ae7dfc3214 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:32.714859 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a922eb-8824-4def-b094-73ae7dfc3214 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:32.730006 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-95a922eb-8824-4def-b094-73ae7dfc3214 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:06:32.730006 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:06:32.730006 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:06:32.730006 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:06:32.730006 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:06:32.730006 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:06:32.730006 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:06:32.730006 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:06:32.730006 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:06:32.730006 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:06:32.730006 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:06:32.730006 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:06:32.730006 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:06:32.730006 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:06:32.730006 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:06:32.730006 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:06:32.731166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:06:32.731166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:06:32.731166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:06:32.731166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:06:32.731166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:06:32.731166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:06:32.731166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:06:32.731166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:06:32.731166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:06:32.731166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:06:32.731166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:06:32.731166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:06:32.731166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:06:32.731166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:06:32.731166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:06:32.731166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:06:32.731166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:06:32.732357 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:06:32.732357 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:06:32.732357 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:06:32.732357 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 610/1210] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:06:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:06:32.737903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da18dce-619b-4378-ab92-74b1ab63d5b3 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:32.844543 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:32.847470 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da18dce-619b-4378-ab92-74b1ab63d5b3 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:32.880702 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59124e98-79ad-4378-aed1-138bfc47a45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:32.881300 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59124e98-79ad-4378-aed1-138bfc47a45c None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:32.881578 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59124e98-79ad-4378-aed1-138bfc47a45c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:32.881847 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59124e98-79ad-4378-aed1-138bfc47a45c None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:32.882470 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59124e98-79ad-4378-aed1-138bfc47a45c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:32.882767 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59124e98-79ad-4378-aed1-138bfc47a45c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:32.884115 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59124e98-79ad-4378-aed1-138bfc47a45c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:32.894953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 601/1211] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:06:32.901470 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a922eb-8824-4def-b094-73ae7dfc3214 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:33.003302 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a922eb-8824-4def-b094-73ae7dfc3214 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:33.004831 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:33.037260 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720cbb3e-d454-4dc6-8467-13b38c857ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:33.037889 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cbb3e-d454-4dc6-8467-13b38c857ddf None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:33.038259 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cbb3e-d454-4dc6-8467-13b38c857ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:33.038539 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720cbb3e-d454-4dc6-8467-13b38c857ddf None admin] PATH_INFO: `/v3/users/placement` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:33.046447 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720cbb3e-d454-4dc6-8467-13b38c857ddf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:33.047879 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720cbb3e-d454-4dc6-8467-13b38c857ddf None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:33.059407 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-720cbb3e-d454-4dc6-8467-13b38c857ddf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 21:06:33.059407 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:06:33.059407 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:06:33.059407 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:06:33.059407 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:06:33.059407 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:06:33.059407 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:06:33.059407 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:06:33.059407 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:06:33.059407 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:06:33.059407 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:06:33.059407 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:06:33.059407 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:06:33.059407 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:06:33.059407 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:06:33.059407 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:06:33.060448 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:06:33.060448 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:06:33.060448 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:06:33.060448 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:06:33.060448 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:06:33.060448 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:06:33.060448 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:06:33.060448 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:06:33.060448 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:06:33.060448 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:06:33.060448 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:06:33.060448 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:06:33.060448 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:06:33.060448 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:06:33.060448 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:06:33.060448 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:06:33.060448 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:06:33.060448 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:06:33.061520 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:06:33.061520 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:06:33.061520 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:06:33.061520 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:06:33.061520 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:06:33.061520 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:06:33.061520 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:06:33.061520 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:06:33.061520 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 21:06:33.061520 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:06:33.061520 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 611/1212] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:06:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:06:33.066664 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59124e98-79ad-4378-aed1-138bfc47a45c None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:33.171433 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59124e98-79ad-4378-aed1-138bfc47a45c None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:33.211931 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113595c-2bac-47ac-906d-77e947372ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:33.213060 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113595c-2bac-47ac-906d-77e947372ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:33.213335 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113595c-2bac-47ac-906d-77e947372ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:33.213603 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113595c-2bac-47ac-906d-77e947372ed8 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:33.214324 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113595c-2bac-47ac-906d-77e947372ed8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:33.214622 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113595c-2bac-47ac-906d-77e947372ed8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:33.216072 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113595c-2bac-47ac-906d-77e947372ed8 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:33.239214 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 602/1213] 10.222.0.81 () {56 vars in 1143 bytes} [Tue Sep 6 21:06:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:06:33.245364 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720cbb3e-d454-4dc6-8467-13b38c857ddf None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:33.351039 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720cbb3e-d454-4dc6-8467-13b38c857ddf None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:33.386253 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbae897-32ef-41d4-ae28-8f3072c893c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:33.386859 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbae897-32ef-41d4-ae28-8f3072c893c1 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:33.387134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbae897-32ef-41d4-ae28-8f3072c893c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:33.387403 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbae897-32ef-41d4-ae28-8f3072c893c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:33.419228 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:33.458702 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbae897-32ef-41d4-ae28-8f3072c893c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:33.460147 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbae897-32ef-41d4-ae28-8f3072c893c1 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:33.558809 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 612/1214] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:06:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 21:06:33.564965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113595c-2bac-47ac-906d-77e947372ed8 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:33.586349 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:33.669929 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113595c-2bac-47ac-906d-77e947372ed8 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:33.703501 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb0fbc-6ecc-46ca-96af-7ad2bb0df996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:33.704147 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb0fbc-6ecc-46ca-96af-7ad2bb0df996 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:33.704432 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb0fbc-6ecc-46ca-96af-7ad2bb0df996 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:33.704705 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accb0fbc-6ecc-46ca-96af-7ad2bb0df996 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:33.714415 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb0fbc-6ecc-46ca-96af-7ad2bb0df996 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:33.715869 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accb0fbc-6ecc-46ca-96af-7ad2bb0df996 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:33.730049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-accb0fbc-6ecc-46ca-96af-7ad2bb0df996 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:06:33.730049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:06:33.730049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:06:33.730049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:06:33.730049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:06:33.730049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:06:33.730049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:06:33.730049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:06:33.730049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:06:33.730049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:06:33.730049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:06:33.730049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:06:33.730049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:06:33.730049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:06:33.730049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:06:33.730049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:06:33.732218 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:06:33.732218 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:06:33.732218 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:06:33.732218 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:06:33.732218 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:06:33.732218 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:06:33.732218 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:06:33.732218 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:06:33.732218 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:06:33.732218 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:06:33.732218 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:06:33.732218 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:06:33.732218 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:06:33.732218 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:06:33.732218 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:06:33.732218 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:06:33.732218 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:06:33.734296 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:06:33.734296 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:06:33.734296 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:06:33.734296 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 603/1215] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:06:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:06:33.737224 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbae897-32ef-41d4-ae28-8f3072c893c1 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:33.797545 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:33.838247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbae897-32ef-41d4-ae28-8f3072c893c1 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:33.871213 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab08fc2-25d7-4d2a-8dcc-28dc91531fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:33.872134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab08fc2-25d7-4d2a-8dcc-28dc91531fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:33.872497 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab08fc2-25d7-4d2a-8dcc-28dc91531fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:33.872914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab08fc2-25d7-4d2a-8dcc-28dc91531fc4 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:33.873784 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab08fc2-25d7-4d2a-8dcc-28dc91531fc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:33.874214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab08fc2-25d7-4d2a-8dcc-28dc91531fc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:33.876118 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab08fc2-25d7-4d2a-8dcc-28dc91531fc4 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:33.888203 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 613/1216] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:06:33.893858 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb0fbc-6ecc-46ca-96af-7ad2bb0df996 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:33.967320 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:33.998308 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accb0fbc-6ecc-46ca-96af-7ad2bb0df996 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:34.031292 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42cc13-7d42-4202-b547-2d9a060da4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:34.031983 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42cc13-7d42-4202-b547-2d9a060da4f9 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:34.032287 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42cc13-7d42-4202-b547-2d9a060da4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:34.038333 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc42cc13-7d42-4202-b547-2d9a060da4f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:34.039454 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42cc13-7d42-4202-b547-2d9a060da4f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:34.040903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc42cc13-7d42-4202-b547-2d9a060da4f9 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:34.052745 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-bc42cc13-7d42-4202-b547-2d9a060da4f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:06:34.052745 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:06:34.052745 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:06:34.052745 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:06:34.052745 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:06:34.052745 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:06:34.052745 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:06:34.052745 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:06:34.052745 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:06:34.052745 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:06:34.052745 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:06:34.052745 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:06:34.052745 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:06:34.052745 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:06:34.052745 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:06:34.057973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:06:34.057973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:06:34.057973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:06:34.057973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:06:34.057973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:06:34.057973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:06:34.057973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:06:34.057973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:06:34.057973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:06:34.057973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:06:34.057973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:06:34.057973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:06:34.057973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:06:34.057973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:06:34.057973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:06:34.057973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:06:34.057973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:06:34.058966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:06:34.058966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:06:34.058966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:06:34.058966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:06:34.058966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:06:34.058966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:06:34.058966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:06:34.058966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:06:34.058966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 604/1217] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:06:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:06:34.060546 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab08fc2-25d7-4d2a-8dcc-28dc91531fc4 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:34.159289 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab08fc2-25d7-4d2a-8dcc-28dc91531fc4 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:34.182565 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:34.194313 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abce685-68d3-485c-9c79-ecd68b94f6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:34.194922 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abce685-68d3-485c-9c79-ecd68b94f6ba None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:34.195226 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abce685-68d3-485c-9c79-ecd68b94f6ba None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:34.195500 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abce685-68d3-485c-9c79-ecd68b94f6ba None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:34.196211 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abce685-68d3-485c-9c79-ecd68b94f6ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:34.196521 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abce685-68d3-485c-9c79-ecd68b94f6ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:34.198098 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abce685-68d3-485c-9c79-ecd68b94f6ba None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:34.209561 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 614/1218] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:06:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:06:34.215739 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42cc13-7d42-4202-b547-2d9a060da4f9 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:34.316734 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc42cc13-7d42-4202-b547-2d9a060da4f9 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:34.344319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:34.349982 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a09db-b60a-4d4e-aa09-0bc2aa43a12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:34.350584 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a09db-b60a-4d4e-aa09-0bc2aa43a12e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:34.350864 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a09db-b60a-4d4e-aa09-0bc2aa43a12e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:34.351132 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a09db-b60a-4d4e-aa09-0bc2aa43a12e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:34.351962 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a09db-b60a-4d4e-aa09-0bc2aa43a12e None admin] RBAC: Adding query filter params (role.id=747c70d4cefb4a82816c17da1259b90f, scope.project.id=002e09339d4e49ce98434571d3b64248, user.id=c3295306746f4552837f1bb12b2c500f) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:34.352300 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a09db-b60a-4d4e-aa09-0bc2aa43a12e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:34.354340 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a09db-b60a-4d4e-aa09-0bc2aa43a12e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:34.360379 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 605/1219] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:06:34 2022] GET /identity/v3/role_assignments?user.id=c3295306746f4552837f1bb12b2c500f&scope.project.id=002e09339d4e49ce98434571d3b64248&role.id=747c70d4cefb4a82816c17da1259b90f => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:06:36.490086 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9999f6-f30c-4521-9319-a5f614505c2e None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:36.490699 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9999f6-f30c-4521-9319-a5f614505c2e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:36.490699 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9999f6-f30c-4521-9319-a5f614505c2e None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:36.491961 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 615/1220] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:06:36.497199 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e93bf-ee80-414e-a0df-8777d280aa96 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:36.497639 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e93bf-ee80-414e-a0df-8777d280aa96 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:36.497829 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051e93bf-ee80-414e-a0df-8777d280aa96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:36.516373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-051e93bf-ee80-414e-a0df-8777d280aa96 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:06:36.521179 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-051e93bf-ee80-414e-a0df-8777d280aa96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:06:36.589899 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 606/1221] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:06:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:06:36.856672 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9999f6-f30c-4521-9319-a5f614505c2e None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:36.959885 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9999f6-f30c-4521-9319-a5f614505c2e None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:36.993429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfefed-1b9f-4e8c-9589-1513bbdafc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:36.994115 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfefed-1b9f-4e8c-9589-1513bbdafc13 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:36.995056 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfefed-1b9f-4e8c-9589-1513bbdafc13 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:36.995381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfefed-1b9f-4e8c-9589-1513bbdafc13 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:37.006173 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfefed-1b9f-4e8c-9589-1513bbdafc13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:06:37.010863 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-11bfefed-1b9f-4e8c-9589-1513bbdafc13 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:06:37.010863 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:06:37.010863 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:06:37.010863 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:06:37.010863 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:06:37.010863 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:06:37.010863 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:06:37.010863 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:06:37.010863 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:06:37.010863 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:06:37.010863 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:06:37.010863 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:06:37.010863 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:06:37.010863 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:06:37.010863 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:06:37.010863 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:06:37.012122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:06:37.012122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:06:37.012122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:06:37.012122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:06:37.012122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:06:37.012122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:06:37.012122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:06:37.012122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:06:37.012122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:06:37.012122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:06:37.012122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:06:37.012122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:06:37.012122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:06:37.012122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:06:37.012122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:06:37.012122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:06:37.013318 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:06:37.013318 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:06:37.013318 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:06:37.013318 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:06:37.013318 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:06:37.013318 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:06:37.013318 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:06:37.013318 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:06:37.013318 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:06:37.013318 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:06:37.013318 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:06:37.013318 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:06:37.013318 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 616/1222] 10.222.0.81 () {56 vars in 1102 bytes} [Tue Sep 6 21:06:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:06:37.018058 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e93bf-ee80-414e-a0df-8777d280aa96 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:37.114165 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051e93bf-ee80-414e-a0df-8777d280aa96 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:37.138272 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:37.148644 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a1e6e-6bc0-4a54-b751-4c60669479a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:37.149306 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a1e6e-6bc0-4a54-b751-4c60669479a0 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:37.149588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a1e6e-6bc0-4a54-b751-4c60669479a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:37.149881 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a1e6e-6bc0-4a54-b751-4c60669479a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:37.150523 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a1e6e-6bc0-4a54-b751-4c60669479a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:37.150824 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a1e6e-6bc0-4a54-b751-4c60669479a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:37.152277 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a1e6e-6bc0-4a54-b751-4c60669479a0 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:37.160067 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 607/1223] 10.222.0.81 () {56 vars in 1103 bytes} [Tue Sep 6 21:06:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:06:37.166666 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfefed-1b9f-4e8c-9589-1513bbdafc13 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:37.210973 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:37.266802 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfefed-1b9f-4e8c-9589-1513bbdafc13 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:37.302298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5549d-9164-428a-975d-07aec3840cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:37.302922 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5549d-9164-428a-975d-07aec3840cec None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:37.303205 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5549d-9164-428a-975d-07aec3840cec None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:37.303479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5549d-9164-428a-975d-07aec3840cec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:37.314510 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5549d-9164-428a-975d-07aec3840cec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:37.316074 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5549d-9164-428a-975d-07aec3840cec None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:37.330063 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-79b5549d-9164-428a-975d-07aec3840cec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:06:37.330063 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:06:37.330063 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:06:37.330063 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:06:37.330063 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:06:37.330063 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:06:37.330063 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:06:37.330063 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:06:37.330063 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:06:37.330063 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:06:37.330063 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:06:37.330063 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:06:37.330063 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:06:37.330063 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:06:37.330063 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:06:37.330063 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:06:37.331161 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:06:37.331161 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:06:37.331161 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:06:37.331161 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:06:37.331161 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:06:37.331161 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:06:37.331161 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:06:37.331161 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:06:37.331161 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:06:37.331161 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:06:37.331161 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:06:37.331161 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:06:37.331161 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:06:37.331161 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:06:37.331161 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:06:37.331161 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:06:37.331161 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:06:37.332240 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:06:37.332240 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:06:37.332240 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:06:37.332240 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 617/1224] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:06:37.337119 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a1e6e-6bc0-4a54-b751-4c60669479a0 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:37.438616 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a1e6e-6bc0-4a54-b751-4c60669479a0 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:37.471392 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7537c6-833c-4483-a1b6-c7f78fc1d1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:37.471997 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7537c6-833c-4483-a1b6-c7f78fc1d1aa None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:37.472308 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7537c6-833c-4483-a1b6-c7f78fc1d1aa None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:37.472584 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7537c6-833c-4483-a1b6-c7f78fc1d1aa None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:37.473222 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7537c6-833c-4483-a1b6-c7f78fc1d1aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:37.473529 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7537c6-833c-4483-a1b6-c7f78fc1d1aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:37.474887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7537c6-833c-4483-a1b6-c7f78fc1d1aa None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:37.487089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 608/1225] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:06:37.493468 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5549d-9164-428a-975d-07aec3840cec None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:37.593994 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:37.600495 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5549d-9164-428a-975d-07aec3840cec None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:37.635074 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d328d1-51b8-4717-985a-429a98edd61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:37.635700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d328d1-51b8-4717-985a-429a98edd61f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:37.635980 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d328d1-51b8-4717-985a-429a98edd61f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:37.636289 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d328d1-51b8-4717-985a-429a98edd61f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:37.643187 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d328d1-51b8-4717-985a-429a98edd61f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:37.646984 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d328d1-51b8-4717-985a-429a98edd61f None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:37.657081 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-64d328d1-51b8-4717-985a-429a98edd61f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 21:06:37.657081 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:06:37.657081 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:06:37.657081 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:06:37.657081 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:06:37.657081 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:06:37.657081 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:06:37.657081 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:06:37.657081 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:06:37.657081 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:06:37.657081 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:06:37.657081 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:06:37.657081 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:06:37.657081 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:06:37.657081 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:06:37.657081 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:06:37.658142 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:06:37.658142 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:06:37.658142 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:06:37.658142 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:06:37.658142 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:06:37.658142 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:06:37.658142 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:06:37.658142 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:06:37.658142 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:06:37.658142 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:06:37.658142 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:06:37.658142 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:06:37.658142 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:06:37.658142 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:06:37.658142 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:06:37.658142 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:06:37.658142 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:06:37.658142 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:06:37.659110 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:06:37.659110 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:06:37.659110 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:06:37.659110 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:06:37.659110 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:06:37.659110 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:06:37.659110 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:06:37.659110 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:06:37.659110 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 21:06:37.659110 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:06:37.659110 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 618/1226] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:06:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:06:37.664377 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7537c6-833c-4483-a1b6-c7f78fc1d1aa None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:37.719542 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:37.771951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7537c6-833c-4483-a1b6-c7f78fc1d1aa None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:37.805806 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba9a12-a8e4-4d6b-a644-fe0e1fa69816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:37.806422 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba9a12-a8e4-4d6b-a644-fe0e1fa69816 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:37.806701 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba9a12-a8e4-4d6b-a644-fe0e1fa69816 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:37.806973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba9a12-a8e4-4d6b-a644-fe0e1fa69816 None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:37.807713 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba9a12-a8e4-4d6b-a644-fe0e1fa69816 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:37.808014 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba9a12-a8e4-4d6b-a644-fe0e1fa69816 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:37.809444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ba9a12-a8e4-4d6b-a644-fe0e1fa69816 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:37.828008 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 609/1227] 10.222.0.81 () {56 vars in 1143 bytes} [Tue Sep 6 21:06:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:06:37.834125 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d328d1-51b8-4717-985a-429a98edd61f None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:37.934258 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d328d1-51b8-4717-985a-429a98edd61f None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:37.967602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c6270-04e0-4497-8d34-1ff325f6673c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:37.968248 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c6270-04e0-4497-8d34-1ff325f6673c None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:37.968585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c6270-04e0-4497-8d34-1ff325f6673c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:37.968929 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c6270-04e0-4497-8d34-1ff325f6673c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:37.987514 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c6270-04e0-4497-8d34-1ff325f6673c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:37.987514 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55c6270-04e0-4497-8d34-1ff325f6673c None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:37.995469 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-b55c6270-04e0-4497-8d34-1ff325f6673c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:06:37.995469 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:06:37.995469 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:06:37.995469 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:06:37.995469 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:06:37.995469 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:06:37.995469 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:06:37.995469 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:06:37.995469 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:06:37.995469 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:06:37.995469 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:06:37.995469 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:06:37.995469 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:06:37.995469 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:06:37.995469 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:06:37.995469 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:06:37.996620 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:06:37.996620 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:06:37.996620 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:06:37.996620 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:06:37.996620 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:06:37.996620 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:06:37.996620 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:06:37.996620 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:06:37.996620 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:06:37.996620 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:06:37.996620 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:06:37.996620 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:06:37.996620 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:06:37.996620 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:06:37.996620 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:06:37.996620 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:06:37.996620 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:06:37.997927 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:06:37.997927 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:06:37.997927 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:06:37.997927 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 619/1228] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:06:38.002613 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba9a12-a8e4-4d6b-a644-fe0e1fa69816 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:38.102826 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ba9a12-a8e4-4d6b-a644-fe0e1fa69816 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:38.105199 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:38.136577 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff59f7-9399-4fe9-9142-954944b9d781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:38.137184 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff59f7-9399-4fe9-9142-954944b9d781 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:38.137461 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff59f7-9399-4fe9-9142-954944b9d781 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:38.137730 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff59f7-9399-4fe9-9142-954944b9d781 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:38.138373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff59f7-9399-4fe9-9142-954944b9d781 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:38.138671 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff59f7-9399-4fe9-9142-954944b9d781 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:38.140018 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ff59f7-9399-4fe9-9142-954944b9d781 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:38.150985 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 610/1229] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:06:38.156844 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c6270-04e0-4497-8d34-1ff325f6673c None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:38.166620 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:38.255576 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c6270-04e0-4497-8d34-1ff325f6673c None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:38.290536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e9947-9933-43f4-99a1-f01e710f1d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:38.291156 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e9947-9933-43f4-99a1-f01e710f1d8c None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:38.291431 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e9947-9933-43f4-99a1-f01e710f1d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:38.291697 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e9947-9933-43f4-99a1-f01e710f1d8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:38.298190 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e9947-9933-43f4-99a1-f01e710f1d8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:38.299636 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e9947-9933-43f4-99a1-f01e710f1d8c None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:38.311379 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-9c2e9947-9933-43f4-99a1-f01e710f1d8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:06:38.311379 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:06:38.311379 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:06:38.311379 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:06:38.311379 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:06:38.311379 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:06:38.311379 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:06:38.311379 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:06:38.311379 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:06:38.311379 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:06:38.311379 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:06:38.311379 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:06:38.311379 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:06:38.311379 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:06:38.311379 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:06:38.316429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:06:38.316429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:06:38.316429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:06:38.316429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:06:38.316429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:06:38.316429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:06:38.316429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:06:38.316429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:06:38.316429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:06:38.316429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:06:38.316429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:06:38.316429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:06:38.316429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:06:38.316429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:06:38.316429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:06:38.316429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:06:38.316429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:06:38.317359 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:06:38.317359 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:06:38.317359 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:06:38.317359 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:06:38.317359 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:06:38.317359 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:06:38.317359 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:06:38.317359 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:06:38.317359 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 620/1230] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:06:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:06:38.319128 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff59f7-9399-4fe9-9142-954944b9d781 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:38.420160 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff59f7-9399-4fe9-9142-954944b9d781 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:38.453594 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec018f-14d3-4a47-a2ee-311a8f903522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:38.454198 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec018f-14d3-4a47-a2ee-311a8f903522 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:38.454481 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec018f-14d3-4a47-a2ee-311a8f903522 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:38.454754 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec018f-14d3-4a47-a2ee-311a8f903522 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:38.455437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec018f-14d3-4a47-a2ee-311a8f903522 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:38.455743 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec018f-14d3-4a47-a2ee-311a8f903522 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:38.457181 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec018f-14d3-4a47-a2ee-311a8f903522 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:38.469189 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 611/1231] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:06:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:06:38.475230 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e9947-9933-43f4-99a1-f01e710f1d8c None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:38.539115 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:38.575862 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e9947-9933-43f4-99a1-f01e710f1d8c None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:38.609168 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f56fa3f-2808-414d-80d7-90082df6a0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:38.609808 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56fa3f-2808-414d-80d7-90082df6a0b9 None admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:38.610083 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56fa3f-2808-414d-80d7-90082df6a0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:38.610356 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f56fa3f-2808-414d-80d7-90082df6a0b9 None admin] PATH_INFO: `/v3/projects/002e09339d4e49ce98434571d3b64248/users/c3295306746f4552837f1bb12b2c500f/roles/747c70d4cefb4a82816c17da1259b90f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:38.625434 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f56fa3f-2808-414d-80d7-90082df6a0b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=002e09339d4e49ce98434571d3b64248, user_id=c3295306746f4552837f1bb12b2c500f, role_id=747c70d4cefb4a82816c17da1259b90f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:38.634897 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f56fa3f-2808-414d-80d7-90082df6a0b9 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:38.753754 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 621/1232] 10.222.0.81 () {58 vars in 1439 bytes} [Tue Sep 6 21:06:38 2022] PUT /identity/v3/projects/002e09339d4e49ce98434571d3b64248/users/c3295306746f4552837f1bb12b2c500f/roles/747c70d4cefb4a82816c17da1259b90f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:06:40.886583 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a8020-671c-4663-9c4b-a075befe2655 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:40.887126 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a8020-671c-4663-9c4b-a075befe2655 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:40.887126 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a8020-671c-4663-9c4b-a075befe2655 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:40.888531 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 612/1233] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:06:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:06:40.893881 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d1639-2820-461b-87f9-29609b670ae2 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:40.894292 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d1639-2820-461b-87f9-29609b670ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:40.894432 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d1639-2820-461b-87f9-29609b670ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:40.921571 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-9d6d1639-2820-461b-87f9-29609b670ae2 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:06:40.921571 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-9d6d1639-2820-461b-87f9-29609b670ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:06:40.988323 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 622/1234] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:06:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:06:41.253113 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a8020-671c-4663-9c4b-a075befe2655 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:41.278845 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:41.358668 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a8020-671c-4663-9c4b-a075befe2655 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:41.392902 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6edbd-1784-4b1f-8cb2-ff02d5700345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:41.393535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6edbd-1784-4b1f-8cb2-ff02d5700345 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:41.393817 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6edbd-1784-4b1f-8cb2-ff02d5700345 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:41.394093 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6edbd-1784-4b1f-8cb2-ff02d5700345 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:41.404626 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6edbd-1784-4b1f-8cb2-ff02d5700345 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:06:41.409472 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-dcc6edbd-1784-4b1f-8cb2-ff02d5700345 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:06:41.409472 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:06:41.409472 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:06:41.409472 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:06:41.409472 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:06:41.409472 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:06:41.409472 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:06:41.409472 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:06:41.409472 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:06:41.409472 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:06:41.409472 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:06:41.409472 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:06:41.409472 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:06:41.409472 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:06:41.409472 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:06:41.409472 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:06:41.410482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:06:41.410482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:06:41.410482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:06:41.410482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:06:41.410482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:06:41.410482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:06:41.410482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:06:41.410482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:06:41.410482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:06:41.410482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:06:41.410482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:06:41.410482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:06:41.410482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:06:41.410482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:06:41.410482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:06:41.410482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:06:41.411513 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:06:41.411513 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:06:41.411513 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:06:41.411513 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:06:41.411513 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:06:41.411513 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:06:41.411513 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:06:41.411513 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:06:41.411513 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:06:41.411513 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:06:41.411513 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 06 21:06:41.411513 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:06:41.411513 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 613/1235] 10.222.0.81 () {56 vars in 1102 bytes} [Tue Sep 6 21:06:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:06:41.416994 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d1639-2820-461b-87f9-29609b670ae2 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:41.462846 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:41.513416 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d1639-2820-461b-87f9-29609b670ae2 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:41.547059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f20236-7802-4a39-afa6-53cde99e0b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:41.547654 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f20236-7802-4a39-afa6-53cde99e0b02 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:41.547935 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f20236-7802-4a39-afa6-53cde99e0b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:41.548244 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f20236-7802-4a39-afa6-53cde99e0b02 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:41.548899 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f20236-7802-4a39-afa6-53cde99e0b02 None admin] RBAC: Adding query filter params (name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:41.549204 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f20236-7802-4a39-afa6-53cde99e0b02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:41.550621 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f20236-7802-4a39-afa6-53cde99e0b02 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:41.558868 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 623/1236] 10.222.0.81 () {56 vars in 1103 bytes} [Tue Sep 6 21:06:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:06:41.564808 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6edbd-1784-4b1f-8cb2-ff02d5700345 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:41.647999 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:41.664340 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6edbd-1784-4b1f-8cb2-ff02d5700345 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:41.697687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7dc39-bf80-4961-a83e-a08246a37019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:41.698313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7dc39-bf80-4961-a83e-a08246a37019 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:41.698592 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7dc39-bf80-4961-a83e-a08246a37019 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:41.698864 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7dc39-bf80-4961-a83e-a08246a37019 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:41.708921 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7dc39-bf80-4961-a83e-a08246a37019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:41.710357 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7dc39-bf80-4961-a83e-a08246a37019 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:41.724996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-9fd7dc39-bf80-4961-a83e-a08246a37019 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:06:41.724996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:06:41.724996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:06:41.724996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:06:41.724996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:06:41.724996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:06:41.724996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:06:41.724996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:06:41.724996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:06:41.724996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:06:41.724996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:06:41.724996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:06:41.724996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:06:41.724996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:06:41.724996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:06:41.724996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:06:41.726105 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:06:41.726105 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:06:41.726105 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:06:41.726105 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:06:41.726105 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:06:41.726105 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:06:41.726105 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:06:41.726105 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:06:41.726105 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:06:41.726105 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:06:41.726105 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:06:41.726105 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:06:41.726105 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:06:41.726105 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:06:41.726105 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:06:41.726105 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:06:41.726105 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:06:41.727023 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:06:41.727023 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:06:41.727023 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:06:41.727023 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 614/1237] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:06:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:06:41.731940 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f20236-7802-4a39-afa6-53cde99e0b02 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:41.830833 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f20236-7802-4a39-afa6-53cde99e0b02 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:41.839980 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:41.863469 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc0192-78e4-45d6-b94b-bd5a933c2481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:41.864075 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc0192-78e4-45d6-b94b-bd5a933c2481 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:41.864381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc0192-78e4-45d6-b94b-bd5a933c2481 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:41.864659 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc0192-78e4-45d6-b94b-bd5a933c2481 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:41.865293 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc0192-78e4-45d6-b94b-bd5a933c2481 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:41.865596 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc0192-78e4-45d6-b94b-bd5a933c2481 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:41.866976 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fc0192-78e4-45d6-b94b-bd5a933c2481 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:41.878944 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 624/1238] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:06:41.885535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7dc39-bf80-4961-a83e-a08246a37019 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:41.983773 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7dc39-bf80-4961-a83e-a08246a37019 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:42.017648 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcca277-03fd-497d-9fb6-4c6de51ce113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:42.018276 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcca277-03fd-497d-9fb6-4c6de51ce113 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:42.018552 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcca277-03fd-497d-9fb6-4c6de51ce113 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:42.018818 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcca277-03fd-497d-9fb6-4c6de51ce113 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:42.021503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:42.026501 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcca277-03fd-497d-9fb6-4c6de51ce113 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:42.028019 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcca277-03fd-497d-9fb6-4c6de51ce113 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:42.039312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-5fcca277-03fd-497d-9fb6-4c6de51ce113 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 21:06:42.039312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:06:42.039312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:06:42.039312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:06:42.039312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:06:42.039312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:06:42.039312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:06:42.039312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:06:42.039312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:06:42.039312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:06:42.039312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:06:42.039312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:06:42.039312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:06:42.039312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:06:42.039312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:06:42.039312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:06:42.040562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:06:42.040562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:06:42.040562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:06:42.040562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:06:42.040562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:06:42.040562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:06:42.040562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:06:42.040562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:06:42.040562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:06:42.040562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:06:42.040562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:06:42.040562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:06:42.040562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:06:42.040562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:06:42.040562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:06:42.040562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:06:42.040562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:06:42.040562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:06:42.041756 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:06:42.041756 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:06:42.041756 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:06:42.041756 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:06:42.041756 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:06:42.041756 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:06:42.041756 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:06:42.041756 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:06:42.041756 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 21:06:42.041756 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:06:42.041756 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 615/1239] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:06:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:06:42.047048 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc0192-78e4-45d6-b94b-bd5a933c2481 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:42.150544 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fc0192-78e4-45d6-b94b-bd5a933c2481 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:42.185106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5663e2e9-22ed-402a-ab4f-82268cc4b132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:42.185881 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663e2e9-22ed-402a-ab4f-82268cc4b132 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:42.186198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663e2e9-22ed-402a-ab4f-82268cc4b132 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:42.186444 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5663e2e9-22ed-402a-ab4f-82268cc4b132 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:42.187164 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5663e2e9-22ed-402a-ab4f-82268cc4b132 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:42.187470 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5663e2e9-22ed-402a-ab4f-82268cc4b132 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:42.188921 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5663e2e9-22ed-402a-ab4f-82268cc4b132 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:42.206695 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 625/1240] 10.222.0.81 () {56 vars in 1143 bytes} [Tue Sep 6 21:06:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:06:42.213503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcca277-03fd-497d-9fb6-4c6de51ce113 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:42.316075 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcca277-03fd-497d-9fb6-4c6de51ce113 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:42.348881 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3c795-2391-4e53-8f9e-b733df654ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:42.349487 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3c795-2391-4e53-8f9e-b733df654ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:42.349793 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3c795-2391-4e53-8f9e-b733df654ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:42.350062 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a3c795-2391-4e53-8f9e-b733df654ed9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:42.408997 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:42.415490 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3c795-2391-4e53-8f9e-b733df654ed9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:42.417622 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a3c795-2391-4e53-8f9e-b733df654ed9 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:42.514158 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 616/1241] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:06:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 21:06:42.520134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5663e2e9-22ed-402a-ab4f-82268cc4b132 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:42.547888 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:42.622248 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5663e2e9-22ed-402a-ab4f-82268cc4b132 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:42.655985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84356ef-1556-418b-bbe6-c50d084c5d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:42.656676 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84356ef-1556-418b-bbe6-c50d084c5d66 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:42.656967 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84356ef-1556-418b-bbe6-c50d084c5d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:42.657250 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84356ef-1556-418b-bbe6-c50d084c5d66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:42.671127 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84356ef-1556-418b-bbe6-c50d084c5d66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:42.671127 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84356ef-1556-418b-bbe6-c50d084c5d66 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:42.685985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-f84356ef-1556-418b-bbe6-c50d084c5d66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:06:42.685985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:06:42.685985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:06:42.685985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:06:42.685985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:06:42.685985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:06:42.685985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:06:42.685985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:06:42.685985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:06:42.685985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:06:42.685985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:06:42.685985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:06:42.685985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:06:42.685985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:06:42.685985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:06:42.685985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:06:42.686987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:06:42.686987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:06:42.686987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:06:42.686987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:06:42.686987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:06:42.686987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:06:42.686987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:06:42.686987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:06:42.686987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:06:42.686987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:06:42.686987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:06:42.686987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:06:42.686987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:06:42.686987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:06:42.686987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:06:42.686987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:06:42.686987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:06:42.688064 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:06:42.688064 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:06:42.688064 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:06:42.688064 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 626/1242] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:06:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:06:42.692963 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3c795-2391-4e53-8f9e-b733df654ed9 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:42.787351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:42.794256 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a3c795-2391-4e53-8f9e-b733df654ed9 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:42.827135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b1f9e-65a3-48e4-b6c7-40716113635a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:42.827749 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b1f9e-65a3-48e4-b6c7-40716113635a None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:42.828025 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b1f9e-65a3-48e4-b6c7-40716113635a None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:42.828328 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b1f9e-65a3-48e4-b6c7-40716113635a None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:42.828962 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b1f9e-65a3-48e4-b6c7-40716113635a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:42.829263 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b1f9e-65a3-48e4-b6c7-40716113635a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:42.830609 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b1f9e-65a3-48e4-b6c7-40716113635a None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:42.841952 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 617/1243] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:06:42.847756 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84356ef-1556-418b-bbe6-c50d084c5d66 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:42.925217 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:42.945448 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84356ef-1556-418b-bbe6-c50d084c5d66 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:42.979420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13dc69-0d33-4960-be00-42f616ef4055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:42.980112 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13dc69-0d33-4960-be00-42f616ef4055 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:42.980433 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13dc69-0d33-4960-be00-42f616ef4055 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:42.980714 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13dc69-0d33-4960-be00-42f616ef4055 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:42.987325 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13dc69-0d33-4960-be00-42f616ef4055 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:42.988825 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13dc69-0d33-4960-be00-42f616ef4055 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:42.999788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-4b13dc69-0d33-4960-be00-42f616ef4055 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:06:42.999788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:06:42.999788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:06:42.999788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:06:42.999788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:06:42.999788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:06:42.999788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:06:42.999788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:06:42.999788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:06:42.999788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:06:42.999788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:06:42.999788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:06:42.999788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:06:42.999788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:06:42.999788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:06:43.004205 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:06:43.004205 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:06:43.004205 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:06:43.004205 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:06:43.004205 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:06:43.004205 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:06:43.004205 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:06:43.004205 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:06:43.004205 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:06:43.004205 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:06:43.004205 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:06:43.004205 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:06:43.004205 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:06:43.004205 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:06:43.004205 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:06:43.004205 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:06:43.004205 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:06:43.005196 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:06:43.005196 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:06:43.005196 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:06:43.005196 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:06:43.005196 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:06:43.005196 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:06:43.005196 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:06:43.005196 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:06:43.005196 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 627/1244] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:06:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:06:43.006862 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b1f9e-65a3-48e4-b6c7-40716113635a None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:43.108306 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b1f9e-65a3-48e4-b6c7-40716113635a None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:43.141833 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a60579-de3e-4f26-803d-5184a19018f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:43.142436 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a60579-de3e-4f26-803d-5184a19018f3 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:43.142720 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a60579-de3e-4f26-803d-5184a19018f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:43.142997 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a60579-de3e-4f26-803d-5184a19018f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:43.143688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a60579-de3e-4f26-803d-5184a19018f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:43.143997 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a60579-de3e-4f26-803d-5184a19018f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:43.145455 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a60579-de3e-4f26-803d-5184a19018f3 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:43.158140 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 618/1245] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:06:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:06:43.164796 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13dc69-0d33-4960-be00-42f616ef4055 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:43.270746 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13dc69-0d33-4960-be00-42f616ef4055 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:43.304420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1a0404-1bae-430d-84ab-d24eb2130d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:43.305010 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a0404-1bae-430d-84ab-d24eb2130d6d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:43.305306 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a0404-1bae-430d-84ab-d24eb2130d6d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:43.305573 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1a0404-1bae-430d-84ab-d24eb2130d6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:43.306352 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a0404-1bae-430d-84ab-d24eb2130d6d None admin] RBAC: Adding query filter params (role.id=747c70d4cefb4a82816c17da1259b90f, scope.project.id=002e09339d4e49ce98434571d3b64248, user.id=c3295306746f4552837f1bb12b2c500f) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:43.306653 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a0404-1bae-430d-84ab-d24eb2130d6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:43.308078 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1a0404-1bae-430d-84ab-d24eb2130d6d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:43.313822 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 628/1246] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:06:43 2022] GET /identity/v3/role_assignments?user.id=c3295306746f4552837f1bb12b2c500f&scope.project.id=002e09339d4e49ce98434571d3b64248&role.id=747c70d4cefb4a82816c17da1259b90f => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:06:45.520005 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9813d0e-1795-4ccf-b945-7e039d0aabd7 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:45.520536 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9813d0e-1795-4ccf-b945-7e039d0aabd7 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:45.520536 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9813d0e-1795-4ccf-b945-7e039d0aabd7 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:45.521909 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 619/1247] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:06:45.527475 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2c191-8c6a-49d8-91f9-39b562b0985d None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:45.538962 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2c191-8c6a-49d8-91f9-39b562b0985d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:45.538962 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c2c191-8c6a-49d8-91f9-39b562b0985d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:45.538962 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:45.547249 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-a2c2c191-8c6a-49d8-91f9-39b562b0985d None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:06:45.548460 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a2c2c191-8c6a-49d8-91f9-39b562b0985d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:06:45.615599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 629/1248] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:06:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:06:45.891110 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9813d0e-1795-4ccf-b945-7e039d0aabd7 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:45.909280 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:45.992109 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9813d0e-1795-4ccf-b945-7e039d0aabd7 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:46.026180 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d042de8-cb06-4a52-8d74-ea14dc9fd39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:46.026887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d042de8-cb06-4a52-8d74-ea14dc9fd39e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:46.027169 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d042de8-cb06-4a52-8d74-ea14dc9fd39e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:46.027444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d042de8-cb06-4a52-8d74-ea14dc9fd39e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:46.037305 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d042de8-cb06-4a52-8d74-ea14dc9fd39e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:06:46.042443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-2d042de8-cb06-4a52-8d74-ea14dc9fd39e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:06:46.042443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:06:46.042443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:06:46.042443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:06:46.042443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:06:46.042443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:06:46.042443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:06:46.042443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:06:46.042443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:06:46.042443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:06:46.042443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:06:46.042443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:06:46.042443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:06:46.042443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:06:46.042443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:06:46.042443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:06:46.043521 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:06:46.043521 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:06:46.043521 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:06:46.043521 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:06:46.043521 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:06:46.043521 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:06:46.043521 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:06:46.043521 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:06:46.043521 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:06:46.043521 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:06:46.043521 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:06:46.043521 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:06:46.043521 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:06:46.043521 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:06:46.043521 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:06:46.043521 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:06:46.044558 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:06:46.044558 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:06:46.044558 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:06:46.044558 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:06:46.044558 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:06:46.044558 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:06:46.044558 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:06:46.044558 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:06:46.044558 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:06:46.044558 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:06:46.044558 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:06:46.044558 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:06:46.044558 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 620/1249] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:06:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:06:46.049637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2c191-8c6a-49d8-91f9-39b562b0985d None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:46.147410 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c2c191-8c6a-49d8-91f9-39b562b0985d None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:46.176679 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:46.181641 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85d7be-f2ec-45ce-aafd-9a6c81caedd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:46.183203 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85d7be-f2ec-45ce-aafd-9a6c81caedd3 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:46.183203 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85d7be-f2ec-45ce-aafd-9a6c81caedd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:46.183203 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85d7be-f2ec-45ce-aafd-9a6c81caedd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:46.183559 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85d7be-f2ec-45ce-aafd-9a6c81caedd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:46.183858 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85d7be-f2ec-45ce-aafd-9a6c81caedd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:46.185256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85d7be-f2ec-45ce-aafd-9a6c81caedd3 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:46.193210 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 630/1250] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:06:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:06:46.199745 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d042de8-cb06-4a52-8d74-ea14dc9fd39e None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:46.277035 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:46.300250 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d042de8-cb06-4a52-8d74-ea14dc9fd39e None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:46.333464 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f962c0-1d1b-417a-be33-0746326b3bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:46.334115 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f962c0-1d1b-417a-be33-0746326b3bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:46.334401 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f962c0-1d1b-417a-be33-0746326b3bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:46.334680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f962c0-1d1b-417a-be33-0746326b3bd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:46.345022 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f962c0-1d1b-417a-be33-0746326b3bd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:46.346483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f962c0-1d1b-417a-be33-0746326b3bd5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:46.361588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-57f962c0-1d1b-417a-be33-0746326b3bd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:06:46.361588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:06:46.361588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:06:46.361588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:06:46.361588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:06:46.361588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:06:46.361588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:06:46.361588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:06:46.361588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:06:46.361588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:06:46.361588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:06:46.361588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:06:46.361588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:06:46.361588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:06:46.361588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:06:46.361588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:06:46.362687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:06:46.362687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:06:46.362687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:06:46.362687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:06:46.362687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:06:46.362687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:06:46.362687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:06:46.362687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:06:46.362687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:06:46.362687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:06:46.362687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:06:46.362687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:06:46.362687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:06:46.362687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:06:46.362687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:06:46.362687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:06:46.362687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:06:46.363674 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:06:46.363674 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:06:46.363674 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:06:46.363674 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 621/1251] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:06:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:06:46.369378 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85d7be-f2ec-45ce-aafd-9a6c81caedd3 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:46.470571 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85d7be-f2ec-45ce-aafd-9a6c81caedd3 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:46.503335 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5efff-2a8a-463d-90a1-b169a20b0772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:46.503948 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5efff-2a8a-463d-90a1-b169a20b0772 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:46.504254 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5efff-2a8a-463d-90a1-b169a20b0772 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:46.504530 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de5efff-2a8a-463d-90a1-b169a20b0772 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:46.505221 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5efff-2a8a-463d-90a1-b169a20b0772 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:46.505526 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5efff-2a8a-463d-90a1-b169a20b0772 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:46.506894 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de5efff-2a8a-463d-90a1-b169a20b0772 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:46.518913 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 631/1252] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:06:46.524799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f962c0-1d1b-417a-be33-0746326b3bd5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:46.623312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f962c0-1d1b-417a-be33-0746326b3bd5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:46.648895 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:46.656624 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad6396-8c40-417e-94a3-5a608828ffec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:46.657247 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad6396-8c40-417e-94a3-5a608828ffec None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:46.657524 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad6396-8c40-417e-94a3-5a608828ffec None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:46.657798 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dad6396-8c40-417e-94a3-5a608828ffec None admin] PATH_INFO: `/v3/users/placement` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:46.665218 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad6396-8c40-417e-94a3-5a608828ffec None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:46.666652 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dad6396-8c40-417e-94a3-5a608828ffec None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:46.677376 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-6dad6396-8c40-417e-94a3-5a608828ffec None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 21:06:46.677376 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:06:46.677376 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:06:46.677376 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:06:46.677376 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:06:46.677376 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:06:46.677376 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:06:46.677376 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:06:46.677376 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:06:46.677376 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:06:46.677376 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:06:46.677376 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:06:46.677376 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:06:46.677376 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:06:46.677376 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:06:46.677376 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:06:46.678503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:06:46.678503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:06:46.678503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:06:46.678503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:06:46.678503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:06:46.678503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:06:46.678503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:06:46.678503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:06:46.678503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:06:46.678503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:06:46.678503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:06:46.678503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:06:46.678503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:06:46.678503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:06:46.678503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:06:46.678503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:06:46.678503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:06:46.678503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:06:46.679483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:06:46.679483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:06:46.679483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:06:46.679483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:06:46.679483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:06:46.679483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:06:46.679483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:06:46.679483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:06:46.679483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 21:06:46.679483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:06:46.679483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 622/1253] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:06:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:06:46.686018 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5efff-2a8a-463d-90a1-b169a20b0772 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:46.741713 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:46.784833 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de5efff-2a8a-463d-90a1-b169a20b0772 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:46.817939 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31774db6-d3dc-40b5-99d2-8836c80b973f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:46.818530 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31774db6-d3dc-40b5-99d2-8836c80b973f None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:46.818807 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31774db6-d3dc-40b5-99d2-8836c80b973f None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:46.819076 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31774db6-d3dc-40b5-99d2-8836c80b973f None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:46.819804 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31774db6-d3dc-40b5-99d2-8836c80b973f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:46.820213 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31774db6-d3dc-40b5-99d2-8836c80b973f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:46.824611 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31774db6-d3dc-40b5-99d2-8836c80b973f None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:46.839149 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 632/1254] 10.222.0.81 () {56 vars in 1143 bytes} [Tue Sep 6 21:06:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:06:46.845119 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad6396-8c40-417e-94a3-5a608828ffec None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:46.946760 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dad6396-8c40-417e-94a3-5a608828ffec None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:46.979371 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77aadc-04c6-4175-bdb9-a81c90e661cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:46.979982 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77aadc-04c6-4175-bdb9-a81c90e661cb None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:46.980372 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77aadc-04c6-4175-bdb9-a81c90e661cb None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:46.980724 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77aadc-04c6-4175-bdb9-a81c90e661cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:47.035251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:47.047678 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77aadc-04c6-4175-bdb9-a81c90e661cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:47.049144 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77aadc-04c6-4175-bdb9-a81c90e661cb None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:47.147157 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 623/1255] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:06:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 06 21:06:47.153598 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31774db6-d3dc-40b5-99d2-8836c80b973f None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:47.251943 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31774db6-d3dc-40b5-99d2-8836c80b973f None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:47.266692 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:47.288574 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95fdda-bd05-450d-9ff7-113762d229b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:47.289394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95fdda-bd05-450d-9ff7-113762d229b6 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:47.289668 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95fdda-bd05-450d-9ff7-113762d229b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:47.289940 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95fdda-bd05-450d-9ff7-113762d229b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:47.300224 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95fdda-bd05-450d-9ff7-113762d229b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:47.301710 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95fdda-bd05-450d-9ff7-113762d229b6 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:47.315985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-9e95fdda-bd05-450d-9ff7-113762d229b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:06:47.315985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:06:47.315985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:06:47.315985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:06:47.315985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:06:47.315985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:06:47.315985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:06:47.315985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:06:47.315985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:06:47.315985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:06:47.315985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:06:47.315985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:06:47.315985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:06:47.315985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:06:47.315985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:06:47.315985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:06:47.317209 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:06:47.317209 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:06:47.317209 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:06:47.317209 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:06:47.317209 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:06:47.317209 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:06:47.317209 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:06:47.317209 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:06:47.317209 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:06:47.317209 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:06:47.317209 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:06:47.317209 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:06:47.317209 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:06:47.317209 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:06:47.317209 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:06:47.317209 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:06:47.317209 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:06:47.318496 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:06:47.318496 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:06:47.318496 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:06:47.318496 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 633/1256] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:06:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:06:47.322835 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77aadc-04c6-4175-bdb9-a81c90e661cb None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:47.410128 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:47.422655 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77aadc-04c6-4175-bdb9-a81c90e661cb None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:47.459223 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba914310-5a9f-42d1-99fa-0216bdee8f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:47.459826 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba914310-5a9f-42d1-99fa-0216bdee8f10 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:47.460134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba914310-5a9f-42d1-99fa-0216bdee8f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:47.460404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba914310-5a9f-42d1-99fa-0216bdee8f10 None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:47.461040 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba914310-5a9f-42d1-99fa-0216bdee8f10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:47.461343 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba914310-5a9f-42d1-99fa-0216bdee8f10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:47.463344 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba914310-5a9f-42d1-99fa-0216bdee8f10 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:47.474211 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 624/1257] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:06:47.480076 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95fdda-bd05-450d-9ff7-113762d229b6 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:47.582005 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95fdda-bd05-450d-9ff7-113762d229b6 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:47.614852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705a5e8-e6a5-40eb-8e5b-983af72ea06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:47.615471 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705a5e8-e6a5-40eb-8e5b-983af72ea06a None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:47.615749 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705a5e8-e6a5-40eb-8e5b-983af72ea06a None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:47.616020 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705a5e8-e6a5-40eb-8e5b-983af72ea06a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:47.622705 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705a5e8-e6a5-40eb-8e5b-983af72ea06a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:47.624336 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705a5e8-e6a5-40eb-8e5b-983af72ea06a None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:47.635896 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-7705a5e8-e6a5-40eb-8e5b-983af72ea06a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:06:47.635896 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:06:47.635896 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:06:47.635896 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:06:47.635896 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:06:47.635896 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:06:47.635896 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:06:47.635896 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:06:47.635896 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:06:47.635896 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:06:47.635896 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:06:47.635896 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:06:47.635896 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:06:47.635896 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:06:47.635896 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:06:47.637256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:06:47.637256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:06:47.637256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:06:47.637256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:06:47.637256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:06:47.637256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:06:47.637256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:06:47.637256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:06:47.637256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:06:47.637256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:06:47.637256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:06:47.637256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:06:47.637256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:06:47.637256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:06:47.637256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:06:47.637256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:06:47.637256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:06:47.638182 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:06:47.638182 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:06:47.638182 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:06:47.638182 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:06:47.638182 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:06:47.638182 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:06:47.638182 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:06:47.638182 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:06:47.638182 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 634/1258] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:06:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:06:47.643109 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba914310-5a9f-42d1-99fa-0216bdee8f10 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:47.742762 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba914310-5a9f-42d1-99fa-0216bdee8f10 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:47.776012 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf62db-688c-4d5c-b58f-52ab1104d92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:47.776657 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf62db-688c-4d5c-b58f-52ab1104d92e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:47.776939 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf62db-688c-4d5c-b58f-52ab1104d92e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:47.777236 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf62db-688c-4d5c-b58f-52ab1104d92e None admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:47.777926 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf62db-688c-4d5c-b58f-52ab1104d92e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:47.778230 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf62db-688c-4d5c-b58f-52ab1104d92e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:47.779651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf62db-688c-4d5c-b58f-52ab1104d92e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:47.791904 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 625/1259] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:06:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:06:47.798201 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705a5e8-e6a5-40eb-8e5b-983af72ea06a None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:47.824150 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:47.896565 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705a5e8-e6a5-40eb-8e5b-983af72ea06a None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:47.929513 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce41c98-6cbd-4920-a4bc-fbe8bef5c038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:47.930109 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce41c98-6cbd-4920-a4bc-fbe8bef5c038 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:47.930387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce41c98-6cbd-4920-a4bc-fbe8bef5c038 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:47.930749 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce41c98-6cbd-4920-a4bc-fbe8bef5c038 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:47.931965 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce41c98-6cbd-4920-a4bc-fbe8bef5c038 None admin] RBAC: Adding query filter params (role.id=fe9661f095094dd0931e0b96a1d6ef74, scope.project.id=002e09339d4e49ce98434571d3b64248, user.id=c3295306746f4552837f1bb12b2c500f) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:47.932316 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce41c98-6cbd-4920-a4bc-fbe8bef5c038 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:47.933732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce41c98-6cbd-4920-a4bc-fbe8bef5c038 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:47.939841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 635/1260] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:06:47 2022] GET /identity/v3/role_assignments?user.id=c3295306746f4552837f1bb12b2c500f&scope.project.id=002e09339d4e49ce98434571d3b64248&role.id=fe9661f095094dd0931e0b96a1d6ef74 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:06:50.059106 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0319d90-a54f-45f5-82b6-4c61a9272381 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:50.059797 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0319d90-a54f-45f5-82b6-4c61a9272381 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:50.059797 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0319d90-a54f-45f5-82b6-4c61a9272381 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:50.061006 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 626/1261] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:06:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:06:50.066160 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207bd61-f417-4e24-8295-62f2a8f69252 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:50.066612 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207bd61-f417-4e24-8295-62f2a8f69252 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:50.066761 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207bd61-f417-4e24-8295-62f2a8f69252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:50.085013 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c207bd61-f417-4e24-8295-62f2a8f69252 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:06:50.086198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c207bd61-f417-4e24-8295-62f2a8f69252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:06:50.153855 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 636/1262] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:06:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:06:50.421484 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0319d90-a54f-45f5-82b6-4c61a9272381 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:50.432277 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:50.520352 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0319d90-a54f-45f5-82b6-4c61a9272381 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:50.553246 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026a0c9-b14b-48aa-a230-8489ff992fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:50.553865 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026a0c9-b14b-48aa-a230-8489ff992fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:50.554145 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026a0c9-b14b-48aa-a230-8489ff992fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:50.554417 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026a0c9-b14b-48aa-a230-8489ff992fb5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:50.564155 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026a0c9-b14b-48aa-a230-8489ff992fb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:06:50.568904 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-2026a0c9-b14b-48aa-a230-8489ff992fb5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:06:50.568904 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:06:50.568904 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:06:50.568904 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:06:50.568904 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:06:50.568904 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:06:50.568904 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:06:50.568904 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:06:50.568904 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:06:50.568904 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:06:50.568904 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:06:50.568904 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:06:50.568904 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:06:50.568904 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:06:50.568904 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:06:50.568904 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:06:50.570097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:06:50.570097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:06:50.570097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:06:50.570097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:06:50.570097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:06:50.570097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:06:50.570097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:06:50.570097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:06:50.570097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:06:50.570097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:06:50.570097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:06:50.570097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:06:50.570097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:06:50.570097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:06:50.570097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:06:50.570097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:06:50.571220 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:06:50.571220 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:06:50.571220 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:06:50.571220 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:06:50.571220 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:06:50.571220 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:06:50.571220 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:06:50.571220 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:06:50.571220 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:06:50.571220 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:06:50.571220 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:06:50.571220 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:06:50.571220 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 627/1263] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:06:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:06:50.576738 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207bd61-f417-4e24-8295-62f2a8f69252 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:50.595336 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:50.686419 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207bd61-f417-4e24-8295-62f2a8f69252 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:50.721604 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a068b-62e2-4a90-9ffb-16f90bd45d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:50.722214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a068b-62e2-4a90-9ffb-16f90bd45d5e None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:50.722544 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a068b-62e2-4a90-9ffb-16f90bd45d5e None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:50.722759 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a068b-62e2-4a90-9ffb-16f90bd45d5e None admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:50.723410 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a068b-62e2-4a90-9ffb-16f90bd45d5e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:50.723711 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a068b-62e2-4a90-9ffb-16f90bd45d5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:50.725177 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566a068b-62e2-4a90-9ffb-16f90bd45d5e None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:50.733182 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 637/1264] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:06:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:06:50.738942 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026a0c9-b14b-48aa-a230-8489ff992fb5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:50.805529 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:50.837417 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026a0c9-b14b-48aa-a230-8489ff992fb5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:50.872068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcba15e-9950-4c39-b585-d69a47521f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:50.872724 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcba15e-9950-4c39-b585-d69a47521f70 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:50.873010 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcba15e-9950-4c39-b585-d69a47521f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:50.873288 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcba15e-9950-4c39-b585-d69a47521f70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:50.883230 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcba15e-9950-4c39-b585-d69a47521f70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:50.891527 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcba15e-9950-4c39-b585-d69a47521f70 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:50.900388 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-afcba15e-9950-4c39-b585-d69a47521f70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:06:50.900388 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:06:50.900388 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:06:50.900388 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:06:50.900388 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:06:50.900388 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:06:50.900388 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:06:50.900388 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:06:50.900388 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:06:50.900388 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:06:50.900388 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:06:50.900388 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:06:50.900388 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:06:50.900388 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:06:50.900388 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:06:50.900388 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:06:50.901559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:06:50.901559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:06:50.901559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:06:50.901559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:06:50.901559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:06:50.901559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:06:50.901559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:06:50.901559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:06:50.901559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:06:50.901559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:06:50.901559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:06:50.901559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:06:50.901559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:06:50.901559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:06:50.901559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:06:50.901559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:06:50.901559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:06:50.902469 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:06:50.902469 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:06:50.902469 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:06:50.902469 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 628/1265] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:06:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:06:50.907354 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a068b-62e2-4a90-9ffb-16f90bd45d5e None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:50.990009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:51.009125 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566a068b-62e2-4a90-9ffb-16f90bd45d5e None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:51.041707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe59394-b677-49fd-a2b7-6ba032f37144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:51.042304 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe59394-b677-49fd-a2b7-6ba032f37144 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:51.042612 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe59394-b677-49fd-a2b7-6ba032f37144 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:51.042898 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe59394-b677-49fd-a2b7-6ba032f37144 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:51.043527 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe59394-b677-49fd-a2b7-6ba032f37144 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:51.043825 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe59394-b677-49fd-a2b7-6ba032f37144 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:51.045233 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe59394-b677-49fd-a2b7-6ba032f37144 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:51.055819 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 638/1266] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:06:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:06:51.062199 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcba15e-9950-4c39-b585-d69a47521f70 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:51.160735 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcba15e-9950-4c39-b585-d69a47521f70 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:51.179939 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:51.193996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180c0d6-e900-4b47-947f-9ee147ba1e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:51.194623 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180c0d6-e900-4b47-947f-9ee147ba1e17 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:51.194905 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180c0d6-e900-4b47-947f-9ee147ba1e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:51.195182 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9180c0d6-e900-4b47-947f-9ee147ba1e17 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:51.203083 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180c0d6-e900-4b47-947f-9ee147ba1e17 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:51.213668 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9180c0d6-e900-4b47-947f-9ee147ba1e17 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:51.215471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-9180c0d6-e900-4b47-947f-9ee147ba1e17 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 21:06:51.215471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:06:51.215471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:06:51.215471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:06:51.215471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:06:51.215471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:06:51.215471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:06:51.215471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:06:51.215471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:06:51.215471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:06:51.215471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:06:51.215471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:06:51.215471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:06:51.215471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:06:51.215471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:06:51.215471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:06:51.216482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:06:51.216482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:06:51.216482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:06:51.216482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:06:51.216482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:06:51.216482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:06:51.216482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:06:51.216482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:06:51.216482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:06:51.216482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:06:51.216482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:06:51.216482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:06:51.216482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:06:51.216482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:06:51.216482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:06:51.216482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:06:51.216482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:06:51.216482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:06:51.217862 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:06:51.217862 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:06:51.217862 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:06:51.217862 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:06:51.217862 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:06:51.217862 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:06:51.217862 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:06:51.217862 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:06:51.217862 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 21:06:51.217862 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:06:51.217862 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 629/1267] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:06:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:06:51.222489 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe59394-b677-49fd-a2b7-6ba032f37144 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:51.321343 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe59394-b677-49fd-a2b7-6ba032f37144 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:51.354214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bb407-2f80-4e0a-ab37-039b69f5a141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:51.354850 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bb407-2f80-4e0a-ab37-039b69f5a141 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:51.355130 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bb407-2f80-4e0a-ab37-039b69f5a141 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:51.355438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bb407-2f80-4e0a-ab37-039b69f5a141 None admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:51.356146 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4bb407-2f80-4e0a-ab37-039b69f5a141 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:51.356456 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4bb407-2f80-4e0a-ab37-039b69f5a141 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:51.357877 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4bb407-2f80-4e0a-ab37-039b69f5a141 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:51.366887 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:51.375222 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 639/1268] 10.222.0.81 () {56 vars in 1143 bytes} [Tue Sep 6 21:06:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:06:51.381172 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180c0d6-e900-4b47-947f-9ee147ba1e17 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:51.480910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9180c0d6-e900-4b47-947f-9ee147ba1e17 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:51.514255 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c562768-c702-4868-a06b-5a77c83175f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:51.514886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c562768-c702-4868-a06b-5a77c83175f8 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:51.515169 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c562768-c702-4868-a06b-5a77c83175f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:51.515443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c562768-c702-4868-a06b-5a77c83175f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:51.526966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c562768-c702-4868-a06b-5a77c83175f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:51.528365 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c562768-c702-4868-a06b-5a77c83175f8 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:51.543066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-9c562768-c702-4868-a06b-5a77c83175f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:06:51.543066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:06:51.543066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:06:51.543066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:06:51.543066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:06:51.543066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:06:51.543066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:06:51.543066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:06:51.543066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:06:51.543066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:06:51.543066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:06:51.543066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:06:51.543066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:06:51.543066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:06:51.543066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:06:51.543066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:06:51.544226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:06:51.544226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:06:51.544226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:06:51.544226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:06:51.544226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:06:51.544226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:06:51.544226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:06:51.544226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:06:51.544226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:06:51.544226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:06:51.544226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:06:51.544226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:06:51.544226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:06:51.544226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:06:51.544226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:06:51.544226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:06:51.544226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:06:51.545526 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:06:51.545526 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:06:51.545526 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:06:51.545526 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 630/1269] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:06:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:06:51.550236 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bb407-2f80-4e0a-ab37-039b69f5a141 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:51.647310 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bb407-2f80-4e0a-ab37-039b69f5a141 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:51.681568 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060c02c-3065-4013-87bc-349616f7d664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:51.682176 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060c02c-3065-4013-87bc-349616f7d664 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:51.682455 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060c02c-3065-4013-87bc-349616f7d664 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:51.682780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060c02c-3065-4013-87bc-349616f7d664 None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:51.683368 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060c02c-3065-4013-87bc-349616f7d664 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:51.683662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060c02c-3065-4013-87bc-349616f7d664 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:51.685063 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060c02c-3065-4013-87bc-349616f7d664 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:51.696176 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 640/1270] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:06:51.702147 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c562768-c702-4868-a06b-5a77c83175f8 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:51.735308 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:51.804740 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c562768-c702-4868-a06b-5a77c83175f8 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:51.838164 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc47191-ec6e-482d-a980-02b82f6ed914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:51.838786 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc47191-ec6e-482d-a980-02b82f6ed914 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:51.839067 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc47191-ec6e-482d-a980-02b82f6ed914 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:51.839384 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc47191-ec6e-482d-a980-02b82f6ed914 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:51.845869 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc47191-ec6e-482d-a980-02b82f6ed914 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:51.847298 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc47191-ec6e-482d-a980-02b82f6ed914 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:51.858849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-3bc47191-ec6e-482d-a980-02b82f6ed914 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:06:51.858849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:06:51.858849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:06:51.858849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:06:51.858849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:06:51.858849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:06:51.858849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:06:51.858849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:06:51.858849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:06:51.858849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:06:51.858849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:06:51.858849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:06:51.858849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:06:51.858849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:06:51.858849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:06:51.859954 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:06:51.859954 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:06:51.859954 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:06:51.859954 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:06:51.859954 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:06:51.859954 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:06:51.859954 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:06:51.859954 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:06:51.859954 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:06:51.859954 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:06:51.859954 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:06:51.859954 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:06:51.859954 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:06:51.859954 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:06:51.859954 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:06:51.859954 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:06:51.859954 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:06:51.861097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:06:51.861097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:06:51.861097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:06:51.861097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:06:51.861097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:06:51.861097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:06:51.861097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:06:51.861097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:06:51.861097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 631/1271] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:06:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 06 21:06:51.865869 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060c02c-3065-4013-87bc-349616f7d664 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:51.924267 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:51.965948 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060c02c-3065-4013-87bc-349616f7d664 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:52.003171 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f76d00-7489-46e2-8c47-38f0fa2ebba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:52.003781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f76d00-7489-46e2-8c47-38f0fa2ebba1 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:52.004063 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f76d00-7489-46e2-8c47-38f0fa2ebba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:52.004372 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f76d00-7489-46e2-8c47-38f0fa2ebba1 None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:52.005053 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f76d00-7489-46e2-8c47-38f0fa2ebba1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:52.005360 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f76d00-7489-46e2-8c47-38f0fa2ebba1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:52.006791 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f76d00-7489-46e2-8c47-38f0fa2ebba1 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:52.018994 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 641/1272] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:06:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:06:52.025631 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc47191-ec6e-482d-a980-02b82f6ed914 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:52.121072 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:52.129759 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc47191-ec6e-482d-a980-02b82f6ed914 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:52.164962 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59b5c1-0bef-4b55-a50c-724a7dc8b85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:52.165684 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59b5c1-0bef-4b55-a50c-724a7dc8b85c None admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:52.165964 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59b5c1-0bef-4b55-a50c-724a7dc8b85c None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:52.166313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59b5c1-0bef-4b55-a50c-724a7dc8b85c None admin] PATH_INFO: `/v3/projects/002e09339d4e49ce98434571d3b64248/users/c3295306746f4552837f1bb12b2c500f/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:52.168446 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a59b5c1-0bef-4b55-a50c-724a7dc8b85c None admin] RBAC: Authorizing `identity:create_grant(project_id=002e09339d4e49ce98434571d3b64248, user_id=c3295306746f4552837f1bb12b2c500f, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:52.169875 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a59b5c1-0bef-4b55-a50c-724a7dc8b85c None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:52.279535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 632/1273] 10.222.0.81 () {58 vars in 1439 bytes} [Tue Sep 6 21:06:52 2022] PUT /identity/v3/projects/002e09339d4e49ce98434571d3b64248/users/c3295306746f4552837f1bb12b2c500f/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:06:54.445487 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b5298-6475-4f5c-82ce-672043ca34cf None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:54.446080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b5298-6475-4f5c-82ce-672043ca34cf None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:54.446080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b5298-6475-4f5c-82ce-672043ca34cf None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:54.447864 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 642/1274] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:06:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:06:54.453407 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc671f-7c9a-4c75-b52e-61c289434fae None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:54.459164 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc671f-7c9a-4c75-b52e-61c289434fae None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:54.459164 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc671f-7c9a-4c75-b52e-61c289434fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:54.472299 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-71bc671f-7c9a-4c75-b52e-61c289434fae None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:06:54.473478 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-71bc671f-7c9a-4c75-b52e-61c289434fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:06:54.541416 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 633/1275] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:06:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:06:54.815065 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b5298-6475-4f5c-82ce-672043ca34cf None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:54.919324 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b5298-6475-4f5c-82ce-672043ca34cf None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:54.938294 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:54.955349 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf91df-2daa-4e11-b3a1-e09263b43d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:54.955979 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf91df-2daa-4e11-b3a1-e09263b43d63 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:54.956308 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf91df-2daa-4e11-b3a1-e09263b43d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:54.956570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf91df-2daa-4e11-b3a1-e09263b43d63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:54.966491 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf91df-2daa-4e11-b3a1-e09263b43d63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 06 21:06:54.971346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-18bf91df-2daa-4e11-b3a1-e09263b43d63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:06:54.971346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:06:54.971346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:06:54.971346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:06:54.971346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:06:54.971346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:06:54.971346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:06:54.971346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:06:54.971346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:06:54.971346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:06:54.971346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:06:54.971346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:06:54.971346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 06 21:06:54.971346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 06 21:06:54.971346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 06 21:06:54.971346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 06 21:06:54.972534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 06 21:06:54.972534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 06 21:06:54.972534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 06 21:06:54.972534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 06 21:06:54.972534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:06:54.972534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:06:54.972534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:06:54.972534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:06:54.972534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:06:54.972534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:06:54.972534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:06:54.972534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:06:54.972534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:06:54.972534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:06:54.972534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:06:54.972534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:06:54.973417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:06:54.973417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:06:54.973417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:06:54.973417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:06:54.973417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 06 21:06:54.973417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 06 21:06:54.973417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 06 21:06:54.973417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 06 21:06:54.973417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 06 21:06:54.973417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 06 21:06:54.973417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 06 21:06:54.973417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:06:54.973417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 643/1276] 10.222.0.81 () {56 vars in 1096 bytes} [Tue Sep 6 21:06:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:06:54.979053 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc671f-7c9a-4c75-b52e-61c289434fae None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:55.061077 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:55.078958 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc671f-7c9a-4c75-b52e-61c289434fae None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:55.112445 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87704b-8223-4375-85a3-cfc66dc97d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:55.113056 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87704b-8223-4375-85a3-cfc66dc97d1b None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:55.113336 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87704b-8223-4375-85a3-cfc66dc97d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:55.113609 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd87704b-8223-4375-85a3-cfc66dc97d1b None admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:55.114275 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87704b-8223-4375-85a3-cfc66dc97d1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:55.114581 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87704b-8223-4375-85a3-cfc66dc97d1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:55.115939 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd87704b-8223-4375-85a3-cfc66dc97d1b None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:55.126851 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 634/1277] 10.222.0.81 () {56 vars in 1099 bytes} [Tue Sep 6 21:06:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:06:55.131173 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf91df-2daa-4e11-b3a1-e09263b43d63 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:55.229675 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf91df-2daa-4e11-b3a1-e09263b43d63 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:55.263164 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f290c-1691-460b-88eb-9b1426dc3ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:55.267545 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f290c-1691-460b-88eb-9b1426dc3ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:55.267545 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f290c-1691-460b-88eb-9b1426dc3ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:55.267545 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f290c-1691-460b-88eb-9b1426dc3ce9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:55.277078 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f290c-1691-460b-88eb-9b1426dc3ce9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:55.278556 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f290c-1691-460b-88eb-9b1426dc3ce9 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:55.293816 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-185f290c-1691-460b-88eb-9b1426dc3ce9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:06:55.293816 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:06:55.293816 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:06:55.293816 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:06:55.293816 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:06:55.293816 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:06:55.293816 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:06:55.293816 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:06:55.293816 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:06:55.293816 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:06:55.293816 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:06:55.293816 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:06:55.293816 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:06:55.293816 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:06:55.293816 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:06:55.293816 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:06:55.295548 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:06:55.295548 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:06:55.295548 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:06:55.295548 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:06:55.295548 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:06:55.295548 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:06:55.295548 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:06:55.295548 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:06:55.295548 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:06:55.295548 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:06:55.295548 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:06:55.295548 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:06:55.295548 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:06:55.295548 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:06:55.295548 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:06:55.295548 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:06:55.295548 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:06:55.296700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:06:55.296700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:06:55.296700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:06:55.296700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 644/1278] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:06:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:06:55.300982 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87704b-8223-4375-85a3-cfc66dc97d1b None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:55.406986 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd87704b-8223-4375-85a3-cfc66dc97d1b None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:55.440676 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24717b74-e527-4420-b2bb-ebcc52ac5d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:55.441281 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24717b74-e527-4420-b2bb-ebcc52ac5d1f None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:55.441685 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24717b74-e527-4420-b2bb-ebcc52ac5d1f None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:55.441965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24717b74-e527-4420-b2bb-ebcc52ac5d1f None admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:55.442605 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24717b74-e527-4420-b2bb-ebcc52ac5d1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:55.442910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24717b74-e527-4420-b2bb-ebcc52ac5d1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:55.444289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24717b74-e527-4420-b2bb-ebcc52ac5d1f None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:55.455684 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 635/1279] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:06:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:06:55.461516 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f290c-1691-460b-88eb-9b1426dc3ce9 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:55.492710 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:55.561004 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f290c-1691-460b-88eb-9b1426dc3ce9 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:55.596254 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb583e-548b-44a4-af55-661ba3441ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:55.596871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb583e-548b-44a4-af55-661ba3441ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:55.597146 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb583e-548b-44a4-af55-661ba3441ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:55.597415 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb583e-548b-44a4-af55-661ba3441ec2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:55.604952 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb583e-548b-44a4-af55-661ba3441ec2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:55.606379 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb583e-548b-44a4-af55-661ba3441ec2 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:55.617637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-c3bb583e-548b-44a4-af55-661ba3441ec2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 06 21:06:55.617637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:06:55.617637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:06:55.617637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:06:55.617637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:06:55.617637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:06:55.617637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:06:55.617637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:06:55.617637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:06:55.617637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:06:55.617637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:06:55.617637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:06:55.617637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 06 21:06:55.617637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 06 21:06:55.617637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 06 21:06:55.617637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 06 21:06:55.618749 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:06:55.618749 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:06:55.618749 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 06 21:06:55.618749 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:06:55.618749 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 06 21:06:55.618749 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 06 21:06:55.618749 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:06:55.618749 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:06:55.618749 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:06:55.618749 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:06:55.618749 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:06:55.618749 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:06:55.618749 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:06:55.618749 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:06:55.618749 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:06:55.618749 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:06:55.618749 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:06:55.618749 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:06:55.620124 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:06:55.620124 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:06:55.620124 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 06 21:06:55.620124 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 06 21:06:55.620124 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 06 21:06:55.620124 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 06 21:06:55.620124 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 06 21:06:55.620124 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 06 21:06:55.620124 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 06 21:06:55.620124 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:06:55.620124 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 645/1280] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:06:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:06:55.624817 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24717b74-e527-4420-b2bb-ebcc52ac5d1f None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:55.628682 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:55.721627 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24717b74-e527-4420-b2bb-ebcc52ac5d1f None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:55.754918 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b0eb9-5832-4af4-a209-87709c7e08ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:55.755517 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b0eb9-5832-4af4-a209-87709c7e08ba None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:55.755793 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b0eb9-5832-4af4-a209-87709c7e08ba None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:55.756063 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b0eb9-5832-4af4-a209-87709c7e08ba None admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:55.756801 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b0eb9-5832-4af4-a209-87709c7e08ba None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:55.757102 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b0eb9-5832-4af4-a209-87709c7e08ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:55.758499 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b0eb9-5832-4af4-a209-87709c7e08ba None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:55.776013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 636/1281] 10.222.0.81 () {56 vars in 1143 bytes} [Tue Sep 6 21:06:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:06:55.781865 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb583e-548b-44a4-af55-661ba3441ec2 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:55.869501 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:55.878494 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb583e-548b-44a4-af55-661ba3441ec2 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:55.911497 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e06162-771d-4dcf-978a-7347035e788b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:55.912085 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e06162-771d-4dcf-978a-7347035e788b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:55.912388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e06162-771d-4dcf-978a-7347035e788b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:55.912660 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e06162-771d-4dcf-978a-7347035e788b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:55.979451 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e06162-771d-4dcf-978a-7347035e788b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:55.981033 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e06162-771d-4dcf-978a-7347035e788b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:56.066960 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:56.076880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 646/1282] 10.222.0.81 () {58 vars in 1282 bytes} [Tue Sep 6 21:06:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 06 21:06:56.082969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b0eb9-5832-4af4-a209-87709c7e08ba None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:56.144883 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:56.187438 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b0eb9-5832-4af4-a209-87709c7e08ba None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:56.226407 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ca006-7f5f-43f4-9310-43e883e04eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:56.227041 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ca006-7f5f-43f4-9310-43e883e04eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:56.227320 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ca006-7f5f-43f4-9310-43e883e04eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:56.227590 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ca006-7f5f-43f4-9310-43e883e04eb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:56.237960 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ca006-7f5f-43f4-9310-43e883e04eb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:56.239312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ca006-7f5f-43f4-9310-43e883e04eb5 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:56.253790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-9f6ca006-7f5f-43f4-9310-43e883e04eb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:06:56.253790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:06:56.253790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:06:56.253790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:06:56.253790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:06:56.253790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:06:56.253790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:06:56.253790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:06:56.253790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:06:56.253790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:06:56.253790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:06:56.253790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:06:56.253790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 06 21:06:56.253790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 06 21:06:56.253790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 06 21:06:56.253790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 06 21:06:56.254998 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:06:56.254998 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:06:56.254998 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:06:56.254998 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:06:56.254998 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:06:56.254998 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:06:56.254998 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:06:56.254998 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:06:56.254998 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:06:56.254998 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:06:56.254998 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:06:56.254998 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:06:56.254998 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:06:56.254998 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:06:56.254998 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:06:56.254998 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:06:56.254998 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 06 21:06:56.256154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 06 21:06:56.256154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 06 21:06:56.256154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:06:56.256154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 637/1283] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:06:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:06:56.261105 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e06162-771d-4dcf-978a-7347035e788b None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:56.361701 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e06162-771d-4dcf-978a-7347035e788b None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:56.398257 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9ad62-e574-4e9e-a7ca-fbc887ef4d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:56.399291 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9ad62-e574-4e9e-a7ca-fbc887ef4d4d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:56.399291 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9ad62-e574-4e9e-a7ca-fbc887ef4d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:56.401629 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9ad62-e574-4e9e-a7ca-fbc887ef4d4d None admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:56.401629 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9ad62-e574-4e9e-a7ca-fbc887ef4d4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:56.401629 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9ad62-e574-4e9e-a7ca-fbc887ef4d4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:56.401950 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9ad62-e574-4e9e-a7ca-fbc887ef4d4d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:56.414394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 647/1284] 10.222.0.81 () {56 vars in 1109 bytes} [Tue Sep 6 21:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:06:56.422742 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ca006-7f5f-43f4-9310-43e883e04eb5 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:56.522307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ca006-7f5f-43f4-9310-43e883e04eb5 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:56.535831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:56.555828 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c17d56-a73d-40ad-978c-b0aaad43ba35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:56.558154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c17d56-a73d-40ad-978c-b0aaad43ba35 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:56.558154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c17d56-a73d-40ad-978c-b0aaad43ba35 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:56.558154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c17d56-a73d-40ad-978c-b0aaad43ba35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:56.564123 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c17d56-a73d-40ad-978c-b0aaad43ba35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:56.565531 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c17d56-a73d-40ad-978c-b0aaad43ba35 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:56.577031 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application [None req-f6c17d56-a73d-40ad-978c-b0aaad43ba35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:06:56.577031 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:06:56.577031 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:06:56.577031 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:06:56.577031 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:06:56.577031 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:06:56.577031 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:06:56.577031 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:06:56.577031 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:06:56.577031 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:06:56.577031 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:06:56.577031 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:06:56.577031 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 06 21:06:56.577031 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 06 21:06:56.577031 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 06 21:06:56.578125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 06 21:06:56.578125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:06:56.578125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:06:56.578125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:06:56.578125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:06:56.578125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:06:56.578125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:06:56.578125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:06:56.578125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application with Lock( Sep 06 21:06:56.578125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:06:56.578125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:06:56.578125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:06:56.578125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:06:56.578125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:06:56.578125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:06:56.578125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:06:56.578125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:06:56.579471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 06 21:06:56.579471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 06 21:06:56.579471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 06 21:06:56.579471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 06 21:06:56.579471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 06 21:06:56.579471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 06 21:06:56.579471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 06 21:06:56.579471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: ERROR keystone.server.flask.application Sep 06 21:06:56.579471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 638/1285] 10.222.0.81 () {56 vars in 1111 bytes} [Tue Sep 6 21:06:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:06:56.584334 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9ad62-e574-4e9e-a7ca-fbc887ef4d4d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:56.638908 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:56.691452 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9ad62-e574-4e9e-a7ca-fbc887ef4d4d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:56.728248 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119567ea-459b-4aa2-a3e9-6425ae09d90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:56.728861 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119567ea-459b-4aa2-a3e9-6425ae09d90c None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:56.729144 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119567ea-459b-4aa2-a3e9-6425ae09d90c None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:56.729419 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119567ea-459b-4aa2-a3e9-6425ae09d90c None admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:56.730106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119567ea-459b-4aa2-a3e9-6425ae09d90c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:56.730410 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119567ea-459b-4aa2-a3e9-6425ae09d90c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:56.731831 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119567ea-459b-4aa2-a3e9-6425ae09d90c None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:56.743505 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 648/1286] 10.222.0.81 () {56 vars in 1148 bytes} [Tue Sep 6 21:06:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:06:56.749846 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c17d56-a73d-40ad-978c-b0aaad43ba35 None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:56.856794 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c17d56-a73d-40ad-978c-b0aaad43ba35 None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:56.890589 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0f918-3dcb-41e7-8c59-f89a5e3f4336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:56.891185 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0f918-3dcb-41e7-8c59-f89a5e3f4336 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:56.891460 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0f918-3dcb-41e7-8c59-f89a5e3f4336 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:56.891728 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0f918-3dcb-41e7-8c59-f89a5e3f4336 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:56.892545 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0f918-3dcb-41e7-8c59-f89a5e3f4336 None admin] RBAC: Adding query filter params (role.id=fe9661f095094dd0931e0b96a1d6ef74, scope.project.id=002e09339d4e49ce98434571d3b64248, user.id=c3295306746f4552837f1bb12b2c500f) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:56.892857 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0f918-3dcb-41e7-8c59-f89a5e3f4336 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:56.894363 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0f918-3dcb-41e7-8c59-f89a5e3f4336 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:56.900013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 639/1287] 10.222.0.81 () {56 vars in 1374 bytes} [Tue Sep 6 21:06:56 2022] GET /identity/v3/role_assignments?user.id=c3295306746f4552837f1bb12b2c500f&scope.project.id=002e09339d4e49ce98434571d3b64248&role.id=fe9661f095094dd0931e0b96a1d6ef74 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:06:59.094409 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27336c2a-4419-4dab-9f6d-58b541fe96a3 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:59.094966 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27336c2a-4419-4dab-9f6d-58b541fe96a3 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:59.095199 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27336c2a-4419-4dab-9f6d-58b541fe96a3 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:59.096917 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 649/1288] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:06:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:06:59.102399 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2ae53-6dc6-4d70-90ba-2060b6559508 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:59.102786 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2ae53-6dc6-4d70-90ba-2060b6559508 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:59.103582 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2ae53-6dc6-4d70-90ba-2060b6559508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:59.121682 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-dce2ae53-6dc6-4d70-90ba-2060b6559508 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:06:59.122995 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-dce2ae53-6dc6-4d70-90ba-2060b6559508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:06:59.151980 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:59.188621 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 640/1289] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:06:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 06 21:06:59.463347 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27336c2a-4419-4dab-9f6d-58b541fe96a3 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:59.563848 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27336c2a-4419-4dab-9f6d-58b541fe96a3 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:59.574950 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:06:59.598539 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12655a45-4882-470d-991a-546f6b866d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:59.599167 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12655a45-4882-470d-991a-546f6b866d81 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:59.599443 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12655a45-4882-470d-991a-546f6b866d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:59.599714 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12655a45-4882-470d-991a-546f6b866d81 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:59.600320 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12655a45-4882-470d-991a-546f6b866d81 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:59.601681 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12655a45-4882-470d-991a-546f6b866d81 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:59.610851 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-12655a45-4882-470d-991a-546f6b866d81 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 21:06:59.610851 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:06:59.610851 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 21:06:59.610851 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 21:06:59.610851 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 21:06:59.610851 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 21:06:59.610851 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 21:06:59.610851 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:06:59.610851 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 21:06:59.610851 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:06:59.610851 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 21:06:59.610851 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:06:59.610851 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:06:59.610851 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:06:59.610851 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:06:59.610851 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:06:59.610851 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:06:59.613990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:06:59.613990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:06:59.613990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:06:59.613990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:06:59.613990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:06:59.613990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:06:59.613990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 21:06:59.613990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 21:06:59.613990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 21:06:59.613990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 21:06:59.613990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:06:59.613990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:06:59.613990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:06:59.613990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:06:59.613990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:06:59.613990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:06:59.615046 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:06:59.615046 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:06:59.615046 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:06:59.615046 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:06:59.615046 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:06:59.615046 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:06:59.615046 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:06:59.615046 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:06:59.615046 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:06:59.615046 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:06:59.615046 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 21:06:59.615046 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:06:59.615046 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 21:06:59.615046 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:06:59.615046 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 650/1290] 10.222.0.81 () {56 vars in 1117 bytes} [Tue Sep 6 21:06:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:06:59.617965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2ae53-6dc6-4d70-90ba-2060b6559508 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:59.715767 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2ae53-6dc6-4d70-90ba-2060b6559508 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:59.749962 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d929f27-7328-4d3d-ae88-260d19d6a046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:59.750573 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d929f27-7328-4d3d-ae88-260d19d6a046 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:59.750853 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d929f27-7328-4d3d-ae88-260d19d6a046 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:59.751127 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d929f27-7328-4d3d-ae88-260d19d6a046 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:59.751752 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d929f27-7328-4d3d-ae88-260d19d6a046 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:59.752056 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d929f27-7328-4d3d-ae88-260d19d6a046 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:59.753444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d929f27-7328-4d3d-ae88-260d19d6a046 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:59.758313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 641/1291] 10.222.0.81 () {56 vars in 1116 bytes} [Tue Sep 6 21:06:59 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:06:59.764725 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12655a45-4882-470d-991a-546f6b866d81 None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:06:59.861212 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12655a45-4882-470d-991a-546f6b866d81 None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:06:59.895079 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d691d7bc-12b8-430b-bb45-cf4090844e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:06:59.895687 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691d7bc-12b8-430b-bb45-cf4090844e1b None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:06:59.895971 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691d7bc-12b8-430b-bb45-cf4090844e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:06:59.896274 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691d7bc-12b8-430b-bb45-cf4090844e1b None admin] PATH_INFO: `/v3/services` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:06:59.896901 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d691d7bc-12b8-430b-bb45-cf4090844e1b None admin] RBAC: Adding query filter params (type=placement) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:06:59.897205 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d691d7bc-12b8-430b-bb45-cf4090844e1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:06:59.898590 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d691d7bc-12b8-430b-bb45-cf4090844e1b None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:06:59.903019 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 651/1292] 10.222.0.81 () {56 vars in 1116 bytes} [Tue Sep 6 21:06:59 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:07:02.024682 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5fc28-b744-476e-9c55-c77218e79106 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:07:02.025335 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5fc28-b744-476e-9c55-c77218e79106 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:07:02.025335 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5fc28-b744-476e-9c55-c77218e79106 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:07:02.026605 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 642/1293] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:07:02.032406 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095c2c6-e401-4e99-b3bf-9f53050b83b5 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:07:02.032851 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095c2c6-e401-4e99-b3bf-9f53050b83b5 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:07:02.032954 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095c2c6-e401-4e99-b3bf-9f53050b83b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:07:02.051357 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-2095c2c6-e401-4e99-b3bf-9f53050b83b5 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:07:02.052586 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-2095c2c6-e401-4e99-b3bf-9f53050b83b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:07:02.086883 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:07:02.128091 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 652/1294] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:07:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:07:02.398494 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5fc28-b744-476e-9c55-c77218e79106 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:07:02.429520 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:07:02.499437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5fc28-b744-476e-9c55-c77218e79106 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:07:02.532682 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a160a4-6197-4108-9474-e6ade7865a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:07:02.533281 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a160a4-6197-4108-9474-e6ade7865a4d None admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:07:02.533557 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a160a4-6197-4108-9474-e6ade7865a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:07:02.533826 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a160a4-6197-4108-9474-e6ade7865a4d None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:07:02.534474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a160a4-6197-4108-9474-e6ade7865a4d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:07:02.535814 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a160a4-6197-4108-9474-e6ade7865a4d None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:07:02.604751 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 643/1295] 10.222.0.81 () {60 vars in 1141 bytes} [Tue Sep 6 21:07:02 2022] POST /identity/v3/services => generated 246 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:07:04.829854 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc3760-2f2a-4fe7-8c58-5fef8cd560e2 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:07:04.830437 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc3760-2f2a-4fe7-8c58-5fef8cd560e2 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:07:04.830437 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc3760-2f2a-4fe7-8c58-5fef8cd560e2 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:07:04.831734 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 653/1296] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:07:04.837854 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb933c-c28b-49a1-9b95-46fa4518ede7 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:07:04.838303 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb933c-c28b-49a1-9b95-46fa4518ede7 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:07:04.838417 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb933c-c28b-49a1-9b95-46fa4518ede7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:07:04.856922 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-b5bb933c-c28b-49a1-9b95-46fa4518ede7 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:07:04.858123 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b5bb933c-c28b-49a1-9b95-46fa4518ede7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:07:04.935077 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 644/1297] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:07:04 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:07:05.209161 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc3760-2f2a-4fe7-8c58-5fef8cd560e2 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:07:05.310460 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc3760-2f2a-4fe7-8c58-5fef8cd560e2 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:07:05.343735 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf09da-0e63-4e37-99a4-4fcdc71c1e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:07:05.344387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf09da-0e63-4e37-99a4-4fcdc71c1e8d None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:07:05.344671 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf09da-0e63-4e37-99a4-4fcdc71c1e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:07:05.344947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cf09da-0e63-4e37-99a4-4fcdc71c1e8d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:07:05.345532 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf09da-0e63-4e37-99a4-4fcdc71c1e8d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:07:05.346897 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cf09da-0e63-4e37-99a4-4fcdc71c1e8d None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:07:05.355632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-19cf09da-0e63-4e37-99a4-4fcdc71c1e8d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 21:07:05.355632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:07:05.355632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 21:07:05.355632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 21:07:05.355632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 21:07:05.355632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 21:07:05.355632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 21:07:05.355632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:07:05.355632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 21:07:05.355632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:07:05.355632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 21:07:05.355632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:07:05.355632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:07:05.355632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:07:05.355632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:07:05.355632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:07:05.355632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:07:05.356852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:07:05.356852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:07:05.356852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:07:05.356852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:07:05.356852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:07:05.356852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:07:05.356852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 21:07:05.356852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 21:07:05.356852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 21:07:05.356852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 21:07:05.356852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:07:05.356852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:07:05.356852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:07:05.356852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:07:05.356852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:07:05.356852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:07:05.357697 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:07:05.357697 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:07:05.357697 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:07:05.357697 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:07:05.357697 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:07:05.357697 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:07:05.357697 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:07:05.357697 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:07:05.357697 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:07:05.357697 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:07:05.357697 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 21:07:05.357697 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:07:05.357697 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 21:07:05.357697 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:07:05.357697 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 654/1298] 10.222.0.81 () {56 vars in 1117 bytes} [Tue Sep 6 21:07:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:07:05.363145 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb933c-c28b-49a1-9b95-46fa4518ede7 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:07:05.381800 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:07:05.460925 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb933c-c28b-49a1-9b95-46fa4518ede7 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:07:05.495400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd7417-98d8-427f-a518-906670524eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:07:05.496004 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd7417-98d8-427f-a518-906670524eda None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:07:05.496314 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd7417-98d8-427f-a518-906670524eda None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:07:05.496590 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd7417-98d8-427f-a518-906670524eda None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:07:05.497214 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd7417-98d8-427f-a518-906670524eda None admin] RBAC: Adding query filter params (name=placement) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:07:05.497519 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd7417-98d8-427f-a518-906670524eda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:07:05.498872 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd7417-98d8-427f-a518-906670524eda None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:07:05.503901 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 645/1299] 10.222.0.81 () {56 vars in 1116 bytes} [Tue Sep 6 21:07:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:07:05.510017 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf09da-0e63-4e37-99a4-4fcdc71c1e8d None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:07:05.541670 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:07:05.609602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cf09da-0e63-4e37-99a4-4fcdc71c1e8d None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:07:05.643379 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb36222-87bb-44c1-ac03-ad6dc8622120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:07:05.643976 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb36222-87bb-44c1-ac03-ad6dc8622120 None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:07:05.644286 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb36222-87bb-44c1-ac03-ad6dc8622120 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:07:05.644560 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb36222-87bb-44c1-ac03-ad6dc8622120 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:07:05.645247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb36222-87bb-44c1-ac03-ad6dc8622120 None admin] RBAC: Adding query filter params (interface=public, service_id=1d353ec4d51e4f0d82f7e838878b4029, region_id=RegionOne) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:07:05.645555 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb36222-87bb-44c1-ac03-ad6dc8622120 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:07:05.646913 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb36222-87bb-44c1-ac03-ad6dc8622120 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:07:05.651992 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 655/1300] 10.222.0.81 () {56 vars in 1251 bytes} [Tue Sep 6 21:07:05 2022] GET /identity/v3/endpoints?service_id=1d353ec4d51e4f0d82f7e838878b4029&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:07:05.657785 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd7417-98d8-427f-a518-906670524eda None admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:07:05.738329 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:07:05.756137 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd7417-98d8-427f-a518-906670524eda None admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:07:05.789559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582021d-649b-433b-9fe4-c8b996288bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:07:05.790653 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582021d-649b-433b-9fe4-c8b996288bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:07:05.790939 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582021d-649b-433b-9fe4-c8b996288bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:07:05.791279 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582021d-649b-433b-9fe4-c8b996288bb6 None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:07:05.791875 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582021d-649b-433b-9fe4-c8b996288bb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:07:05.793251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582021d-649b-433b-9fe4-c8b996288bb6 None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:07:05.799885 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 646/1301] 10.222.0.81 () {56 vars in 1087 bytes} [Tue Sep 6 21:07:05 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:07:07.957768 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5b56b-986c-4790-8919-e1bb639e659a None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:07:07.958302 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5b56b-986c-4790-8919-e1bb639e659a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:07:07.958302 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5b56b-986c-4790-8919-e1bb639e659a None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:07:07.959628 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 656/1302] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:07:07.965487 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98772e6b-3ed8-4aa7-8d8e-a44983690e49 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:07:07.965936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98772e6b-3ed8-4aa7-8d8e-a44983690e49 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:07:07.966049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98772e6b-3ed8-4aa7-8d8e-a44983690e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:07:07.984003 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-98772e6b-3ed8-4aa7-8d8e-a44983690e49 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:07:07.985225 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-98772e6b-3ed8-4aa7-8d8e-a44983690e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:07:08.049981 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 647/1303] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:07:07 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 06 21:07:08.316172 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5b56b-986c-4790-8919-e1bb639e659a None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:07:08.409974 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:07:08.417447 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5b56b-986c-4790-8919-e1bb639e659a None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:07:08.450557 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138d074-adb8-4f96-a4a1-77fe6f34bcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:07:08.451186 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138d074-adb8-4f96-a4a1-77fe6f34bcfc None admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:07:08.451467 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138d074-adb8-4f96-a4a1-77fe6f34bcfc None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:07:08.451742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138d074-adb8-4f96-a4a1-77fe6f34bcfc None admin] PATH_INFO: `/v3/services/placement` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:07:08.452348 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138d074-adb8-4f96-a4a1-77fe6f34bcfc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:07:08.453771 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138d074-adb8-4f96-a4a1-77fe6f34bcfc None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:07:08.463778 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application [None req-a138d074-adb8-4f96-a4a1-77fe6f34bcfc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 21:07:08.463778 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:07:08.463778 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 06 21:07:08.463778 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 06 21:07:08.463778 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 06 21:07:08.463778 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 06 21:07:08.463778 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 06 21:07:08.463778 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:07:08.463778 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 21:07:08.463778 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:07:08.463778 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 06 21:07:08.463778 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:07:08.463778 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 06 21:07:08.463778 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 06 21:07:08.463778 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 06 21:07:08.463778 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 06 21:07:08.463778 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 06 21:07:08.466788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 06 21:07:08.466788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 06 21:07:08.466788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 06 21:07:08.466788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 06 21:07:08.466788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 06 21:07:08.466788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 06 21:07:08.466788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 06 21:07:08.466788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 06 21:07:08.466788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 06 21:07:08.466788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 06 21:07:08.466788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 06 21:07:08.466788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 06 21:07:08.466788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 06 21:07:08.466788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 06 21:07:08.466788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 06 21:07:08.466788 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.get_or_create( Sep 06 21:07:08.467824 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 06 21:07:08.467824 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application with Lock( Sep 06 21:07:08.467824 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 06 21:07:08.467824 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self._enter() Sep 06 21:07:08.467824 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 06 21:07:08.467824 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 06 21:07:08.467824 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 06 21:07:08.467824 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application return self.creator() Sep 06 21:07:08.467824 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 06 21:07:08.467824 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application created_value = creator( Sep 06 21:07:08.467824 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 06 21:07:08.467824 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 06 21:07:08.467824 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 06 21:07:08.467824 dv-cinder-749155-11-smb devstack@keystone.service[81777]: ERROR keystone.server.flask.application Sep 06 21:07:08.467824 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 657/1304] 10.222.0.81 () {56 vars in 1117 bytes} [Tue Sep 6 21:07:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 06 21:07:08.470954 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98772e6b-3ed8-4aa7-8d8e-a44983690e49 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:07:08.546014 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:07:08.568028 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98772e6b-3ed8-4aa7-8d8e-a44983690e49 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:07:08.603026 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc169101-9d8e-469f-b5ad-82850f00f84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:07:08.603647 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc169101-9d8e-469f-b5ad-82850f00f84e None admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:07:08.603929 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc169101-9d8e-469f-b5ad-82850f00f84e None admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:07:08.604245 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc169101-9d8e-469f-b5ad-82850f00f84e None admin] PATH_INFO: `/v3/services` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:07:08.605360 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc169101-9d8e-469f-b5ad-82850f00f84e None admin] RBAC: Adding query filter params (name=placement) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:07:08.605360 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc169101-9d8e-469f-b5ad-82850f00f84e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:07:08.606525 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc169101-9d8e-469f-b5ad-82850f00f84e None admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:07:08.611548 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 648/1305] 10.222.0.81 () {56 vars in 1116 bytes} [Tue Sep 6 21:07:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:07:08.617676 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138d074-adb8-4f96-a4a1-77fe6f34bcfc None admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:07:08.717639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138d074-adb8-4f96-a4a1-77fe6f34bcfc None admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:07:08.751873 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc8d9d-444d-4a87-88e4-fa4b06f84538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:07:08.752506 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc8d9d-444d-4a87-88e4-fa4b06f84538 None admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:07:08.752791 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc8d9d-444d-4a87-88e4-fa4b06f84538 None admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:07:08.753067 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc8d9d-444d-4a87-88e4-fa4b06f84538 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:07:08.753734 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc8d9d-444d-4a87-88e4-fa4b06f84538 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:07:08.755102 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc8d9d-444d-4a87-88e4-fa4b06f84538 None admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:07:08.817172 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 658/1306] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:07:08 2022] POST /identity/v3/endpoints => generated 331 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:07:18.608638 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=30 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:07:18.811147 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:13:40.912910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f34526-91df-4219-b9d0-1d0ccd11af65 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:13:40.913762 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f34526-91df-4219-b9d0-1d0ccd11af65 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:13:40.913762 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f34526-91df-4219-b9d0-1d0ccd11af65 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:13:40.914948 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 649/1307] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:13:40.920720 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f8ff5-0e4a-4590-a7ba-e7986733afcd None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:13:40.921206 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f8ff5-0e4a-4590-a7ba-e7986733afcd None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:13:40.921290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f8ff5-0e4a-4590-a7ba-e7986733afcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:13:41.083679 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-8e0f8ff5-0e4a-4590-a7ba-e7986733afcd None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:13:41.084937 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8e0f8ff5-0e4a-4590-a7ba-e7986733afcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:13:41.236667 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 659/1308] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:13:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:13:41.524413 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcf405-fc05-47fe-abf4-dbf4078c88d5 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:13:41.524707 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcf405-fc05-47fe-abf4-dbf4078c88d5 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:13:41.524988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fcf405-fc05-47fe-abf4-dbf4078c88d5 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:13:41.526329 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 650/1309] 10.222.0.81 () {54 vars in 965 bytes} [Tue Sep 6 21:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:13:41.532895 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943741d2-d1d8-48dc-868c-3df809eee879 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:13:41.533435 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943741d2-d1d8-48dc-868c-3df809eee879 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:13:41.533923 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943741d2-d1d8-48dc-868c-3df809eee879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:13:41.714137 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-943741d2-d1d8-48dc-868c-3df809eee879 None None] MFA Rules not processed for user `c9aebd6c7ef24f42949918c99a72722d`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:13:41.715606 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-943741d2-d1d8-48dc-868c-3df809eee879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:13:41.756230 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:13:41.845317 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 660/1310] 10.222.0.81 () {58 vars in 1062 bytes} [Tue Sep 6 21:13:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:13:41.856457 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fcf405-fc05-47fe-abf4-dbf4078c88d5 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:13:41.858461 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a6fcf405-fc05-47fe-abf4-dbf4078c88d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:13:41.998136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fcf405-fc05-47fe-abf4-dbf4078c88d5 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:13:42.079047 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e751a-2296-4432-b98d-2662bc3ad25e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:13:42.079671 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e751a-2296-4432-b98d-2662bc3ad25e service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:13:42.079952 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e751a-2296-4432-b98d-2662bc3ad25e service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:13:42.080270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e751a-2296-4432-b98d-2662bc3ad25e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:13:42.081904 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ad3e751a-2296-4432-b98d-2662bc3ad25e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:13:42.140502 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:13:42.198914 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e751a-2296-4432-b98d-2662bc3ad25e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:13:42.200379 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e751a-2296-4432-b98d-2662bc3ad25e service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:13:42.220368 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 651/1311] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:13:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:13:44.765228 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a8562-244a-4d60-b351-82a9c5127a33 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:13:44.765836 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a8562-244a-4d60-b351-82a9c5127a33 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:13:44.765836 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a8562-244a-4d60-b351-82a9c5127a33 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:13:44.767109 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 661/1312] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:13:44.772446 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a36126-2fac-476d-b68a-28268e2efe07 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:13:44.772847 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a36126-2fac-476d-b68a-28268e2efe07 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:13:44.772995 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a36126-2fac-476d-b68a-28268e2efe07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:13:44.856451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f1a36126-2fac-476d-b68a-28268e2efe07 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:13:44.857673 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f1a36126-2fac-476d-b68a-28268e2efe07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:13:44.953470 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 652/1313] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:13:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:13:45.234570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a8562-244a-4d60-b351-82a9c5127a33 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:13:45.236195 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f50a8562-244a-4d60-b351-82a9c5127a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:13:45.339685 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a8562-244a-4d60-b351-82a9c5127a33 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:13:45.409186 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:13:45.411672 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e400d7-88a3-47af-9dd3-bfa9c3711c88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:13:45.412377 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e400d7-88a3-47af-9dd3-bfa9c3711c88 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:13:45.412661 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e400d7-88a3-47af-9dd3-bfa9c3711c88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:13:45.412935 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e400d7-88a3-47af-9dd3-bfa9c3711c88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:13:45.414551 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d0e400d7-88a3-47af-9dd3-bfa9c3711c88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:13:45.522200 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e400d7-88a3-47af-9dd3-bfa9c3711c88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:13:45.523535 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e400d7-88a3-47af-9dd3-bfa9c3711c88 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:13:45.541249 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 662/1314] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:13:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:13:48.248847 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a33bfb-d53a-4fd4-be6e-b05f27b04a61 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:13:48.249756 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a33bfb-d53a-4fd4-be6e-b05f27b04a61 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:13:48.249756 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a33bfb-d53a-4fd4-be6e-b05f27b04a61 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:13:48.250771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 653/1315] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:13:48.256566 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48419a0-9efc-4d3b-9835-59c05f9a800a None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:13:48.257059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48419a0-9efc-4d3b-9835-59c05f9a800a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:13:48.257158 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48419a0-9efc-4d3b-9835-59c05f9a800a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:13:48.330162 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-d48419a0-9efc-4d3b-9835-59c05f9a800a None None] MFA Rules not processed for user `b318067cc95941c9b611879f7240b4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:13:48.331368 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d48419a0-9efc-4d3b-9835-59c05f9a800a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:13:48.384435 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:13:48.448577 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 663/1316] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:13:48 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:13:48.731183 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a33bfb-d53a-4fd4-be6e-b05f27b04a61 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:13:48.732803 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-96a33bfb-d53a-4fd4-be6e-b05f27b04a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:13:48.742509 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:13:48.841713 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a33bfb-d53a-4fd4-be6e-b05f27b04a61 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:13:48.916982 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf4821-d1d3-447d-badc-63bf8e13e8c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:13:48.917586 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf4821-d1d3-447d-badc-63bf8e13e8c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:13:48.917865 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf4821-d1d3-447d-badc-63bf8e13e8c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:13:48.918135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf4821-d1d3-447d-badc-63bf8e13e8c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:13:48.919725 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1ddf4821-d1d3-447d-badc-63bf8e13e8c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:13:48.983731 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:13:49.030469 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf4821-d1d3-447d-badc-63bf8e13e8c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:13:49.031903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddf4821-d1d3-447d-badc-63bf8e13e8c4 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:13:49.050770 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 654/1317] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:13:48 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:13:52.115801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280174e9-6753-4026-a15f-e83384e5e48a None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:13:52.116374 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280174e9-6753-4026-a15f-e83384e5e48a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:13:52.116374 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280174e9-6753-4026-a15f-e83384e5e48a None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:13:52.117708 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 664/1318] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:13:52.123017 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9400b-891d-4a11-9760-6e3b93444114 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:13:52.123427 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9400b-891d-4a11-9760-6e3b93444114 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:13:52.123579 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9400b-891d-4a11-9760-6e3b93444114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:13:52.189031 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-2ba9400b-891d-4a11-9760-6e3b93444114 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:13:52.190261 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2ba9400b-891d-4a11-9760-6e3b93444114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:13:52.286206 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 655/1319] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:13:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:13:52.583233 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae90340-c636-4e53-9ea9-32fcc387d659 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:13:52.583502 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae90340-c636-4e53-9ea9-32fcc387d659 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:13:52.583771 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae90340-c636-4e53-9ea9-32fcc387d659 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:13:52.585161 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 665/1320] 10.222.0.81 () {54 vars in 965 bytes} [Tue Sep 6 21:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:13:52.591232 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8406e-32e4-41b4-8464-c8116a0c96ba None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:13:52.591511 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8406e-32e4-41b4-8464-c8116a0c96ba None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:13:52.591782 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b8406e-32e4-41b4-8464-c8116a0c96ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:13:52.613845 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:13:52.668342 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-86b8406e-32e4-41b4-8464-c8116a0c96ba None None] MFA Rules not processed for user `c9aebd6c7ef24f42949918c99a72722d`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:13:52.669571 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-86b8406e-32e4-41b4-8464-c8116a0c96ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:13:52.742572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 656/1321] 10.222.0.81 () {58 vars in 1062 bytes} [Tue Sep 6 21:13:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:13:52.751981 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae90340-c636-4e53-9ea9-32fcc387d659 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:13:52.753545 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-fae90340-c636-4e53-9ea9-32fcc387d659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:13:52.856356 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae90340-c636-4e53-9ea9-32fcc387d659 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:13:52.928875 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d533d20-3c3f-4eac-b20c-0d918df43a54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:13:52.929473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d533d20-3c3f-4eac-b20c-0d918df43a54 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:13:52.929748 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d533d20-3c3f-4eac-b20c-0d918df43a54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:13:52.930025 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d533d20-3c3f-4eac-b20c-0d918df43a54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:13:52.931595 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7d533d20-3c3f-4eac-b20c-0d918df43a54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:13:52.939068 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:13:53.051587 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d533d20-3c3f-4eac-b20c-0d918df43a54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:13:53.053056 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d533d20-3c3f-4eac-b20c-0d918df43a54 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:13:53.071044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 666/1322] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:13:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:13:56.756893 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508999d6-6ea2-481f-849d-dc71bdc7a19c None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:13:56.757482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508999d6-6ea2-481f-849d-dc71bdc7a19c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:13:56.757482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508999d6-6ea2-481f-849d-dc71bdc7a19c None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:13:56.758838 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 657/1323] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:13:56.764833 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021419e2-baf1-4734-9d95-7467368827bc None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:13:56.765349 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021419e2-baf1-4734-9d95-7467368827bc None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:13:56.765467 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021419e2-baf1-4734-9d95-7467368827bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:13:56.842207 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-021419e2-baf1-4734-9d95-7467368827bc None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:13:56.843471 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-021419e2-baf1-4734-9d95-7467368827bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:13:56.906033 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:13:56.946639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 667/1324] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:13:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:13:57.233903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508999d6-6ea2-481f-849d-dc71bdc7a19c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:13:57.235462 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-508999d6-6ea2-481f-849d-dc71bdc7a19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:13:57.341898 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508999d6-6ea2-481f-849d-dc71bdc7a19c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:13:57.356023 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:13:57.416465 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a972969-e53d-460c-a58c-1536714e4e73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:13:57.417332 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a972969-e53d-460c-a58c-1536714e4e73 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:13:57.417607 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a972969-e53d-460c-a58c-1536714e4e73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:13:57.417873 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a972969-e53d-460c-a58c-1536714e4e73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:13:57.419448 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2a972969-e53d-460c-a58c-1536714e4e73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:13:57.527770 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a972969-e53d-460c-a58c-1536714e4e73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:13:57.529230 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a972969-e53d-460c-a58c-1536714e4e73 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:13:57.547526 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 658/1325] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:13:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:13:59.783525 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fb691-c84a-4b9a-89b6-233b8d544475 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:13:59.784182 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fb691-c84a-4b9a-89b6-233b8d544475 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:13:59.784182 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fb691-c84a-4b9a-89b6-233b8d544475 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:13:59.785802 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 668/1326] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:13:59.791271 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d48cfe-67c3-4dfb-bcff-4b60a9d0409c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:13:59.792059 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d48cfe-67c3-4dfb-bcff-4b60a9d0409c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:13:59.792221 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d48cfe-67c3-4dfb-bcff-4b60a9d0409c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:13:59.850697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:13:59.869227 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a8d48cfe-67c3-4dfb-bcff-4b60a9d0409c None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:13:59.870458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a8d48cfe-67c3-4dfb-bcff-4b60a9d0409c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:13:59.970347 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 659/1327] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:14:00.255921 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fb691-c84a-4b9a-89b6-233b8d544475 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:14:00.257514 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-659fb691-c84a-4b9a-89b6-233b8d544475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:00.365257 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fb691-c84a-4b9a-89b6-233b8d544475 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:14:00.439955 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7d1fa-08b9-4377-ab61-c2ee3987359b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:14:00.440591 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7d1fa-08b9-4377-ab61-c2ee3987359b service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:00.440867 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7d1fa-08b9-4377-ab61-c2ee3987359b service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:00.441166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7d1fa-08b9-4377-ab61-c2ee3987359b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:00.442847 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b1d7d1fa-08b9-4377-ab61-c2ee3987359b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:00.459647 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:00.551781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d7d1fa-08b9-4377-ab61-c2ee3987359b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:14:00.553272 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d7d1fa-08b9-4377-ab61-c2ee3987359b service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:14:00.572033 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 669/1328] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:14:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:14:02.797998 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd0061-c83e-4ad4-accf-16c453f85ae7 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:02.798602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd0061-c83e-4ad4-accf-16c453f85ae7 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:02.798602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd0061-c83e-4ad4-accf-16c453f85ae7 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:02.799911 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 660/1329] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:14:02.806039 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da7433-fb43-4f8d-a404-ac3d0b27f30d None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:02.806539 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da7433-fb43-4f8d-a404-ac3d0b27f30d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:02.806648 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da7433-fb43-4f8d-a404-ac3d0b27f30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:02.878467 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-42da7433-fb43-4f8d-a404-ac3d0b27f30d None None] MFA Rules not processed for user `b318067cc95941c9b611879f7240b4ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:14:02.880237 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-42da7433-fb43-4f8d-a404-ac3d0b27f30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:02.951113 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:02.984946 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 670/1330] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:14:02 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:14:03.267114 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd0061-c83e-4ad4-accf-16c453f85ae7 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:14:03.268726 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-eccd0061-c83e-4ad4-accf-16c453f85ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:03.373851 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd0061-c83e-4ad4-accf-16c453f85ae7 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:14:03.395472 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:03.455555 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef6194-f227-43db-8961-c0d572464a16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:14:03.456199 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef6194-f227-43db-8961-c0d572464a16 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:03.456485 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef6194-f227-43db-8961-c0d572464a16 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:03.457370 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef6194-f227-43db-8961-c0d572464a16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:03.458990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-20ef6194-f227-43db-8961-c0d572464a16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:03.568260 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef6194-f227-43db-8961-c0d572464a16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:14:03.569692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef6194-f227-43db-8961-c0d572464a16 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:14:03.588186 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 661/1331] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:14:03 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:14:06.374169 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3be9d8-8865-4946-a3ad-4cca0a88e20c None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:06.374755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3be9d8-8865-4946-a3ad-4cca0a88e20c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:06.374755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3be9d8-8865-4946-a3ad-4cca0a88e20c None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:06.376112 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 671/1332] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:14:06.381268 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc586e6-2fa2-4211-b104-05eeb02743bd None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:06.381722 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc586e6-2fa2-4211-b104-05eeb02743bd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:06.381826 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc586e6-2fa2-4211-b104-05eeb02743bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:06.446130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:06.448977 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-afc586e6-2fa2-4211-b104-05eeb02743bd None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:14:06.450219 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-afc586e6-2fa2-4211-b104-05eeb02743bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:06.547221 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 662/1333] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:14:06.833925 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3be9d8-8865-4946-a3ad-4cca0a88e20c None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:14:06.835498 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7e3be9d8-8865-4946-a3ad-4cca0a88e20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:06.940951 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3be9d8-8865-4946-a3ad-4cca0a88e20c None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:14:07.013476 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e1d227-7589-4446-9611-58ee2569bc11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:14:07.014084 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1d227-7589-4446-9611-58ee2569bc11 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:07.014364 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1d227-7589-4446-9611-58ee2569bc11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:07.014638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e1d227-7589-4446-9611-58ee2569bc11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:07.016338 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d4e1d227-7589-4446-9611-58ee2569bc11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:07.044127 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:07.124195 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1d227-7589-4446-9611-58ee2569bc11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:14:07.125572 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e1d227-7589-4446-9611-58ee2569bc11 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:14:07.143544 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 672/1334] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:14:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:14:09.326684 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3964b-6f28-4db6-b722-2e6c1f13ac25 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:09.327228 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3964b-6f28-4db6-b722-2e6c1f13ac25 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:09.327228 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd3964b-6f28-4db6-b722-2e6c1f13ac25 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:09.328630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 663/1335] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:14:09.333964 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff1d3a-728a-4ad0-8443-930a919d468c None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:09.334366 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff1d3a-728a-4ad0-8443-930a919d468c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:09.334511 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff1d3a-728a-4ad0-8443-930a919d468c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:09.399408 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-56ff1d3a-728a-4ad0-8443-930a919d468c None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:14:09.400633 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-56ff1d3a-728a-4ad0-8443-930a919d468c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:09.474306 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:09.496928 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 673/1336] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:14:09.781211 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3964b-6f28-4db6-b722-2e6c1f13ac25 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:14:09.782791 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1dd3964b-6f28-4db6-b722-2e6c1f13ac25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:09.886065 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd3964b-6f28-4db6-b722-2e6c1f13ac25 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:14:09.915950 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:09.960272 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18620a-2c2d-44e7-b233-c0314870aa77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:14:09.960872 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18620a-2c2d-44e7-b233-c0314870aa77 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:09.961152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18620a-2c2d-44e7-b233-c0314870aa77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:09.961429 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18620a-2c2d-44e7-b233-c0314870aa77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:09.963015 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2f18620a-2c2d-44e7-b233-c0314870aa77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:10.071721 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f18620a-2c2d-44e7-b233-c0314870aa77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:14:10.073239 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f18620a-2c2d-44e7-b233-c0314870aa77 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:14:10.092206 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 664/1337] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:14:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:14:12.802308 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f3661-0df3-4abb-8b5a-0c1b5e14c0a4 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:12.802850 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f3661-0df3-4abb-8b5a-0c1b5e14c0a4 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:12.802850 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1f3661-0df3-4abb-8b5a-0c1b5e14c0a4 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:12.804320 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 674/1338] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:14:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:14:12.810036 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdf6a7-a900-4923-bc0d-4d6db1f3c3ed None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:12.810461 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdf6a7-a900-4923-bc0d-4d6db1f3c3ed None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:12.810601 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdf6a7-a900-4923-bc0d-4d6db1f3c3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:12.877723 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-77fdf6a7-a900-4923-bc0d-4d6db1f3c3ed None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:14:12.878953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-77fdf6a7-a900-4923-bc0d-4d6db1f3c3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:12.888585 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:12.975605 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 665/1339] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:14:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:14:13.259947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f3661-0df3-4abb-8b5a-0c1b5e14c0a4 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:14:13.261561 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4c1f3661-0df3-4abb-8b5a-0c1b5e14c0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:13.366030 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1f3661-0df3-4abb-8b5a-0c1b5e14c0a4 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:14:13.440842 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7d7d44-7320-4a36-a004-dcaa619cad73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:14:13.441452 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d7d44-7320-4a36-a004-dcaa619cad73 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:13.441734 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d7d44-7320-4a36-a004-dcaa619cad73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:13.442065 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7d7d44-7320-4a36-a004-dcaa619cad73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:13.443669 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-3f7d7d44-7320-4a36-a004-dcaa619cad73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:13.479765 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:13.552291 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d7d44-7320-4a36-a004-dcaa619cad73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:14:13.553743 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7d7d44-7320-4a36-a004-dcaa619cad73 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:14:13.571825 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 675/1340] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:14:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:14:18.011712 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ee9a5-08ea-4e63-a8e8-332e5d0f047b None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:18.012236 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ee9a5-08ea-4e63-a8e8-332e5d0f047b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:18.012344 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ee9a5-08ea-4e63-a8e8-332e5d0f047b None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:18.013636 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 666/1341] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:14:18.019146 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e848a-a483-4c8e-8bd0-cc94fc69328b None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:18.019572 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e848a-a483-4c8e-8bd0-cc94fc69328b None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:18.019686 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e848a-a483-4c8e-8bd0-cc94fc69328b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:18.090485 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f66e848a-a483-4c8e-8bd0-cc94fc69328b None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:14:18.091687 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f66e848a-a483-4c8e-8bd0-cc94fc69328b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:18.178815 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:18.191035 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 676/1342] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:14:18.473061 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ee9a5-08ea-4e63-a8e8-332e5d0f047b None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:14:18.474629 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-539ee9a5-08ea-4e63-a8e8-332e5d0f047b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:18.580868 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ee9a5-08ea-4e63-a8e8-332e5d0f047b None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:14:18.620314 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:18.657392 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d6bb9-c518-4851-bd05-7ff7fbaed2da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:14:18.657991 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d6bb9-c518-4851-bd05-7ff7fbaed2da service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:18.658271 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d6bb9-c518-4851-bd05-7ff7fbaed2da service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:18.658551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d6bb9-c518-4851-bd05-7ff7fbaed2da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:18.660633 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a17d6bb9-c518-4851-bd05-7ff7fbaed2da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:18.777972 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d6bb9-c518-4851-bd05-7ff7fbaed2da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:14:18.779555 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d6bb9-c518-4851-bd05-7ff7fbaed2da service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:14:18.799814 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 667/1343] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:14:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:14:21.904377 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13eeb04-6c13-466b-b943-5d52085a28bc None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:21.904955 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13eeb04-6c13-466b-b943-5d52085a28bc None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:21.904955 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13eeb04-6c13-466b-b943-5d52085a28bc None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:21.906269 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 677/1344] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:14:21.911690 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1181fa1-86bc-4d0f-9ba0-5d1e31e24851 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:21.912134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1181fa1-86bc-4d0f-9ba0-5d1e31e24851 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:21.912348 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1181fa1-86bc-4d0f-9ba0-5d1e31e24851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:21.983259 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d1181fa1-86bc-4d0f-9ba0-5d1e31e24851 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:14:21.984575 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d1181fa1-86bc-4d0f-9ba0-5d1e31e24851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:22.003232 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:22.088614 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 668/1345] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:14:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:14:22.377001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13eeb04-6c13-466b-b943-5d52085a28bc None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:14:22.378578 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f13eeb04-6c13-466b-b943-5d52085a28bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:22.486400 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13eeb04-6c13-466b-b943-5d52085a28bc None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:14:22.559783 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e51f48-4fe9-49f8-aa0b-b88e2ae55126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:14:22.560437 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e51f48-4fe9-49f8-aa0b-b88e2ae55126 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:22.560721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e51f48-4fe9-49f8-aa0b-b88e2ae55126 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:22.560996 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e51f48-4fe9-49f8-aa0b-b88e2ae55126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:22.562635 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d1e51f48-4fe9-49f8-aa0b-b88e2ae55126 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:22.607146 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:22.674956 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e51f48-4fe9-49f8-aa0b-b88e2ae55126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:14:22.676431 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e51f48-4fe9-49f8-aa0b-b88e2ae55126 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:14:22.694423 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 678/1346] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:14:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:14:27.237415 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d43070-e6bb-4747-b68d-9bd85738da30 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:27.237957 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d43070-e6bb-4747-b68d-9bd85738da30 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:27.237957 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d43070-e6bb-4747-b68d-9bd85738da30 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:27.239306 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 669/1347] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:14:27.247746 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c6712-19a1-4cd7-bd2a-c5d4dc8af17b None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:27.248265 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c6712-19a1-4cd7-bd2a-c5d4dc8af17b None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:27.248390 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7c6712-19a1-4cd7-bd2a-c5d4dc8af17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:27.324173 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-8e7c6712-19a1-4cd7-bd2a-c5d4dc8af17b None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:14:27.325405 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8e7c6712-19a1-4cd7-bd2a-c5d4dc8af17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:27.425781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:27.428441 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 679/1348] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:14:27.712217 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d43070-e6bb-4747-b68d-9bd85738da30 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:14:27.713747 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-73d43070-e6bb-4747-b68d-9bd85738da30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:27.816669 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d43070-e6bb-4747-b68d-9bd85738da30 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:14:27.864431 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:27.891045 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f0337-9735-4130-976a-832a8faeab54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:14:27.891662 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f0337-9735-4130-976a-832a8faeab54 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:27.892016 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f0337-9735-4130-976a-832a8faeab54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:27.892279 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f0337-9735-4130-976a-832a8faeab54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:27.894048 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-038f0337-9735-4130-976a-832a8faeab54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:28.003467 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f0337-9735-4130-976a-832a8faeab54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:14:28.004851 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038f0337-9735-4130-976a-832a8faeab54 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:14:28.023916 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 670/1349] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:14:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:14:33.009384 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9de62-679f-4297-8981-ad20db9bfe31 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:33.009957 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9de62-679f-4297-8981-ad20db9bfe31 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:33.009957 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9de62-679f-4297-8981-ad20db9bfe31 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:33.011411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 680/1350] 10.222.0.81 () {54 vars in 921 bytes} [Tue Sep 6 21:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:14:33.016383 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b3191-29a0-4901-bb99-bfa9fe4be473 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:33.016837 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b3191-29a0-4901-bb99-bfa9fe4be473 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:33.016931 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556b3191-29a0-4901-bb99-bfa9fe4be473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:33.116520 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-556b3191-29a0-4901-bb99-bfa9fe4be473 None None] MFA Rules not processed for user `c3295306746f4552837f1bb12b2c500f`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:14:33.118574 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-556b3191-29a0-4901-bb99-bfa9fe4be473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:33.138204 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:33.271225 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 671/1351] 10.222.0.81 () {58 vars in 1018 bytes} [Tue Sep 6 21:14:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:14:37.680731 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40957658-33ee-4223-8680-6acd9186c840 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:37.681706 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40957658-33ee-4223-8680-6acd9186c840 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:37.682191 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40957658-33ee-4223-8680-6acd9186c840 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:37.683969 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 681/1352] 10.222.0.81 () {54 vars in 921 bytes} [Tue Sep 6 21:14:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:14:37.690591 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e35f5-d2b2-4c9e-9c67-d341211e4022 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:37.691057 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e35f5-d2b2-4c9e-9c67-d341211e4022 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:37.691269 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e35f5-d2b2-4c9e-9c67-d341211e4022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:37.787391 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-714e35f5-d2b2-4c9e-9c67-d341211e4022 None None] MFA Rules not processed for user `c3295306746f4552837f1bb12b2c500f`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:14:37.788781 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-714e35f5-d2b2-4c9e-9c67-d341211e4022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:37.876010 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:37.921726 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 672/1353] 10.222.0.81 () {58 vars in 1018 bytes} [Tue Sep 6 21:14:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:14:39.141211 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96698f1-8aa5-4e5a-aeef-f26704cfd499 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:39.141733 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96698f1-8aa5-4e5a-aeef-f26704cfd499 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:39.141733 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96698f1-8aa5-4e5a-aeef-f26704cfd499 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:39.143207 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 682/1354] 10.222.0.81 () {54 vars in 921 bytes} [Tue Sep 6 21:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:14:39.148895 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dca390-31e7-444f-9145-21b7f666ec27 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:39.149377 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dca390-31e7-444f-9145-21b7f666ec27 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:39.149503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dca390-31e7-444f-9145-21b7f666ec27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:39.233354 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f8dca390-31e7-444f-9145-21b7f666ec27 None None] MFA Rules not processed for user `c3295306746f4552837f1bb12b2c500f`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:14:39.234573 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f8dca390-31e7-444f-9145-21b7f666ec27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:39.353849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 673/1355] 10.222.0.81 () {58 vars in 1018 bytes} [Tue Sep 6 21:14:39 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:14:42.871661 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdab197-8af5-47c0-bea1-32130d2d0799 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:42.872183 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdab197-8af5-47c0-bea1-32130d2d0799 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:42.872183 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdab197-8af5-47c0-bea1-32130d2d0799 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:42.878646 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 683/1356] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:14:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:14:42.881950 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2ad7c-462a-4e85-a512-2e4341b0216d None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:42.882401 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2ad7c-462a-4e85-a512-2e4341b0216d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:42.883724 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2ad7c-462a-4e85-a512-2e4341b0216d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:42.934799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:42.975020 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-dbb2ad7c-462a-4e85-a512-2e4341b0216d None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:14:42.977170 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-dbb2ad7c-462a-4e85-a512-2e4341b0216d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:43.116159 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 674/1357] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:14:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:14:43.408714 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8b0f9-9fed-440f-97b3-c6b289adf1f3 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:43.409225 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8b0f9-9fed-440f-97b3-c6b289adf1f3 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:43.409658 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef8b0f9-9fed-440f-97b3-c6b289adf1f3 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:43.411452 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 684/1358] 10.222.0.81 () {54 vars in 962 bytes} [Tue Sep 6 21:14:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:14:43.420332 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d6e5e-7501-4ecc-be04-950c6ffcd8b3 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:43.420842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d6e5e-7501-4ecc-be04-950c6ffcd8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:43.421277 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d6e5e-7501-4ecc-be04-950c6ffcd8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:43.504714 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-277d6e5e-7501-4ecc-be04-950c6ffcd8b3 None None] MFA Rules not processed for user `4441d8fea57f401a96fb8cbd2b501059`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:14:43.506495 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-277d6e5e-7501-4ecc-be04-950c6ffcd8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:43.561558 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:43.636288 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 675/1359] 10.222.0.81 () {58 vars in 1059 bytes} [Tue Sep 6 21:14:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:14:43.641849 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8b0f9-9fed-440f-97b3-c6b289adf1f3 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:14:43.654246 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4ef8b0f9-9fed-440f-97b3-c6b289adf1f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:43.806679 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef8b0f9-9fed-440f-97b3-c6b289adf1f3 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:14:43.885969 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:43.929477 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41375670-374e-4b7b-9e24-0ec8716dfeb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:14:43.930258 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41375670-374e-4b7b-9e24-0ec8716dfeb8 service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:43.930564 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41375670-374e-4b7b-9e24-0ec8716dfeb8 service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:43.930961 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41375670-374e-4b7b-9e24-0ec8716dfeb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:43.932794 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-41375670-374e-4b7b-9e24-0ec8716dfeb8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:44.035396 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41375670-374e-4b7b-9e24-0ec8716dfeb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:14:44.037511 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41375670-374e-4b7b-9e24-0ec8716dfeb8 service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:14:44.059920 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 685/1360] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:14:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:14:46.584791 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a0f57-013f-4bc7-92df-2076a3ede8a0 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:46.585355 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a0f57-013f-4bc7-92df-2076a3ede8a0 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:46.585355 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a0f57-013f-4bc7-92df-2076a3ede8a0 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:46.586988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 676/1361] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:14:46.592212 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31194561-9a51-498b-8680-8121e0ba85bf None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:46.592817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31194561-9a51-498b-8680-8121e0ba85bf None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:46.592817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31194561-9a51-498b-8680-8121e0ba85bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:46.688684 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-31194561-9a51-498b-8680-8121e0ba85bf None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:14:46.689889 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-31194561-9a51-498b-8680-8121e0ba85bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:46.728770 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:46.798564 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 686/1362] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:14:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:14:47.091270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a0f57-013f-4bc7-92df-2076a3ede8a0 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:14:47.093112 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d44a0f57-013f-4bc7-92df-2076a3ede8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:47.274168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a0f57-013f-4bc7-92df-2076a3ede8a0 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:14:47.286809 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:47.404642 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11932d3-a8d2-4c27-91c6-9cb8603c9f14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:14:47.405260 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11932d3-a8d2-4c27-91c6-9cb8603c9f14 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:47.406342 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11932d3-a8d2-4c27-91c6-9cb8603c9f14 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:47.406342 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11932d3-a8d2-4c27-91c6-9cb8603c9f14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:47.407439 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d11932d3-a8d2-4c27-91c6-9cb8603c9f14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:47.498416 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11932d3-a8d2-4c27-91c6-9cb8603c9f14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:14:47.500014 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11932d3-a8d2-4c27-91c6-9cb8603c9f14 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:14:47.518503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 677/1363] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:14:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:14:50.422075 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d96a05-4b90-4ae4-a008-7d8a0586c6a1 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:50.422639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d96a05-4b90-4ae4-a008-7d8a0586c6a1 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:50.422639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d96a05-4b90-4ae4-a008-7d8a0586c6a1 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:50.424691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 687/1364] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:14:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:14:50.430361 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836abbe6-3b6c-405b-b6c8-0dfbbe3187fd None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:50.430821 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836abbe6-3b6c-405b-b6c8-0dfbbe3187fd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:50.430926 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836abbe6-3b6c-405b-b6c8-0dfbbe3187fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:50.451533 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:50.511524 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-836abbe6-3b6c-405b-b6c8-0dfbbe3187fd None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:14:50.512859 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-836abbe6-3b6c-405b-b6c8-0dfbbe3187fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:50.640158 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 678/1365] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:14:50.934326 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef5756-8613-47b0-b116-ba88160a7a52 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:50.934772 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef5756-8613-47b0-b116-ba88160a7a52 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:50.935142 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef5756-8613-47b0-b116-ba88160a7a52 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:50.936785 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 688/1366] 10.222.0.81 () {54 vars in 962 bytes} [Tue Sep 6 21:14:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:14:50.943109 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead08d0-e402-49a7-a915-2a3ca0f69392 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:50.943409 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead08d0-e402-49a7-a915-2a3ca0f69392 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:50.943664 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead08d0-e402-49a7-a915-2a3ca0f69392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:51.027420 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-fead08d0-e402-49a7-a915-2a3ca0f69392 None None] MFA Rules not processed for user `4441d8fea57f401a96fb8cbd2b501059`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:14:51.028862 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fead08d0-e402-49a7-a915-2a3ca0f69392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:51.068881 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:51.161148 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 679/1367] 10.222.0.81 () {58 vars in 1059 bytes} [Tue Sep 6 21:14:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:14:51.170398 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef5756-8613-47b0-b116-ba88160a7a52 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:14:51.172031 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-09ef5756-8613-47b0-b116-ba88160a7a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:51.337558 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef5756-8613-47b0-b116-ba88160a7a52 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:14:51.359607 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:51.460928 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df53a4-01f1-4ab9-a4e5-37c04b89dd52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:14:51.461604 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df53a4-01f1-4ab9-a4e5-37c04b89dd52 service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:51.461986 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df53a4-01f1-4ab9-a4e5-37c04b89dd52 service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:51.462357 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df53a4-01f1-4ab9-a4e5-37c04b89dd52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:51.464074 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e9df53a4-01f1-4ab9-a4e5-37c04b89dd52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:51.571458 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df53a4-01f1-4ab9-a4e5-37c04b89dd52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:14:51.573269 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df53a4-01f1-4ab9-a4e5-37c04b89dd52 service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:14:51.592527 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 689/1368] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:14:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:14:51.646363 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46be42-653f-4e66-a2f3-c7372d709760 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:51.646965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46be42-653f-4e66-a2f3-c7372d709760 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:51.647052 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46be42-653f-4e66-a2f3-c7372d709760 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:51.648389 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 680/1369] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:14:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:14:51.653876 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c539514-70d8-4c5a-b94a-c82d89acffa4 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:51.654166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c539514-70d8-4c5a-b94a-c82d89acffa4 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:51.654471 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c539514-70d8-4c5a-b94a-c82d89acffa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:51.688947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:51.728933 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-1c539514-70d8-4c5a-b94a-c82d89acffa4 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:14:51.730079 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1c539514-70d8-4c5a-b94a-c82d89acffa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:51.837150 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 690/1370] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:14:52.194202 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbfd9d-921a-49f6-8581-40f353547a1e None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:52.194688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbfd9d-921a-49f6-8581-40f353547a1e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:52.194994 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbfd9d-921a-49f6-8581-40f353547a1e None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:52.196650 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 681/1371] 10.222.0.81 () {54 vars in 964 bytes} [Tue Sep 6 21:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:14:52.201891 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a925d-e170-4d9c-b273-7c58bb187285 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:52.202304 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a925d-e170-4d9c-b273-7c58bb187285 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:52.202700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a925d-e170-4d9c-b273-7c58bb187285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:52.299526 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-d61a925d-e170-4d9c-b273-7c58bb187285 None None] MFA Rules not processed for user `af9589aaba334db494ed0b036e94062f`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:14:52.300781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d61a925d-e170-4d9c-b273-7c58bb187285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:52.359863 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:52.397529 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 691/1372] 10.222.0.81 () {58 vars in 1061 bytes} [Tue Sep 6 21:14:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:14:52.406072 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afbfd9d-921a-49f6-8581-40f353547a1e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:14:52.407636 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8afbfd9d-921a-49f6-8581-40f353547a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:52.553813 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afbfd9d-921a-49f6-8581-40f353547a1e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:14:52.613911 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:52.663556 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e2469-a860-4426-bd8c-b85ff62cc3b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:14:52.664570 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e2469-a860-4426-bd8c-b85ff62cc3b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:52.665091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e2469-a860-4426-bd8c-b85ff62cc3b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:52.665668 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e2469-a860-4426-bd8c-b85ff62cc3b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:52.668474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-679e2469-a860-4426-bd8c-b85ff62cc3b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:52.810286 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e2469-a860-4426-bd8c-b85ff62cc3b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:14:52.811740 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679e2469-a860-4426-bd8c-b85ff62cc3b3 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:14:52.833615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 682/1373] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:14:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:14:54.093372 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b77f8d-7f63-4602-a779-e2a557a9f3c1 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:54.094204 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b77f8d-7f63-4602-a779-e2a557a9f3c1 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:54.094204 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b77f8d-7f63-4602-a779-e2a557a9f3c1 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:54.095274 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 692/1374] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:14:54.101467 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4a53e-2b6a-489d-bad5-53102d048ca0 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:54.101973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4a53e-2b6a-489d-bad5-53102d048ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:54.102177 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c4a53e-2b6a-489d-bad5-53102d048ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:54.173101 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-49c4a53e-2b6a-489d-bad5-53102d048ca0 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:14:54.174350 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-49c4a53e-2b6a-489d-bad5-53102d048ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:54.195538 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:54.278316 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 683/1375] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:14:54.570207 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b77f8d-7f63-4602-a779-e2a557a9f3c1 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:14:54.571754 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f2b77f8d-7f63-4602-a779-e2a557a9f3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:54.730460 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b77f8d-7f63-4602-a779-e2a557a9f3c1 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:14:54.791260 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:54.865785 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad36627-b68b-4664-bc38-dd59ce086141 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:14:54.866411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad36627-b68b-4664-bc38-dd59ce086141 service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:54.866690 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad36627-b68b-4664-bc38-dd59ce086141 service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:54.867014 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad36627-b68b-4664-bc38-dd59ce086141 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:54.868675 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7ad36627-b68b-4664-bc38-dd59ce086141 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:54.968754 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad36627-b68b-4664-bc38-dd59ce086141 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:14:54.970435 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad36627-b68b-4664-bc38-dd59ce086141 service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:14:54.989744 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 693/1376] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:14:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:14:57.352204 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f6819-fac8-4538-9c25-1a0e9cd98170 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:57.352753 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f6819-fac8-4538-9c25-1a0e9cd98170 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:57.352753 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f6819-fac8-4538-9c25-1a0e9cd98170 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:57.356202 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 684/1377] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:14:57.359331 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e07c8-4bfa-498d-b601-eb7e65d918e0 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:57.359745 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e07c8-4bfa-498d-b601-eb7e65d918e0 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:57.359941 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947e07c8-4bfa-498d-b601-eb7e65d918e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:57.429739 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-947e07c8-4bfa-498d-b601-eb7e65d918e0 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:14:57.430953 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-947e07c8-4bfa-498d-b601-eb7e65d918e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:57.438159 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:57.530233 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 694/1378] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:14:57.818701 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f6819-fac8-4538-9c25-1a0e9cd98170 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:14:57.820382 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a87f6819-fac8-4538-9c25-1a0e9cd98170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:57.974541 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f6819-fac8-4538-9c25-1a0e9cd98170 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:14:57.978725 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:14:58.100943 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3d0b3-c360-4b56-97e3-c169c026d18f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:14:58.101490 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3d0b3-c360-4b56-97e3-c169c026d18f service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:14:58.101765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3d0b3-c360-4b56-97e3-c169c026d18f service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:14:58.102037 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3d0b3-c360-4b56-97e3-c169c026d18f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:14:58.104147 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2ba3d0b3-c360-4b56-97e3-c169c026d18f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:14:58.205712 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3d0b3-c360-4b56-97e3-c169c026d18f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:14:58.207279 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3d0b3-c360-4b56-97e3-c169c026d18f service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:14:58.227503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 685/1379] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:14:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:15:00.527195 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8da535-e638-47a4-98eb-1536a283b3cc None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:00.527913 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8da535-e638-47a4-98eb-1536a283b3cc None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:00.527913 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8da535-e638-47a4-98eb-1536a283b3cc None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:00.534928 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799cd4b-9e96-41f0-b01e-cc88eb021e91 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:00.534928 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799cd4b-9e96-41f0-b01e-cc88eb021e91 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:00.534928 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799cd4b-9e96-41f0-b01e-cc88eb021e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:00.540186 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 695/1380] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:15:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:15:00.547930 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:00.612925 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-b799cd4b-9e96-41f0-b01e-cc88eb021e91 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:15:00.615464 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b799cd4b-9e96-41f0-b01e-cc88eb021e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:00.718833 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 686/1381] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:15:01.016614 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8da535-e638-47a4-98eb-1536a283b3cc None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:15:01.018542 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-df8da535-e638-47a4-98eb-1536a283b3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:01.171261 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:01.185548 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8da535-e638-47a4-98eb-1536a283b3cc None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:15:01.308929 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a3f41a-2f9c-4c8b-aaec-788cb27d3277 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:15:01.309703 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3f41a-2f9c-4c8b-aaec-788cb27d3277 service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:01.310243 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3f41a-2f9c-4c8b-aaec-788cb27d3277 service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:01.310609 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a3f41a-2f9c-4c8b-aaec-788cb27d3277 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:01.312715 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d8a3f41a-2f9c-4c8b-aaec-788cb27d3277 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:01.416012 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3f41a-2f9c-4c8b-aaec-788cb27d3277 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:15:01.417916 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a3f41a-2f9c-4c8b-aaec-788cb27d3277 service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:15:01.428160 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:01.436506 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 696/1382] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:15:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:15:03.763254 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f6965-7810-448b-8bf7-fcde02cd4410 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:03.763832 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f6965-7810-448b-8bf7-fcde02cd4410 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:03.763832 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f6965-7810-448b-8bf7-fcde02cd4410 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:03.765163 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 687/1383] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:15:03.771594 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2ebab-ede7-45c7-a1d8-2157c42ff125 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:03.772085 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2ebab-ede7-45c7-a1d8-2157c42ff125 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:03.772299 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c2ebab-ede7-45c7-a1d8-2157c42ff125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:03.847114 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-60c2ebab-ede7-45c7-a1d8-2157c42ff125 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:15:03.848853 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-60c2ebab-ede7-45c7-a1d8-2157c42ff125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:03.955362 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 697/1384] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:15:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:15:04.261541 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f6965-7810-448b-8bf7-fcde02cd4410 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:15:04.263107 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b92f6965-7810-448b-8bf7-fcde02cd4410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:04.351249 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:04.413467 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f6965-7810-448b-8bf7-fcde02cd4410 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:15:04.538962 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cbc6e1-03bc-421f-b991-e94394af0191 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:15:04.539576 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbc6e1-03bc-421f-b991-e94394af0191 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:04.539854 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbc6e1-03bc-421f-b991-e94394af0191 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:04.540161 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbc6e1-03bc-421f-b991-e94394af0191 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:04.541753 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-11cbc6e1-03bc-421f-b991-e94394af0191 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:04.604848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:04.656925 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbc6e1-03bc-421f-b991-e94394af0191 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:15:04.659261 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cbc6e1-03bc-421f-b991-e94394af0191 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:15:04.683834 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 688/1385] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:15:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:15:06.954669 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9eeb57-2b4b-4667-b0fe-472f7b1d2c50 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:06.955271 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9eeb57-2b4b-4667-b0fe-472f7b1d2c50 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:06.955271 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9eeb57-2b4b-4667-b0fe-472f7b1d2c50 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:06.956640 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 698/1386] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:15:06.962268 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f627a22-bb2e-4a80-835d-aebe49021e07 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:06.962777 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f627a22-bb2e-4a80-835d-aebe49021e07 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:06.962887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f627a22-bb2e-4a80-835d-aebe49021e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:07.030708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-1f627a22-bb2e-4a80-835d-aebe49021e07 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:15:07.031937 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1f627a22-bb2e-4a80-835d-aebe49021e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:07.165344 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 689/1387] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:15:07.456323 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9eeb57-2b4b-4667-b0fe-472f7b1d2c50 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:15:07.457827 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5f9eeb57-2b4b-4667-b0fe-472f7b1d2c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:07.554950 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:07.630517 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9eeb57-2b4b-4667-b0fe-472f7b1d2c50 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:15:07.750521 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97655592-8638-4a23-bac5-b9f09cc31ed0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:15:07.750521 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97655592-8638-4a23-bac5-b9f09cc31ed0 service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:07.750521 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97655592-8638-4a23-bac5-b9f09cc31ed0 service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:07.750521 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97655592-8638-4a23-bac5-b9f09cc31ed0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:07.751056 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-97655592-8638-4a23-bac5-b9f09cc31ed0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:07.788231 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:07.840910 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97655592-8638-4a23-bac5-b9f09cc31ed0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:15:07.842531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97655592-8638-4a23-bac5-b9f09cc31ed0 service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:15:07.861354 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 699/1388] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:15:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:15:08.477622 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196411c-d002-4ec1-aa00-7d81b356000d None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:08.478190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196411c-d002-4ec1-aa00-7d81b356000d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:08.478190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9196411c-d002-4ec1-aa00-7d81b356000d None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:08.479488 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 690/1389] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:15:08.484944 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e41fe9-2c2e-4a22-a56a-478149baccdd None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:08.485421 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e41fe9-2c2e-4a22-a56a-478149baccdd None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:08.485637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e41fe9-2c2e-4a22-a56a-478149baccdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:08.553431 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-75e41fe9-2c2e-4a22-a56a-478149baccdd None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:15:08.554639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-75e41fe9-2c2e-4a22-a56a-478149baccdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:08.664338 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 700/1390] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:15:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:15:08.971856 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c294d-359a-41bd-ae78-290526b59be9 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:08.972165 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c294d-359a-41bd-ae78-290526b59be9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:08.972444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c294d-359a-41bd-ae78-290526b59be9 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:08.974406 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 691/1391] 10.222.0.81 () {54 vars in 961 bytes} [Tue Sep 6 21:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:15:08.981238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6c37c-1fbc-4b3d-bdf4-9ff7ac75e909 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:08.981552 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6c37c-1fbc-4b3d-bdf4-9ff7ac75e909 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:08.981987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd6c37c-1fbc-4b3d-bdf4-9ff7ac75e909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:08.998270 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:09.059999 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-4fd6c37c-1fbc-4b3d-bdf4-9ff7ac75e909 None None] MFA Rules not processed for user `c2ba30d9c40641bf8abb580a219b5352`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:15:09.061355 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4fd6c37c-1fbc-4b3d-bdf4-9ff7ac75e909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:09.138350 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 701/1392] 10.222.0.81 () {58 vars in 1058 bytes} [Tue Sep 6 21:15:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:15:09.147887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c294d-359a-41bd-ae78-290526b59be9 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:15:09.149513 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9c2c294d-359a-41bd-ae78-290526b59be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:09.181570 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:09.259069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c294d-359a-41bd-ae78-290526b59be9 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:15:09.334836 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78d29b-d8fa-4dc4-aefb-617b61b52542 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ba30d9c40641bf8abb580a219b5352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:15:09.335450 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78d29b-d8fa-4dc4-aefb-617b61b52542 service glance] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:09.335732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78d29b-d8fa-4dc4-aefb-617b61b52542 service glance] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:09.336004 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78d29b-d8fa-4dc4-aefb-617b61b52542 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:09.337637 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3b78d29b-d8fa-4dc4-aefb-617b61b52542 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:09.417047 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:09.450337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78d29b-d8fa-4dc4-aefb-617b61b52542 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:15:09.451757 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78d29b-d8fa-4dc4-aefb-617b61b52542 service glance] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:15:09.469450 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 692/1393] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:15:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:15:10.187394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a83fbf-2c79-4320-a35c-769a72b06cb2 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:10.187975 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a83fbf-2c79-4320-a35c-769a72b06cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:10.187975 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a83fbf-2c79-4320-a35c-769a72b06cb2 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:10.189586 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 702/1394] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:15:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:15:10.195269 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cce1c-30d3-4de2-bdef-8342d6c3ac70 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:10.197440 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cce1c-30d3-4de2-bdef-8342d6c3ac70 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:10.197440 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cce1c-30d3-4de2-bdef-8342d6c3ac70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:10.271541 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-823cce1c-30d3-4de2-bdef-8342d6c3ac70 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:15:10.272786 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-823cce1c-30d3-4de2-bdef-8342d6c3ac70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:10.383578 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122fd7e-bc86-419a-9174-4addde543bb1 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:10.383863 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122fd7e-bc86-419a-9174-4addde543bb1 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:10.384153 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122fd7e-bc86-419a-9174-4addde543bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:10.389489 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 693/1395] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:15:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:15:10.456999 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-2122fd7e-bc86-419a-9174-4addde543bb1 None None] MFA Rules not processed for user `0ba7376671a24d35a920e0ec3290472b`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:15:10.458179 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-2122fd7e-bc86-419a-9174-4addde543bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:10.517290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:10.548715 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 703/1396] 10.222.0.81 () {58 vars in 1009 bytes} [Tue Sep 6 21:15:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:15:10.600737 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a6e1b-5162-444d-ac3f-94cc1ba09615 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:10.601058 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a6e1b-5162-444d-ac3f-94cc1ba09615 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:10.601305 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a6e1b-5162-444d-ac3f-94cc1ba09615 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:10.602867 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 694/1397] 10.222.0.81 () {54 vars in 943 bytes} [Tue Sep 6 21:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:15:10.615700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50196b1-70eb-44b5-a6ad-003312470e58 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:10.615997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50196b1-70eb-44b5-a6ad-003312470e58 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:10.616350 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50196b1-70eb-44b5-a6ad-003312470e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:10.697642 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a6e1b-5162-444d-ac3f-94cc1ba09615 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:15:10.699373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a82a6e1b-5162-444d-ac3f-94cc1ba09615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:10.706225 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c50196b1-70eb-44b5-a6ad-003312470e58 None None] MFA Rules not processed for user `cf0aac45d8b549afafae0a3f623bce46`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:15:10.707522 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c50196b1-70eb-44b5-a6ad-003312470e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:10.742392 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:10.878031 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a6e1b-5162-444d-ac3f-94cc1ba09615 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:15:10.893840 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 704/1398] 10.222.0.81 () {58 vars in 1040 bytes} [Tue Sep 6 21:15:10 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:15:10.903702 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50196b1-70eb-44b5-a6ad-003312470e58 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:15:10.913452 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50196b1-70eb-44b5-a6ad-003312470e58 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:15:10.939703 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:10.996919 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:10.999799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93859a3-c70e-4182-b263-196bab26f704 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:15:11.001107 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93859a3-c70e-4182-b263-196bab26f704 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:11.001107 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93859a3-c70e-4182-b263-196bab26f704 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:11.001107 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93859a3-c70e-4182-b263-196bab26f704 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:11.014487 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a93859a3-c70e-4182-b263-196bab26f704 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:11.022111 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc3501-b70f-4618-b7e3-6c7cd9267b1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0aac45d8b549afafae0a3f623bce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:15:11.022724 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc3501-b70f-4618-b7e3-6c7cd9267b1b service swift] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:11.023003 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc3501-b70f-4618-b7e3-6c7cd9267b1b service swift] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:11.023281 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc3501-b70f-4618-b7e3-6c7cd9267b1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:11.024979 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8bdc3501-b70f-4618-b7e3-6c7cd9267b1b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:11.096048 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93859a3-c70e-4182-b263-196bab26f704 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:15:11.098246 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93859a3-c70e-4182-b263-196bab26f704 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:15:11.111918 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc3501-b70f-4618-b7e3-6c7cd9267b1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:15:11.114119 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc3501-b70f-4618-b7e3-6c7cd9267b1b service swift] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:15:11.117762 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 695/1399] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:15:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:15:11.122381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 705/1400] 10.222.0.81 () {60 vars in 1384 bytes} [Tue Sep 6 21:15:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 21:15:13.572972 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd8466-f776-4e8a-8805-56ebd464a186 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:13.573575 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd8466-f776-4e8a-8805-56ebd464a186 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:13.573575 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd8466-f776-4e8a-8805-56ebd464a186 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:13.574861 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 696/1401] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:15:13.580415 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1e3ed-1067-4714-908e-0509af3c7e73 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:13.580862 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1e3ed-1067-4714-908e-0509af3c7e73 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:13.581151 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff1e3ed-1067-4714-908e-0509af3c7e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:13.661609 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-bff1e3ed-1067-4714-908e-0509af3c7e73 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:15:13.663135 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-bff1e3ed-1067-4714-908e-0509af3c7e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:13.670542 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:13.770738 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 706/1402] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:15:14.064417 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd8466-f776-4e8a-8805-56ebd464a186 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:15:14.065991 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-efbd8466-f776-4e8a-8805-56ebd464a186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:14.202303 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:14.238033 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd8466-f776-4e8a-8805-56ebd464a186 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:15:14.371202 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1595900a-e8f5-4a6c-9f61-132b720dc5e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:15:14.371892 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595900a-e8f5-4a6c-9f61-132b720dc5e3 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:14.372256 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595900a-e8f5-4a6c-9f61-132b720dc5e3 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:14.372588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1595900a-e8f5-4a6c-9f61-132b720dc5e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:14.374257 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1595900a-e8f5-4a6c-9f61-132b720dc5e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:14.465500 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:14.477629 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595900a-e8f5-4a6c-9f61-132b720dc5e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:15:14.479365 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1595900a-e8f5-4a6c-9f61-132b720dc5e3 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:15:14.501449 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 697/1403] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:15:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:15:16.870014 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23366fb3-a244-4433-baa5-8de2a2833b29 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:16.870587 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23366fb3-a244-4433-baa5-8de2a2833b29 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:16.870587 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23366fb3-a244-4433-baa5-8de2a2833b29 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:16.872058 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 707/1404] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:15:16.877418 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f1e9b-0560-4cb2-beca-9963b4a70d37 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:16.877846 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f1e9b-0560-4cb2-beca-9963b4a70d37 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:16.878088 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f1e9b-0560-4cb2-beca-9963b4a70d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:16.952799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-c01f1e9b-0560-4cb2-beca-9963b4a70d37 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:15:16.954400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c01f1e9b-0560-4cb2-beca-9963b4a70d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:17.064168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 698/1405] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:15:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:15:17.354980 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23366fb3-a244-4433-baa5-8de2a2833b29 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:15:17.356624 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-23366fb3-a244-4433-baa5-8de2a2833b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:17.514335 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:17.525148 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23366fb3-a244-4433-baa5-8de2a2833b29 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:15:17.651306 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0451033-ea6e-4ccf-8d52-9903cb8cbd6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:15:17.651985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0451033-ea6e-4ccf-8d52-9903cb8cbd6f service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:17.652403 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0451033-ea6e-4ccf-8d52-9903cb8cbd6f service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:17.652768 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0451033-ea6e-4ccf-8d52-9903cb8cbd6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:17.654576 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e0451033-ea6e-4ccf-8d52-9903cb8cbd6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:17.755214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0451033-ea6e-4ccf-8d52-9903cb8cbd6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:15:17.756998 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0451033-ea6e-4ccf-8d52-9903cb8cbd6f service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:15:17.770423 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:17.779892 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 708/1406] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:15:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:15:20.150314 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496808f-632a-4771-9d6e-08f70fb2f136 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:20.150843 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496808f-632a-4771-9d6e-08f70fb2f136 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:20.150843 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496808f-632a-4771-9d6e-08f70fb2f136 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:20.153190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 699/1407] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:15:20.157612 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed45ce0-40c1-447e-ac83-6ad5282276c6 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:20.158128 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed45ce0-40c1-447e-ac83-6ad5282276c6 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:20.158128 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed45ce0-40c1-447e-ac83-6ad5282276c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:20.227888 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-4ed45ce0-40c1-447e-ac83-6ad5282276c6 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:15:20.229229 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4ed45ce0-40c1-447e-ac83-6ad5282276c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:20.334814 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 709/1408] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:15:20.626502 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496808f-632a-4771-9d6e-08f70fb2f136 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:15:20.628049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3496808f-632a-4771-9d6e-08f70fb2f136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:20.704737 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:20.797906 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496808f-632a-4771-9d6e-08f70fb2f136 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:15:20.932401 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ec503a-f23b-4f8e-b7cf-865f82160f16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:15:20.932995 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec503a-f23b-4f8e-b7cf-865f82160f16 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:20.933294 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec503a-f23b-4f8e-b7cf-865f82160f16 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:20.933565 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ec503a-f23b-4f8e-b7cf-865f82160f16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:20.935227 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-40ec503a-f23b-4f8e-b7cf-865f82160f16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:20.963211 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:21.043908 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec503a-f23b-4f8e-b7cf-865f82160f16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:15:21.045739 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ec503a-f23b-4f8e-b7cf-865f82160f16 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:15:21.067351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 700/1409] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:15:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:15:30.333344 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=67 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:31.063886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=35 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:35.853499 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001278c7-60b2-4cff-ba70-9c0ef8bb16ac None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:35.854085 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001278c7-60b2-4cff-ba70-9c0ef8bb16ac None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:35.854085 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001278c7-60b2-4cff-ba70-9c0ef8bb16ac None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:35.855382 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 710/1410] 10.222.0.81 () {54 vars in 918 bytes} [Tue Sep 6 21:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:15:35.860547 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f478cd-baee-4c5c-bcbd-854f4fc12ca8 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:35.860991 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f478cd-baee-4c5c-bcbd-854f4fc12ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:35.861097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f478cd-baee-4c5c-bcbd-854f4fc12ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:35.936491 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-34f478cd-baee-4c5c-bcbd-854f4fc12ca8 None None] MFA Rules not processed for user `c3295306746f4552837f1bb12b2c500f`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:15:35.937681 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-34f478cd-baee-4c5c-bcbd-854f4fc12ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:36.053175 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 701/1411] 10.222.0.81 () {58 vars in 1015 bytes} [Tue Sep 6 21:15:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:15:36.067476 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd8b29-1dca-417b-8554-170744f9e255 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:36.067764 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd8b29-1dca-417b-8554-170744f9e255 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:36.068044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd8b29-1dca-417b-8554-170744f9e255 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:36.069411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 711/1412] 10.222.0.81 () {54 vars in 918 bytes} [Tue Sep 6 21:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:15:36.074554 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edae96b-4ad7-44a8-9ed8-639097cd5fdc None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:36.074843 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edae96b-4ad7-44a8-9ed8-639097cd5fdc None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:36.075636 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edae96b-4ad7-44a8-9ed8-639097cd5fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:36.149438 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:36.151974 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-5edae96b-4ad7-44a8-9ed8-639097cd5fdc None None] MFA Rules not processed for user `4441d8fea57f401a96fb8cbd2b501059`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:15:36.153224 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5edae96b-4ad7-44a8-9ed8-639097cd5fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:36.270669 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 702/1413] 10.222.0.81 () {58 vars in 1015 bytes} [Tue Sep 6 21:15:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:15:38.850052 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9522c55-d30d-4ac1-80ec-6f694aeba424 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:38.850636 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9522c55-d30d-4ac1-80ec-6f694aeba424 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:38.850636 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9522c55-d30d-4ac1-80ec-6f694aeba424 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:38.851976 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 712/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 21:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:15:38.857562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029727b-14d3-4440-89f1-8282e17b4e3f None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:38.858021 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029727b-14d3-4440-89f1-8282e17b4e3f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:38.858128 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029727b-14d3-4440-89f1-8282e17b4e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:38.925286 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-c029727b-14d3-4440-89f1-8282e17b4e3f None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:15:38.927005 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c029727b-14d3-4440-89f1-8282e17b4e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:38.980586 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:39.021481 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 703/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 21:15:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:15:39.315428 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9522c55-d30d-4ac1-80ec-6f694aeba424 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:15:39.317000 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e9522c55-d30d-4ac1-80ec-6f694aeba424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:39.463698 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9522c55-d30d-4ac1-80ec-6f694aeba424 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:15:39.537418 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:39.579044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650161c-b362-4e30-8848-341475c4fe92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:15:39.579870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650161c-b362-4e30-8848-341475c4fe92 service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:39.580178 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650161c-b362-4e30-8848-341475c4fe92 service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:39.580458 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650161c-b362-4e30-8848-341475c4fe92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:39.582120 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-0650161c-b362-4e30-8848-341475c4fe92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:39.672371 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0650161c-b362-4e30-8848-341475c4fe92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:15:39.674001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0650161c-b362-4e30-8848-341475c4fe92 service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:15:39.691652 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 713/1416] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:15:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:15:40.842842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac0859-e6f3-4771-bcce-afc48abe2d02 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:40.843395 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac0859-e6f3-4771-bcce-afc48abe2d02 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:40.843518 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac0859-e6f3-4771-bcce-afc48abe2d02 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:40.844827 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 704/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 21:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:15:40.851758 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d23b96-3143-476e-9c29-a6384655dd6b None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:40.852232 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d23b96-3143-476e-9c29-a6384655dd6b None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:40.852352 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d23b96-3143-476e-9c29-a6384655dd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:40.929381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-d9d23b96-3143-476e-9c29-a6384655dd6b None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:15:40.930610 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d9d23b96-3143-476e-9c29-a6384655dd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:40.962113 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:41.030822 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 714/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 21:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:15:41.179838 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac0859-e6f3-4771-bcce-afc48abe2d02 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:15:41.181417 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4eac0859-e6f3-4771-bcce-afc48abe2d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:41.326965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac0859-e6f3-4771-bcce-afc48abe2d02 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:15:41.367269 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:41.440428 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bfd22d-4359-41c2-b1fe-2e2d5f94d454 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:15:41.441040 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfd22d-4359-41c2-b1fe-2e2d5f94d454 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:41.441340 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfd22d-4359-41c2-b1fe-2e2d5f94d454 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:41.441620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bfd22d-4359-41c2-b1fe-2e2d5f94d454 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:41.443235 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-44bfd22d-4359-41c2-b1fe-2e2d5f94d454 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:41.650177 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bfd22d-4359-41c2-b1fe-2e2d5f94d454 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:15:41.651673 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bfd22d-4359-41c2-b1fe-2e2d5f94d454 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:15:41.669940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 705/1419] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:15:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:15:42.795413 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fe32a-a85b-4411-8912-a52e89351734 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:42.795947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fe32a-a85b-4411-8912-a52e89351734 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:42.795947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73fe32a-a85b-4411-8912-a52e89351734 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:42.797320 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 715/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 21:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:15:42.804982 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c36c25-7399-4db3-b367-7384680b5788 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:42.805429 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c36c25-7399-4db3-b367-7384680b5788 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:42.805539 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c36c25-7399-4db3-b367-7384680b5788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:42.859485 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:42.882333 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f7c36c25-7399-4db3-b367-7384680b5788 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:15:42.883561 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f7c36c25-7399-4db3-b367-7384680b5788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:42.978238 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 706/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 21:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:15:43.133571 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fe32a-a85b-4411-8912-a52e89351734 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:15:43.135121 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c73fe32a-a85b-4411-8912-a52e89351734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:43.281903 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73fe32a-a85b-4411-8912-a52e89351734 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:15:43.294931 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:43.398441 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304a6a7-c801-4c30-8cfb-7cde6654661c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:15:43.398689 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304a6a7-c801-4c30-8cfb-7cde6654661c service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:43.398829 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304a6a7-c801-4c30-8cfb-7cde6654661c service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:43.399672 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304a6a7-c801-4c30-8cfb-7cde6654661c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:43.400928 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8304a6a7-c801-4c30-8cfb-7cde6654661c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:43.494003 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8304a6a7-c801-4c30-8cfb-7cde6654661c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:15:43.495611 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8304a6a7-c801-4c30-8cfb-7cde6654661c service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:15:43.513677 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 716/1422] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:15:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:15:44.636493 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543efa8a-b262-4cd6-9ce0-608d5a76cb99 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:44.637098 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543efa8a-b262-4cd6-9ce0-608d5a76cb99 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:44.637098 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543efa8a-b262-4cd6-9ce0-608d5a76cb99 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:44.638393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 707/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 21:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:15:44.647087 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5afd10-18da-467b-a46b-d1e24696524e None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:44.647589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5afd10-18da-467b-a46b-d1e24696524e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:44.647699 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5afd10-18da-467b-a46b-d1e24696524e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:44.670992 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:44.729389 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-1b5afd10-18da-467b-a46b-d1e24696524e None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:15:44.730625 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1b5afd10-18da-467b-a46b-d1e24696524e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:44.833721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 717/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 21:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:15:44.989726 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543efa8a-b262-4cd6-9ce0-608d5a76cb99 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:15:44.991223 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-543efa8a-b262-4cd6-9ce0-608d5a76cb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:45.105361 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:45.143061 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543efa8a-b262-4cd6-9ce0-608d5a76cb99 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:15:45.259975 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593241f-ead5-4128-9431-6ddc9e101cc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:15:45.260528 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593241f-ead5-4128-9431-6ddc9e101cc7 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:45.260810 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593241f-ead5-4128-9431-6ddc9e101cc7 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:45.261084 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593241f-ead5-4128-9431-6ddc9e101cc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:45.262681 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b593241f-ead5-4128-9431-6ddc9e101cc7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:45.348843 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:45.362032 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593241f-ead5-4128-9431-6ddc9e101cc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:15:45.364223 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593241f-ead5-4128-9431-6ddc9e101cc7 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:15:45.381960 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 708/1425] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:15:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:15:46.497797 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118f8d9-62b2-49e1-ab0b-16c5c06f7c1c None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:46.498339 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118f8d9-62b2-49e1-ab0b-16c5c06f7c1c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:46.498339 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118f8d9-62b2-49e1-ab0b-16c5c06f7c1c None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:46.499678 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 718/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 21:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:15:46.506403 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849751f8-22d0-4585-80ee-e2da6f88c2a3 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:46.506861 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849751f8-22d0-4585-80ee-e2da6f88c2a3 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:46.506973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849751f8-22d0-4585-80ee-e2da6f88c2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:46.590093 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-849751f8-22d0-4585-80ee-e2da6f88c2a3 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:15:46.591289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-849751f8-22d0-4585-80ee-e2da6f88c2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:46.689585 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 709/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 21:15:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:15:46.841677 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118f8d9-62b2-49e1-ab0b-16c5c06f7c1c None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:15:46.843210 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-0118f8d9-62b2-49e1-ab0b-16c5c06f7c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:46.927851 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:46.989853 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0118f8d9-62b2-49e1-ab0b-16c5c06f7c1c None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:15:47.100526 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4073cf3-75fc-4c62-880a-f530359879c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:15:47.101044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4073cf3-75fc-4c62-880a-f530359879c7 service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:47.101324 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4073cf3-75fc-4c62-880a-f530359879c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:47.101598 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4073cf3-75fc-4c62-880a-f530359879c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:47.103194 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e4073cf3-75fc-4c62-880a-f530359879c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:47.150954 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:47.193584 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4073cf3-75fc-4c62-880a-f530359879c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:15:47.195182 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4073cf3-75fc-4c62-880a-f530359879c7 service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:15:47.212640 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 719/1428] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:15:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:15:48.323802 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1383e4d-9f41-4ef5-aaa3-6ba4971a05ee None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:48.324452 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1383e4d-9f41-4ef5-aaa3-6ba4971a05ee None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:48.324452 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1383e4d-9f41-4ef5-aaa3-6ba4971a05ee None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:48.325723 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 710/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 21:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:15:48.332865 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a13292-c328-441c-92c9-6c137a33fe09 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:48.333329 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a13292-c328-441c-92c9-6c137a33fe09 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:48.333439 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a13292-c328-441c-92c9-6c137a33fe09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:48.409787 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-43a13292-c328-441c-92c9-6c137a33fe09 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:15:48.411009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-43a13292-c328-441c-92c9-6c137a33fe09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:48.506826 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 720/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 21:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:15:48.658114 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1383e4d-9f41-4ef5-aaa3-6ba4971a05ee None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:15:48.659774 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e1383e4d-9f41-4ef5-aaa3-6ba4971a05ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:48.709803 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:48.811081 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1383e4d-9f41-4ef5-aaa3-6ba4971a05ee None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:15:48.926903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033605b1-0b7f-43ee-a9cd-3a5e5c22c28c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:15:48.927432 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033605b1-0b7f-43ee-a9cd-3a5e5c22c28c service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:48.927712 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033605b1-0b7f-43ee-a9cd-3a5e5c22c28c service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:48.927984 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033605b1-0b7f-43ee-a9cd-3a5e5c22c28c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:48.929606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-033605b1-0b7f-43ee-a9cd-3a5e5c22c28c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:48.936678 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:49.018796 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033605b1-0b7f-43ee-a9cd-3a5e5c22c28c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:15:49.020474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033605b1-0b7f-43ee-a9cd-3a5e5c22c28c service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:15:49.038265 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 711/1431] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:15:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:15:50.160473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c6088-b0ae-4a97-802a-1d87f7d261ad None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:50.161068 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c6088-b0ae-4a97-802a-1d87f7d261ad None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:50.161068 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c6088-b0ae-4a97-802a-1d87f7d261ad None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:50.162377 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 721/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 21:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:15:50.169187 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cacde7-e9ef-4443-9321-3b5fe0c00fc9 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:50.169622 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cacde7-e9ef-4443-9321-3b5fe0c00fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:50.169739 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cacde7-e9ef-4443-9321-3b5fe0c00fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:50.246234 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-97cacde7-e9ef-4443-9321-3b5fe0c00fc9 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:15:50.247438 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-97cacde7-e9ef-4443-9321-3b5fe0c00fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:50.315983 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:50.345295 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 712/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 21:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:15:50.498670 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c6088-b0ae-4a97-802a-1d87f7d261ad None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:15:50.500125 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6c2c6088-b0ae-4a97-802a-1d87f7d261ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:50.517886 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:50.651571 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c6088-b0ae-4a97-802a-1d87f7d261ad None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:15:50.739234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:50.765847 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee31fd-285a-442e-84ec-d0922ecc9641 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:15:50.766407 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee31fd-285a-442e-84ec-d0922ecc9641 service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:50.766725 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee31fd-285a-442e-84ec-d0922ecc9641 service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:50.767058 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee31fd-285a-442e-84ec-d0922ecc9641 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:50.768763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-38ee31fd-285a-442e-84ec-d0922ecc9641 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:50.862564 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee31fd-285a-442e-84ec-d0922ecc9641 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:15:50.864739 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee31fd-285a-442e-84ec-d0922ecc9641 service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:15:50.884519 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 722/1434] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:15:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:15:52.013698 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e09e12-d80e-47f9-93ee-b3ff689b4672 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:52.014286 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e09e12-d80e-47f9-93ee-b3ff689b4672 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:52.014286 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e09e12-d80e-47f9-93ee-b3ff689b4672 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:52.015617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 713/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 21:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:15:52.022784 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea03a2-ba40-4945-a355-71a7b8ae36fa None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:52.023314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea03a2-ba40-4945-a355-71a7b8ae36fa None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:52.023314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea03a2-ba40-4945-a355-71a7b8ae36fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:52.098799 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-3eea03a2-ba40-4945-a355-71a7b8ae36fa None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:15:52.100021 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-3eea03a2-ba40-4945-a355-71a7b8ae36fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:52.146210 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:52.201381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 723/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 21:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:15:52.351215 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e09e12-d80e-47f9-93ee-b3ff689b4672 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:15:52.352746 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-67e09e12-d80e-47f9-93ee-b3ff689b4672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:52.499661 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e09e12-d80e-47f9-93ee-b3ff689b4672 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:15:52.554282 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:52.612706 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1f1583-3343-49be-bf0a-7ba7a31fe1c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:15:52.613833 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f1583-3343-49be-bf0a-7ba7a31fe1c3 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:52.614111 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f1583-3343-49be-bf0a-7ba7a31fe1c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:52.614438 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1f1583-3343-49be-bf0a-7ba7a31fe1c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:52.616042 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3c1f1583-3343-49be-bf0a-7ba7a31fe1c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:52.705562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f1583-3343-49be-bf0a-7ba7a31fe1c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:15:52.707190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1f1583-3343-49be-bf0a-7ba7a31fe1c3 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:15:52.726081 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 714/1437] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:15:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:15:53.908641 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a021b34-c7e2-4f46-ada6-121be56b94a0 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:53.909217 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a021b34-c7e2-4f46-ada6-121be56b94a0 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:53.909217 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a021b34-c7e2-4f46-ada6-121be56b94a0 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:53.910507 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 724/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 21:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:15:53.917514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cb2b2-7cb2-4650-8a05-4fe65c3859de None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:53.918018 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cb2b2-7cb2-4650-8a05-4fe65c3859de None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:53.918122 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cb2b2-7cb2-4650-8a05-4fe65c3859de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:53.995053 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-9b4cb2b2-7cb2-4650-8a05-4fe65c3859de None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:15:53.996305 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9b4cb2b2-7cb2-4650-8a05-4fe65c3859de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:53.998399 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:54.096220 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 715/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 21:15:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:15:54.246554 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a021b34-c7e2-4f46-ada6-121be56b94a0 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:15:54.247998 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-9a021b34-c7e2-4f46-ada6-121be56b94a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:54.401622 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a021b34-c7e2-4f46-ada6-121be56b94a0 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:15:54.429476 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:54.516703 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faca790d-6e03-45ba-af8b-ed43572f3ae9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:15:54.517224 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca790d-6e03-45ba-af8b-ed43572f3ae9 service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:54.517505 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca790d-6e03-45ba-af8b-ed43572f3ae9 service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:54.517776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faca790d-6e03-45ba-af8b-ed43572f3ae9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:54.519430 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-faca790d-6e03-45ba-af8b-ed43572f3ae9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:54.612254 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca790d-6e03-45ba-af8b-ed43572f3ae9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:15:54.614441 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faca790d-6e03-45ba-af8b-ed43572f3ae9 service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:15:54.633034 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 725/1440] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:15:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:15:56.708840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af2357-7d8d-4e05-b852-de21f8ab624b None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:56.709420 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af2357-7d8d-4e05-b852-de21f8ab624b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:56.709420 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af2357-7d8d-4e05-b852-de21f8ab624b None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:56.710724 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 716/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 21:15:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:15:56.716168 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b160e9e-534d-4fad-8102-241d99936a79 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:56.716591 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b160e9e-534d-4fad-8102-241d99936a79 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:56.716741 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b160e9e-534d-4fad-8102-241d99936a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:56.763798 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:56.784023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-1b160e9e-534d-4fad-8102-241d99936a79 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:15:56.788558 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1b160e9e-534d-4fad-8102-241d99936a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:56.888885 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 726/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 21:15:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:15:57.172125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af2357-7d8d-4e05-b852-de21f8ab624b None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:15:57.173653 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-04af2357-7d8d-4e05-b852-de21f8ab624b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:57.277125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af2357-7d8d-4e05-b852-de21f8ab624b None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:15:57.310143 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:15:57.351080 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630222a-8370-4a3d-afaf-4715b27908ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:15:57.351680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630222a-8370-4a3d-afaf-4715b27908ec service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:57.351955 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630222a-8370-4a3d-afaf-4715b27908ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:57.352256 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630222a-8370-4a3d-afaf-4715b27908ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:57.353826 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6630222a-8370-4a3d-afaf-4715b27908ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:57.459101 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6630222a-8370-4a3d-afaf-4715b27908ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:15:57.460461 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6630222a-8370-4a3d-afaf-4715b27908ec service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:15:57.478870 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 717/1443] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:15:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:15:59.858520 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dddc77-d123-42c1-82ed-0086c30e1fe4 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:59.859126 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dddc77-d123-42c1-82ed-0086c30e1fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:59.859126 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dddc77-d123-42c1-82ed-0086c30e1fe4 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:59.860438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 727/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 21:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:15:59.866305 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6600e0-ebd2-48cd-b2e2-4e262614f78a None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:15:59.866727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6600e0-ebd2-48cd-b2e2-4e262614f78a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:15:59.866837 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6600e0-ebd2-48cd-b2e2-4e262614f78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:15:59.932562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-5f6600e0-ebd2-48cd-b2e2-4e262614f78a None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:15:59.933775 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5f6600e0-ebd2-48cd-b2e2-4e262614f78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:15:59.947047 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:00.030148 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 718/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 21:15:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:16:00.313548 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dddc77-d123-42c1-82ed-0086c30e1fe4 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:16:00.315077 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-42dddc77-d123-42c1-82ed-0086c30e1fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:00.418758 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dddc77-d123-42c1-82ed-0086c30e1fe4 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:16:00.430678 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:00.493193 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4bd49-da4d-4778-811c-6b5af17e45e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:16:00.493804 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4bd49-da4d-4778-811c-6b5af17e45e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:00.494083 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4bd49-da4d-4778-811c-6b5af17e45e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:00.494355 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4bd49-da4d-4778-811c-6b5af17e45e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:00.495958 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-83d4bd49-da4d-4778-811c-6b5af17e45e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:00.604981 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4bd49-da4d-4778-811c-6b5af17e45e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:16:00.606414 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d4bd49-da4d-4778-811c-6b5af17e45e9 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:16:00.626840 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 728/1446] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:16:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:16:03.150160 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4b80c-e111-49d3-8e09-cf76f1fad983 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:03.150706 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4b80c-e111-49d3-8e09-cf76f1fad983 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:03.150706 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c4b80c-e111-49d3-8e09-cf76f1fad983 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:03.152147 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 719/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 21:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:16:03.157740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43d547-6890-44e4-a6a8-31852cc982d7 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:03.158188 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43d547-6890-44e4-a6a8-31852cc982d7 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:03.158293 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43d547-6890-44e4-a6a8-31852cc982d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:03.206822 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:03.224825 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-fe43d547-6890-44e4-a6a8-31852cc982d7 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:16:03.226291 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-fe43d547-6890-44e4-a6a8-31852cc982d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:03.324018 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 729/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 21:16:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:16:03.614370 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4b80c-e111-49d3-8e09-cf76f1fad983 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:16:03.616055 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c3c4b80c-e111-49d3-8e09-cf76f1fad983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:03.721648 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c4b80c-e111-49d3-8e09-cf76f1fad983 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:16:03.762636 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:03.796677 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e507c5-a781-4052-9844-e6386323d520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:16:03.797291 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e507c5-a781-4052-9844-e6386323d520 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:03.797574 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e507c5-a781-4052-9844-e6386323d520 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:03.797848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e507c5-a781-4052-9844-e6386323d520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:03.799492 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a4e507c5-a781-4052-9844-e6386323d520 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:03.915722 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e507c5-a781-4052-9844-e6386323d520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:16:03.917085 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e507c5-a781-4052-9844-e6386323d520 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:16:03.936247 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 720/1449] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:16:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:16:06.259107 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa471a-c94b-4a7a-9783-8df694fdcb4e None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:06.259701 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa471a-c94b-4a7a-9783-8df694fdcb4e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:06.259701 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa471a-c94b-4a7a-9783-8df694fdcb4e None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:06.261017 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 730/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 21:16:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:16:06.266629 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e5e68-9f07-4a98-a117-f2312e25c96f None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:06.267087 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e5e68-9f07-4a98-a117-f2312e25c96f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:06.267181 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e5e68-9f07-4a98-a117-f2312e25c96f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:06.333080 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-9b5e5e68-9f07-4a98-a117-f2312e25c96f None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:16:06.334280 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9b5e5e68-9f07-4a98-a117-f2312e25c96f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:06.354698 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:06.430690 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 721/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 21:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:16:06.713157 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa471a-c94b-4a7a-9783-8df694fdcb4e None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:16:06.714711 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-90fa471a-c94b-4a7a-9783-8df694fdcb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:06.821214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fa471a-c94b-4a7a-9783-8df694fdcb4e None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:16:06.842571 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:06.906103 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15d74a-6f3c-4268-a40c-caa36db0bcc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:16:06.906722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15d74a-6f3c-4268-a40c-caa36db0bcc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:06.907005 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15d74a-6f3c-4268-a40c-caa36db0bcc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:06.907276 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15d74a-6f3c-4268-a40c-caa36db0bcc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:06.908966 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-fd15d74a-6f3c-4268-a40c-caa36db0bcc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:07.019561 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd15d74a-6f3c-4268-a40c-caa36db0bcc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:16:07.020959 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd15d74a-6f3c-4268-a40c-caa36db0bcc2 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:16:07.038724 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 731/1452] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:16:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:16:09.341618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e0274-ed7c-43df-82df-f0540296e11e None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:09.342159 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e0274-ed7c-43df-82df-f0540296e11e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:09.342159 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6e0274-ed7c-43df-82df-f0540296e11e None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:09.343379 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 722/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 21:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:16:09.349458 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae36e30-83ef-4762-9ab8-d95e1f079ac8 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:09.349919 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae36e30-83ef-4762-9ab8-d95e1f079ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:09.350024 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae36e30-83ef-4762-9ab8-d95e1f079ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:09.415076 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:09.417963 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-6ae36e30-83ef-4762-9ab8-d95e1f079ac8 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:16:09.419210 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6ae36e30-83ef-4762-9ab8-d95e1f079ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:09.632314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 732/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 21:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:16:09.921663 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e0274-ed7c-43df-82df-f0540296e11e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:16:09.923195 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4a6e0274-ed7c-43df-82df-f0540296e11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:10.029374 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6e0274-ed7c-43df-82df-f0540296e11e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:16:10.082444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:10.106554 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96193b8-03cd-4b94-9f96-548f7b4f11f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:16:10.107158 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96193b8-03cd-4b94-9f96-548f7b4f11f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:10.107436 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96193b8-03cd-4b94-9f96-548f7b4f11f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:10.107706 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96193b8-03cd-4b94-9f96-548f7b4f11f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:10.109346 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c96193b8-03cd-4b94-9f96-548f7b4f11f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:10.220318 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96193b8-03cd-4b94-9f96-548f7b4f11f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:16:10.221684 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96193b8-03cd-4b94-9f96-548f7b4f11f0 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:16:10.242768 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 723/1455] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:16:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:16:12.511801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315be11c-6641-48ed-b47c-448e2d007b31 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:12.512408 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315be11c-6641-48ed-b47c-448e2d007b31 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:12.512408 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315be11c-6641-48ed-b47c-448e2d007b31 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:12.513700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 733/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 21:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:16:12.519089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585c2ff-b234-4477-9e20-013e7d0bfb15 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:12.519520 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585c2ff-b234-4477-9e20-013e7d0bfb15 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:12.519636 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7585c2ff-b234-4477-9e20-013e7d0bfb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:12.584545 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-7585c2ff-b234-4477-9e20-013e7d0bfb15 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:16:12.585756 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7585c2ff-b234-4477-9e20-013e7d0bfb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:12.615134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:12.683003 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 724/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 21:16:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:16:12.967614 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315be11c-6641-48ed-b47c-448e2d007b31 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:16:12.969132 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-315be11c-6641-48ed-b47c-448e2d007b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:13.077055 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315be11c-6641-48ed-b47c-448e2d007b31 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:16:13.107956 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:13.153510 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdee929-03aa-42bc-bc98-89301c4c0607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:16:13.154308 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdee929-03aa-42bc-bc98-89301c4c0607 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:13.154586 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdee929-03aa-42bc-bc98-89301c4c0607 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:13.154858 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdee929-03aa-42bc-bc98-89301c4c0607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:13.156687 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-afdee929-03aa-42bc-bc98-89301c4c0607 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:13.268134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdee929-03aa-42bc-bc98-89301c4c0607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:16:13.270119 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdee929-03aa-42bc-bc98-89301c4c0607 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:16:13.289268 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 734/1458] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:16:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:16:15.519177 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45674cd-aa31-48a4-8aba-3be4999e777c None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:15.519719 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45674cd-aa31-48a4-8aba-3be4999e777c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:15.519719 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45674cd-aa31-48a4-8aba-3be4999e777c None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:15.521029 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 725/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 21:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:16:15.526436 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cb2de-66cf-408a-b782-d7a7363aa565 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:15.526907 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cb2de-66cf-408a-b782-d7a7363aa565 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:15.527088 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248cb2de-66cf-408a-b782-d7a7363aa565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:15.594420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-248cb2de-66cf-408a-b782-d7a7363aa565 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:16:15.596075 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-248cb2de-66cf-408a-b782-d7a7363aa565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:15.604623 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:15.694118 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 735/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 21:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:16:15.981245 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45674cd-aa31-48a4-8aba-3be4999e777c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:16:15.982775 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f45674cd-aa31-48a4-8aba-3be4999e777c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:16.086735 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45674cd-aa31-48a4-8aba-3be4999e777c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:16:16.141080 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:16.160408 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08368425-f8d5-416e-9b89-a6a4e1a1ea07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:16:16.161033 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08368425-f8d5-416e-9b89-a6a4e1a1ea07 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:16.161307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08368425-f8d5-416e-9b89-a6a4e1a1ea07 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:16.161575 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08368425-f8d5-416e-9b89-a6a4e1a1ea07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:16.163167 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-08368425-f8d5-416e-9b89-a6a4e1a1ea07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:16.272894 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08368425-f8d5-416e-9b89-a6a4e1a1ea07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:16:16.274316 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08368425-f8d5-416e-9b89-a6a4e1a1ea07 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:16:16.293384 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 726/1461] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:16:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:16:18.485392 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26623d13-83a4-4020-b822-355266327b8a None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:18.485969 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26623d13-83a4-4020-b822-355266327b8a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:18.485969 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26623d13-83a4-4020-b822-355266327b8a None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:18.487279 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 736/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 21:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:16:18.492929 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c359a-90da-4944-b720-0a4b42c26d82 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:18.493384 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c359a-90da-4944-b720-0a4b42c26d82 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:18.493483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c359a-90da-4944-b720-0a4b42c26d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:18.559617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ed0c359a-90da-4944-b720-0a4b42c26d82 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:16:18.560863 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ed0c359a-90da-4944-b720-0a4b42c26d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:18.599564 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:18.657542 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 727/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 21:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:16:18.937470 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26623d13-83a4-4020-b822-355266327b8a None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:16:18.939010 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-26623d13-83a4-4020-b822-355266327b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:19.045322 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26623d13-83a4-4020-b822-355266327b8a None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:16:19.085209 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:19.121570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894de903-3e28-4e42-a553-eaf38cb9873f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:16:19.122173 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894de903-3e28-4e42-a553-eaf38cb9873f service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:19.122448 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894de903-3e28-4e42-a553-eaf38cb9873f service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:19.122716 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894de903-3e28-4e42-a553-eaf38cb9873f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:19.124333 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-894de903-3e28-4e42-a553-eaf38cb9873f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:19.232821 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894de903-3e28-4e42-a553-eaf38cb9873f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:16:19.234207 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894de903-3e28-4e42-a553-eaf38cb9873f service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:16:19.253149 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 737/1464] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:16:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:16:21.430920 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b16470-5eaa-4e1c-bd2e-5cc986f3db63 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:21.431466 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b16470-5eaa-4e1c-bd2e-5cc986f3db63 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:21.431466 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b16470-5eaa-4e1c-bd2e-5cc986f3db63 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:21.432845 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 728/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 21:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:16:21.438186 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa6440-a62b-4e8c-815b-e94bb6b9ce89 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:21.438605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa6440-a62b-4e8c-815b-e94bb6b9ce89 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:21.438739 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa6440-a62b-4e8c-815b-e94bb6b9ce89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:21.503943 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-11fa6440-a62b-4e8c-815b-e94bb6b9ce89 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:16:21.505190 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-11fa6440-a62b-4e8c-815b-e94bb6b9ce89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:21.523456 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:21.602827 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 738/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 21:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:16:21.882085 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b16470-5eaa-4e1c-bd2e-5cc986f3db63 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:16:21.883630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-65b16470-5eaa-4e1c-bd2e-5cc986f3db63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:21.985189 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b16470-5eaa-4e1c-bd2e-5cc986f3db63 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:16:22.052751 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:22.059551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f92166-cbb1-45d7-ab8c-273fe995edf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:16:22.060188 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f92166-cbb1-45d7-ab8c-273fe995edf5 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:22.063173 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f92166-cbb1-45d7-ab8c-273fe995edf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:22.063173 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f92166-cbb1-45d7-ab8c-273fe995edf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:22.063173 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-65f92166-cbb1-45d7-ab8c-273fe995edf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:22.171430 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f92166-cbb1-45d7-ab8c-273fe995edf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:16:22.172814 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f92166-cbb1-45d7-ab8c-273fe995edf5 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:16:22.191033 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 729/1467] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:16:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:16:24.386188 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80fc4f-750d-4f71-8364-cf6169f8f2b4 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:24.386802 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80fc4f-750d-4f71-8364-cf6169f8f2b4 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:24.386802 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80fc4f-750d-4f71-8364-cf6169f8f2b4 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:24.388187 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 739/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 21:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:16:24.393493 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d519f2-b7e3-4042-9f4b-996d806432ff None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:24.393919 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d519f2-b7e3-4042-9f4b-996d806432ff None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:24.394053 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d519f2-b7e3-4042-9f4b-996d806432ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:24.459790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-01d519f2-b7e3-4042-9f4b-996d806432ff None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:16:24.461032 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-01d519f2-b7e3-4042-9f4b-996d806432ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:24.509615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:24.557370 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 730/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 21:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:16:24.839565 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80fc4f-750d-4f71-8364-cf6169f8f2b4 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:16:24.841404 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-bb80fc4f-750d-4f71-8364-cf6169f8f2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:24.944735 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80fc4f-750d-4f71-8364-cf6169f8f2b4 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:16:24.992828 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:25.019653 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458c31b4-cd1d-4847-82ea-238f65593d80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:16:25.020297 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c31b4-cd1d-4847-82ea-238f65593d80 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:25.020580 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c31b4-cd1d-4847-82ea-238f65593d80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:25.020854 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458c31b4-cd1d-4847-82ea-238f65593d80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:25.023210 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-458c31b4-cd1d-4847-82ea-238f65593d80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:25.139049 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c31b4-cd1d-4847-82ea-238f65593d80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:16:25.140421 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458c31b4-cd1d-4847-82ea-238f65593d80 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:16:25.158560 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 740/1470] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:16:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:16:34.555758 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=22 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:35.156323 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=66 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:45.191692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025526a3-507d-4702-a572-b5fd04cbcfff None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:45.192264 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025526a3-507d-4702-a572-b5fd04cbcfff None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:45.192264 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025526a3-507d-4702-a572-b5fd04cbcfff None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:45.193666 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 731/1471] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:16:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:16:45.199031 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2596cc1-88ce-42f3-8559-b75adaaf8eb3 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:45.199464 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2596cc1-88ce-42f3-8559-b75adaaf8eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:45.199625 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2596cc1-88ce-42f3-8559-b75adaaf8eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:45.276266 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c2596cc1-88ce-42f3-8559-b75adaaf8eb3 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:16:45.277484 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c2596cc1-88ce-42f3-8559-b75adaaf8eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:45.375987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 741/1472] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:16:45.677846 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a645d-4ce2-4879-986b-fa8819e41463 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:45.678136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a645d-4ce2-4879-986b-fa8819e41463 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:45.678410 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a645d-4ce2-4879-986b-fa8819e41463 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:45.679756 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 732/1473] 10.222.0.81 () {54 vars in 961 bytes} [Tue Sep 6 21:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:16:45.684955 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f519f74-3362-411f-8039-c732c6fe6b4a None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:45.685245 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f519f74-3362-411f-8039-c732c6fe6b4a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:45.685521 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f519f74-3362-411f-8039-c732c6fe6b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:45.764214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-9f519f74-3362-411f-8039-c732c6fe6b4a None None] MFA Rules not processed for user `c2ba30d9c40641bf8abb580a219b5352`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:16:45.765740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-9f519f74-3362-411f-8039-c732c6fe6b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:45.788572 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:45.849436 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 742/1474] 10.222.0.81 () {58 vars in 1058 bytes} [Tue Sep 6 21:16:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:16:45.857695 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a645d-4ce2-4879-986b-fa8819e41463 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:16:45.859136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0b4a645d-4ce2-4879-986b-fa8819e41463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:45.966134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a645d-4ce2-4879-986b-fa8819e41463 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:16:46.042972 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7170c6-d13b-4765-8203-49e4196c1aaa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ba30d9c40641bf8abb580a219b5352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:16:46.043586 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7170c6-d13b-4765-8203-49e4196c1aaa service glance] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:46.043871 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7170c6-d13b-4765-8203-49e4196c1aaa service glance] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:46.044321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7170c6-d13b-4765-8203-49e4196c1aaa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:46.045817 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2e7170c6-d13b-4765-8203-49e4196c1aaa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:46.111176 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:46.168722 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7170c6-d13b-4765-8203-49e4196c1aaa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:16:46.170190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7170c6-d13b-4765-8203-49e4196c1aaa service glance] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:16:46.189058 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 733/1475] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:16:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:16:48.441039 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1a966-da28-43a4-9169-944a6abd818f None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:48.441576 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1a966-da28-43a4-9169-944a6abd818f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:48.441576 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1a966-da28-43a4-9169-944a6abd818f None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:48.442947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 743/1476] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:16:48.448227 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f614f-42a6-424e-b96a-cf155e622442 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:48.448675 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f614f-42a6-424e-b96a-cf155e622442 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:48.448784 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f614f-42a6-424e-b96a-cf155e622442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:48.514050 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-2c0f614f-42a6-424e-b96a-cf155e622442 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:16:48.515247 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2c0f614f-42a6-424e-b96a-cf155e622442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:48.610939 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 734/1477] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:16:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:16:48.885339 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1a966-da28-43a4-9169-944a6abd818f None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:16:48.886897 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-89d1a966-da28-43a4-9169-944a6abd818f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:49.013356 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1a966-da28-43a4-9169-944a6abd818f None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:16:49.062806 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:49.107415 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c70bca-de16-42bf-8035-9092e8108e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:16:49.108054 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c70bca-de16-42bf-8035-9092e8108e8b admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:49.108367 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c70bca-de16-42bf-8035-9092e8108e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:49.108637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c70bca-de16-42bf-8035-9092e8108e8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:49.109268 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c70bca-de16-42bf-8035-9092e8108e8b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:16:49.110997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: WARNING py.warnings [None req-53c70bca-de16-42bf-8035-9092e8108e8b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 21:16:49.110997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: warnings.warn(msg) Sep 06 21:16:49.110997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: Sep 06 21:16:49.112174 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c70bca-de16-42bf-8035-9092e8108e8b admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:16:49.132522 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 744/1478] 10.222.0.81 () {56 vars in 1108 bytes} [Tue Sep 6 21:16:48 2022] GET /identity/v3/projects => generated 2553 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:16:51.319374 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949a219-4782-4278-9c6e-4063d7b76c00 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:51.319960 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949a219-4782-4278-9c6e-4063d7b76c00 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:51.319960 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949a219-4782-4278-9c6e-4063d7b76c00 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:51.321323 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 735/1479] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:16:51.326771 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29106c6-7014-4f5a-8048-64b5fdc78fde None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:51.327223 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29106c6-7014-4f5a-8048-64b5fdc78fde None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:51.327332 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29106c6-7014-4f5a-8048-64b5fdc78fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:51.394407 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c29106c6-7014-4f5a-8048-64b5fdc78fde None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:16:51.395650 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c29106c6-7014-4f5a-8048-64b5fdc78fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:51.492369 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 745/1480] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:16:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:16:51.790642 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949a219-4782-4278-9c6e-4063d7b76c00 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:16:51.792211 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2949a219-4782-4278-9c6e-4063d7b76c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:51.805144 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:51.940404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949a219-4782-4278-9c6e-4063d7b76c00 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:16:52.019502 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:52.052722 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd815c67-1d49-4c70-8eaf-c37462c83743 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:16:52.053325 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd815c67-1d49-4c70-8eaf-c37462c83743 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:52.053605 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd815c67-1d49-4c70-8eaf-c37462c83743 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:52.053877 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd815c67-1d49-4c70-8eaf-c37462c83743 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:52.055469 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-dd815c67-1d49-4c70-8eaf-c37462c83743 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:52.143691 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd815c67-1d49-4c70-8eaf-c37462c83743 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:16:52.145329 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd815c67-1d49-4c70-8eaf-c37462c83743 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:16:52.163185 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 736/1481] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:16:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:16:54.504915 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d9f43-115e-4d28-aeb7-06149aace747 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:54.505481 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d9f43-115e-4d28-aeb7-06149aace747 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:54.505481 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d9f43-115e-4d28-aeb7-06149aace747 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:54.506916 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 746/1482] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:16:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:16:54.512428 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b90354-960b-41ee-9cf5-57a7da24c55f None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:54.513104 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b90354-960b-41ee-9cf5-57a7da24c55f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:54.513407 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b90354-960b-41ee-9cf5-57a7da24c55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:54.580991 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-38b90354-960b-41ee-9cf5-57a7da24c55f None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:16:54.582258 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-38b90354-960b-41ee-9cf5-57a7da24c55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:54.628090 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:54.678203 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 737/1483] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:16:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:16:54.968539 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d9f43-115e-4d28-aeb7-06149aace747 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:16:54.970108 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6c4d9f43-115e-4d28-aeb7-06149aace747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:54.994845 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:55.076771 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d9f43-115e-4d28-aeb7-06149aace747 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:16:55.151045 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c4afe-83b0-428f-9a7d-aace688dc975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:16:55.151655 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c4afe-83b0-428f-9a7d-aace688dc975 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:55.151935 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c4afe-83b0-428f-9a7d-aace688dc975 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:55.152245 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c4afe-83b0-428f-9a7d-aace688dc975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:55.153839 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-644c4afe-83b0-428f-9a7d-aace688dc975 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:55.228127 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:55.264567 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c4afe-83b0-428f-9a7d-aace688dc975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:16:55.266043 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c4afe-83b0-428f-9a7d-aace688dc975 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:16:55.287035 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 747/1484] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:16:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:16:57.486808 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94ed7f-6155-48cb-852d-092d9aa32aad None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:57.487414 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94ed7f-6155-48cb-852d-092d9aa32aad None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:57.487414 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94ed7f-6155-48cb-852d-092d9aa32aad None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:57.488735 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 738/1485] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:16:57.494310 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176eb4a-410c-4c4d-8dc6-c1cad968aaf9 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:57.494861 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176eb4a-410c-4c4d-8dc6-c1cad968aaf9 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:57.494861 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176eb4a-410c-4c4d-8dc6-c1cad968aaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:57.560255 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-6176eb4a-410c-4c4d-8dc6-c1cad968aaf9 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:16:57.561479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6176eb4a-410c-4c4d-8dc6-c1cad968aaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:57.657853 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 748/1486] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:16:57.951410 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94ed7f-6155-48cb-852d-092d9aa32aad None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:16:57.952976 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ac94ed7f-6155-48cb-852d-092d9aa32aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:58.054840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94ed7f-6155-48cb-852d-092d9aa32aad None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:16:58.124566 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:16:58.126389 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fd19f7-40ea-4b93-84d4-c92a19c7d40f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:16:58.126995 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd19f7-40ea-4b93-84d4-c92a19c7d40f service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:16:58.127272 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd19f7-40ea-4b93-84d4-c92a19c7d40f service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:16:58.127544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fd19f7-40ea-4b93-84d4-c92a19c7d40f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:16:58.129188 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d8fd19f7-40ea-4b93-84d4-c92a19c7d40f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:16:58.235655 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd19f7-40ea-4b93-84d4-c92a19c7d40f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:16:58.237021 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fd19f7-40ea-4b93-84d4-c92a19c7d40f service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:16:58.255256 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 739/1487] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:16:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:17:00.564750 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09ed36-9aff-47e4-9919-4897a01df883 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:17:00.565318 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09ed36-9aff-47e4-9919-4897a01df883 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:17:00.565318 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd09ed36-9aff-47e4-9919-4897a01df883 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:17:00.566707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 749/1488] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:17:00.572120 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba4925-d2ac-4272-9178-cfa90887c9bf None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:17:00.572566 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba4925-d2ac-4272-9178-cfa90887c9bf None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:17:00.572753 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba4925-d2ac-4272-9178-cfa90887c9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:17:00.638354 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-88ba4925-d2ac-4272-9178-cfa90887c9bf None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:17:00.639560 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-88ba4925-d2ac-4272-9178-cfa90887c9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:17:00.692494 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:17:00.736281 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 740/1489] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:17:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:17:01.028606 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09ed36-9aff-47e4-9919-4897a01df883 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:17:01.030200 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-fd09ed36-9aff-47e4-9919-4897a01df883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:17:01.066632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:17:01.133625 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd09ed36-9aff-47e4-9919-4897a01df883 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:17:01.206237 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5fa8b6-d1bf-4b40-882e-8b46043a929b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:17:01.206843 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fa8b6-d1bf-4b40-882e-8b46043a929b service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:17:01.207120 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fa8b6-d1bf-4b40-882e-8b46043a929b service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:17:01.207390 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5fa8b6-d1bf-4b40-882e-8b46043a929b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:17:01.209015 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6d5fa8b6-d1bf-4b40-882e-8b46043a929b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:17:01.289865 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:17:01.319697 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5fa8b6-d1bf-4b40-882e-8b46043a929b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:17:01.321206 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5fa8b6-d1bf-4b40-882e-8b46043a929b service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:17:01.338787 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 750/1490] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:17:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:17:03.827953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3a4e5-2e99-4a03-b19f-adec3bfece19 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:17:03.828557 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3a4e5-2e99-4a03-b19f-adec3bfece19 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:17:03.828557 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3a4e5-2e99-4a03-b19f-adec3bfece19 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:17:03.829873 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 741/1491] 10.222.0.81 () {54 vars in 927 bytes} [Tue Sep 6 21:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:17:03.835111 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe2661-500b-4f46-bd80-b1f150dd9739 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:17:03.835522 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe2661-500b-4f46-bd80-b1f150dd9739 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:17:03.835667 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe2661-500b-4f46-bd80-b1f150dd9739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:17:03.901453 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-19fe2661-500b-4f46-bd80-b1f150dd9739 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:17:03.902694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-19fe2661-500b-4f46-bd80-b1f150dd9739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:17:03.997562 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 751/1492] 10.222.0.81 () {58 vars in 1024 bytes} [Tue Sep 6 21:17:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:17:04.288219 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3a4e5-2e99-4a03-b19f-adec3bfece19 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:17:04.289887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0cf3a4e5-2e99-4a03-b19f-adec3bfece19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:17:04.392124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3a4e5-2e99-4a03-b19f-adec3bfece19 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:17:04.465822 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120c32dc-7af6-48d9-bd59-77fb1bc728a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:17:04.466426 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c32dc-7af6-48d9-bd59-77fb1bc728a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:17:04.466707 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c32dc-7af6-48d9-bd59-77fb1bc728a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:17:04.466980 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120c32dc-7af6-48d9-bd59-77fb1bc728a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:17:04.468598 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-120c32dc-7af6-48d9-bd59-77fb1bc728a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:17:04.477483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:17:04.576822 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120c32dc-7af6-48d9-bd59-77fb1bc728a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:17:04.578256 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120c32dc-7af6-48d9-bd59-77fb1bc728a9 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:17:04.596503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 742/1493] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:17:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:17:13.995807 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=82 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:17:14.594164 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=50 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:18:49.500189 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea311e-3c41-4f0e-9d05-6ea6ace798d9 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:18:49.500798 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea311e-3c41-4f0e-9d05-6ea6ace798d9 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:18:49.500798 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea311e-3c41-4f0e-9d05-6ea6ace798d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:18:49.583209 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-1cea311e-3c41-4f0e-9d05-6ea6ace798d9 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:18:49.584464 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1cea311e-3c41-4f0e-9d05-6ea6ace798d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:18:49.693771 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 752/1494] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:18:49.701965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c7057-220e-42e3-bcc2-c5c8784d3832 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:18:49.702535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c7057-220e-42e3-bcc2-c5c8784d3832 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:18:49.702535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c7057-220e-42e3-bcc2-c5c8784d3832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:18:49.725484 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-048c7057-220e-42e3-bcc2-c5c8784d3832 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:18:49.726785 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-048c7057-220e-42e3-bcc2-c5c8784d3832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:18:49.735367 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 743/1495] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:18:49.740840 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea311e-3c41-4f0e-9d05-6ea6ace798d9 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:18:49.750914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea311e-3c41-4f0e-9d05-6ea6ace798d9 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:18:49.756264 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03d57c-0f9e-40c8-8c42-866094e20252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:18:49.756877 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03d57c-0f9e-40c8-8c42-866094e20252 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:18:49.757160 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03d57c-0f9e-40c8-8c42-866094e20252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:18:49.757435 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be03d57c-0f9e-40c8-8c42-866094e20252 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:18:49.758086 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03d57c-0f9e-40c8-8c42-866094e20252 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:18:49.758396 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03d57c-0f9e-40c8-8c42-866094e20252 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:18:49.759416 dv-cinder-749155-11-smb devstack@keystone.service[81777]: WARNING py.warnings [None req-be03d57c-0f9e-40c8-8c42-866094e20252 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 21:18:49.759416 dv-cinder-749155-11-smb devstack@keystone.service[81777]: warnings.warn(msg) Sep 06 21:18:49.759416 dv-cinder-749155-11-smb devstack@keystone.service[81777]: Sep 06 21:18:49.760338 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be03d57c-0f9e-40c8-8c42-866094e20252 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:18:49.772060 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 753/1496] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:18:49.780347 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c7057-220e-42e3-bcc2-c5c8784d3832 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:18:49.790083 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c7057-220e-42e3-bcc2-c5c8784d3832 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:18:49.795064 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f10f6c-0142-40a0-a336-fea721fada6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:18:49.795680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f10f6c-0142-40a0-a336-fea721fada6c admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:18:49.795961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f10f6c-0142-40a0-a336-fea721fada6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:18:49.796266 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f10f6c-0142-40a0-a336-fea721fada6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:18:49.796922 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f10f6c-0142-40a0-a336-fea721fada6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:18:49.798671 dv-cinder-749155-11-smb devstack@keystone.service[81778]: WARNING py.warnings [None req-90f10f6c-0142-40a0-a336-fea721fada6c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 21:18:49.798671 dv-cinder-749155-11-smb devstack@keystone.service[81778]: warnings.warn(msg) Sep 06 21:18:49.798671 dv-cinder-749155-11-smb devstack@keystone.service[81778]: Sep 06 21:18:49.799879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f10f6c-0142-40a0-a336-fea721fada6c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:18:49.982088 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 744/1497] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:18:49 2022] POST /identity/v3/projects => generated 379 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:18:49.986438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03d57c-0f9e-40c8-8c42-866094e20252 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:18:49.997398 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be03d57c-0f9e-40c8-8c42-866094e20252 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:18:50.048888 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:18:50.056525 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987b8c8-16db-432f-a80d-ee31c65a679e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:18:50.057146 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987b8c8-16db-432f-a80d-ee31c65a679e admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:18:50.057430 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987b8c8-16db-432f-a80d-ee31c65a679e admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:18:50.057706 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987b8c8-16db-432f-a80d-ee31c65a679e admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:18:50.058372 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987b8c8-16db-432f-a80d-ee31c65a679e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:18:50.059416 dv-cinder-749155-11-smb devstack@keystone.service[81777]: WARNING py.warnings [None req-b987b8c8-16db-432f-a80d-ee31c65a679e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 21:18:50.059416 dv-cinder-749155-11-smb devstack@keystone.service[81777]: warnings.warn(msg) Sep 06 21:18:50.059416 dv-cinder-749155-11-smb devstack@keystone.service[81777]: Sep 06 21:18:50.060637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987b8c8-16db-432f-a80d-ee31c65a679e admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:18:50.160117 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 754/1498] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:18:49 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:18:50.165089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f10f6c-0142-40a0-a336-fea721fada6c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:18:50.175764 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f10f6c-0142-40a0-a336-fea721fada6c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:18:50.181176 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda2e13-319e-4b68-8449-f93773e15e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:18:50.181790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda2e13-319e-4b68-8449-f93773e15e1a admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:18:50.182081 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda2e13-319e-4b68-8449-f93773e15e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:18:50.182360 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda2e13-319e-4b68-8449-f93773e15e1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:18:50.183007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda2e13-319e-4b68-8449-f93773e15e1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:18:50.184011 dv-cinder-749155-11-smb devstack@keystone.service[81778]: WARNING py.warnings [None req-bdda2e13-319e-4b68-8449-f93773e15e1a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 21:18:50.184011 dv-cinder-749155-11-smb devstack@keystone.service[81778]: warnings.warn(msg) Sep 06 21:18:50.184011 dv-cinder-749155-11-smb devstack@keystone.service[81778]: Sep 06 21:18:50.184955 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdda2e13-319e-4b68-8449-f93773e15e1a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:18:50.198613 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 745/1499] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:18:50.203203 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987b8c8-16db-432f-a80d-ee31c65a679e admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:18:50.213910 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987b8c8-16db-432f-a80d-ee31c65a679e admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:18:50.218892 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f1060-068b-4a99-83d2-f46c5b3670dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:18:50.219500 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f1060-068b-4a99-83d2-f46c5b3670dc admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:18:50.219776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f1060-068b-4a99-83d2-f46c5b3670dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:18:50.220116 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f1060-068b-4a99-83d2-f46c5b3670dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:18:50.220770 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f1060-068b-4a99-83d2-f46c5b3670dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:18:50.221776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: WARNING py.warnings [None req-688f1060-068b-4a99-83d2-f46c5b3670dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 21:18:50.221776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: warnings.warn(msg) Sep 06 21:18:50.221776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: Sep 06 21:18:50.222659 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f1060-068b-4a99-83d2-f46c5b3670dc admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:18:50.238895 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 755/1500] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:18:50.243750 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda2e13-319e-4b68-8449-f93773e15e1a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:18:50.254795 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda2e13-319e-4b68-8449-f93773e15e1a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:18:50.260424 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c428b0-bf02-4b2f-8888-8672d251665c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:18:50.261107 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c428b0-bf02-4b2f-8888-8672d251665c admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:18:50.261394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c428b0-bf02-4b2f-8888-8672d251665c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:18:50.261674 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c428b0-bf02-4b2f-8888-8672d251665c admin admin] PATH_INFO: `/v3/projects/ef3511f3b8d042d085ffeab5a25d6708/users/c7d6f44c553c409d8a0008e8c5950203/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:18:50.278261 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c428b0-bf02-4b2f-8888-8672d251665c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef3511f3b8d042d085ffeab5a25d6708, user_id=c7d6f44c553c409d8a0008e8c5950203, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:18:50.279301 dv-cinder-749155-11-smb devstack@keystone.service[81778]: WARNING py.warnings [None req-c4c428b0-bf02-4b2f-8888-8672d251665c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 21:18:50.279301 dv-cinder-749155-11-smb devstack@keystone.service[81778]: warnings.warn(msg) Sep 06 21:18:50.279301 dv-cinder-749155-11-smb devstack@keystone.service[81778]: Sep 06 21:18:50.281294 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c428b0-bf02-4b2f-8888-8672d251665c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:18:50.353417 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 746/1501] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:18:50 2022] PUT /identity/v3/projects/ef3511f3b8d042d085ffeab5a25d6708/users/c7d6f44c553c409d8a0008e8c5950203/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:18:50.366768 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064b9b5-65b3-4e55-a98e-878b3696ed63 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:18:50.367056 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064b9b5-65b3-4e55-a98e-878b3696ed63 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:18:50.367454 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064b9b5-65b3-4e55-a98e-878b3696ed63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:18:50.395101 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c064b9b5-65b3-4e55-a98e-878b3696ed63 None None] MFA Rules not processed for user `c7d6f44c553c409d8a0008e8c5950203`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:18:50.396856 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c064b9b5-65b3-4e55-a98e-878b3696ed63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:18:50.460747 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 756/1502] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:18:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:18:50.474841 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67b66c-ae36-4b7f-8917-23cca7d15986 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:18:50.475149 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67b66c-ae36-4b7f-8917-23cca7d15986 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:18:50.475422 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb67b66c-ae36-4b7f-8917-23cca7d15986 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:18:50.476848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 747/1503] 10.222.0.81 () {54 vars in 964 bytes} [Tue Sep 6 21:18:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:18:50.481626 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f12ffa-d020-409f-ae39-4a2517b89088 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:18:50.481918 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f12ffa-d020-409f-ae39-4a2517b89088 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:18:50.482200 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f12ffa-d020-409f-ae39-4a2517b89088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:18:50.543665 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f6f12ffa-d020-409f-ae39-4a2517b89088 None None] MFA Rules not processed for user `af9589aaba334db494ed0b036e94062f`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:18:50.544934 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f6f12ffa-d020-409f-ae39-4a2517b89088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:18:50.622736 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 757/1504] 10.222.0.81 () {58 vars in 1061 bytes} [Tue Sep 6 21:18:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:18:50.631132 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67b66c-ae36-4b7f-8917-23cca7d15986 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:18:50.643354 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb67b66c-ae36-4b7f-8917-23cca7d15986 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:18:50.646954 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7915b1a-d429-4d90-991d-1e333033cbe1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:18:50.647564 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7915b1a-d429-4d90-991d-1e333033cbe1 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:18:50.647842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7915b1a-d429-4d90-991d-1e333033cbe1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:18:50.648144 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7915b1a-d429-4d90-991d-1e333033cbe1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:18:50.656725 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7915b1a-d429-4d90-991d-1e333033cbe1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:18:50.658138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7915b1a-d429-4d90-991d-1e333033cbe1 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:18:50.667133 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 748/1505] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:18:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:18:50.714582 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d696dd-074a-4914-a8df-e58ceb69c563 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:18:50.714872 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d696dd-074a-4914-a8df-e58ceb69c563 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:18:50.715148 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d696dd-074a-4914-a8df-e58ceb69c563 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:18:50.716447 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 758/1506] 10.222.0.81 () {52 vars in 830 bytes} [Tue Sep 6 21:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:18:50.719931 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7915b1a-d429-4d90-991d-1e333033cbe1 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:18:50.784648 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7915b1a-d429-4d90-991d-1e333033cbe1 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:18:50.790000 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34792f87-50a0-4eed-999f-fd175548a0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:18:50.790669 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34792f87-50a0-4eed-999f-fd175548a0ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:18:50.790947 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34792f87-50a0-4eed-999f-fd175548a0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:18:50.791220 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34792f87-50a0-4eed-999f-fd175548a0ae admin admin] PATH_INFO: `/v3/users/c7d6f44c553c409d8a0008e8c5950203` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:18:50.792413 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34792f87-50a0-4eed-999f-fd175548a0ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7d6f44c553c409d8a0008e8c5950203)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:18:50.793740 dv-cinder-749155-11-smb devstack@keystone.service[81778]: WARNING py.warnings [None req-34792f87-50a0-4eed-999f-fd175548a0ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 21:18:50.793740 dv-cinder-749155-11-smb devstack@keystone.service[81778]: warnings.warn(msg) Sep 06 21:18:50.793740 dv-cinder-749155-11-smb devstack@keystone.service[81778]: Sep 06 21:18:50.794894 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34792f87-50a0-4eed-999f-fd175548a0ae admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:18:51.018534 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-34792f87-50a0-4eed-999f-fd175548a0ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7d6f44c553c409d8a0008e8c5950203'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:18:51.112014 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-34792f87-50a0-4eed-999f-fd175548a0ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7d6f44c553c409d8a0008e8c5950203'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:18:51.137014 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-34792f87-50a0-4eed-999f-fd175548a0ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7d6f44c553c409d8a0008e8c5950203'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:18:51.137766 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-34792f87-50a0-4eed-999f-fd175548a0ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7d6f44c553c409d8a0008e8c5950203'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:18:51.149459 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:18:51.153769 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-34792f87-50a0-4eed-999f-fd175548a0ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7d6f44c553c409d8a0008e8c5950203'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:18:51.162714 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 749/1507] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:18:50 2022] DELETE /identity/v3/users/c7d6f44c553c409d8a0008e8c5950203 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:18:51.167050 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c713db9-416b-4c1a-b61b-730da1c274a3 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:18:51.167335 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c713db9-416b-4c1a-b61b-730da1c274a3 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:18:51.167666 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c713db9-416b-4c1a-b61b-730da1c274a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:18:51.188959 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-0c713db9-416b-4c1a-b61b-730da1c274a3 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:18:51.190176 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-0c713db9-416b-4c1a-b61b-730da1c274a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:18:51.199644 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:18:51.253659 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 759/1508] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:18:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:18:51.263351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34792f87-50a0-4eed-999f-fd175548a0ae admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:18:51.265054 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-34792f87-50a0-4eed-999f-fd175548a0ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:18:51.346913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34792f87-50a0-4eed-999f-fd175548a0ae admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:18:51.351429 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5128c56d-6b27-4fce-b599-289bc80b48bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:18:51.352050 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128c56d-6b27-4fce-b599-289bc80b48bd service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:18:51.352566 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128c56d-6b27-4fce-b599-289bc80b48bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:18:51.352868 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5128c56d-6b27-4fce-b599-289bc80b48bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:18:51.362840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128c56d-6b27-4fce-b599-289bc80b48bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:18:51.364289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5128c56d-6b27-4fce-b599-289bc80b48bd service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:18:51.373818 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 750/1509] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:18:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:18:51.905731 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c713db9-416b-4c1a-b61b-730da1c274a3 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:18:51.905731 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-0c713db9-416b-4c1a-b61b-730da1c274a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:18:51.917449 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c713db9-416b-4c1a-b61b-730da1c274a3 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:18:51.922636 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09337936-d4c8-4354-9bcb-adc257db6b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:18:51.923275 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09337936-d4c8-4354-9bcb-adc257db6b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:18:51.923557 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09337936-d4c8-4354-9bcb-adc257db6b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:18:51.923830 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09337936-d4c8-4354-9bcb-adc257db6b61 admin admin] PATH_INFO: `/v3/projects/ef3511f3b8d042d085ffeab5a25d6708` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:18:51.925017 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09337936-d4c8-4354-9bcb-adc257db6b61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef3511f3b8d042d085ffeab5a25d6708)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:18:51.926498 dv-cinder-749155-11-smb devstack@keystone.service[81777]: WARNING py.warnings [None req-09337936-d4c8-4354-9bcb-adc257db6b61 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 21:18:51.926498 dv-cinder-749155-11-smb devstack@keystone.service[81777]: warnings.warn(msg) Sep 06 21:18:51.926498 dv-cinder-749155-11-smb devstack@keystone.service[81777]: Sep 06 21:18:51.927241 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09337936-d4c8-4354-9bcb-adc257db6b61 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:18:52.043905 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-09337936-d4c8-4354-9bcb-adc257db6b61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef3511f3b8d042d085ffeab5a25d6708', 'request_id': 'req-09337936-d4c8-4354-9bcb-adc257db6b61'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:18:52.123864 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-09337936-d4c8-4354-9bcb-adc257db6b61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef3511f3b8d042d085ffeab5a25d6708', 'request_id': 'req-09337936-d4c8-4354-9bcb-adc257db6b61'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:18:52.131455 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-09337936-d4c8-4354-9bcb-adc257db6b61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef3511f3b8d042d085ffeab5a25d6708', 'request_id': 'req-09337936-d4c8-4354-9bcb-adc257db6b61'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:18:52.150449 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-09337936-d4c8-4354-9bcb-adc257db6b61 admin admin] The token cache is being invalidate because project ef3511f3b8d042d085ffeab5a25d6708 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:18:52.150670 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-09337936-d4c8-4354-9bcb-adc257db6b61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:18:52.151402 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-09337936-d4c8-4354-9bcb-adc257db6b61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:18:52.153148 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 760/1510] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:18:51 2022] DELETE /identity/v3/projects/ef3511f3b8d042d085ffeab5a25d6708 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:19:01.369563 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=38 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:19:02.147162 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:20:35.303786 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d371ec3-d627-4877-bd32-2eb5e431fee3 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:20:35.304722 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d371ec3-d627-4877-bd32-2eb5e431fee3 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:20:35.304722 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d371ec3-d627-4877-bd32-2eb5e431fee3 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:20:35.305713 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 751/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 21:20:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:20:35.310557 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243d4ac-2351-4b3f-912e-b2233068aa35 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:20:35.310957 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243d4ac-2351-4b3f-912e-b2233068aa35 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:20:35.311111 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7243d4ac-2351-4b3f-912e-b2233068aa35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:20:35.330693 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-7243d4ac-2351-4b3f-912e-b2233068aa35 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:20:35.331881 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7243d4ac-2351-4b3f-912e-b2233068aa35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:20:35.389937 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 761/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 21:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:20:35.544712 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d371ec3-d627-4877-bd32-2eb5e431fee3 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:20:35.546446 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3d371ec3-d627-4877-bd32-2eb5e431fee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:20:35.647730 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d371ec3-d627-4877-bd32-2eb5e431fee3 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:20:35.653242 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1f5f1c-5a85-466d-bce8-bf83a8fa58fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:20:35.653848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f5f1c-5a85-466d-bce8-bf83a8fa58fd service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:20:35.654142 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f5f1c-5a85-466d-bce8-bf83a8fa58fd service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:20:35.654397 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1f5f1c-5a85-466d-bce8-bf83a8fa58fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:20:35.663096 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f5f1c-5a85-466d-bce8-bf83a8fa58fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:20:35.664701 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1f5f1c-5a85-466d-bce8-bf83a8fa58fd service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:20:35.674104 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 752/1513] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:20:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:20:36.763729 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad37dc5-f517-47e9-9fd5-c9efc0fb4505 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:20:36.764303 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad37dc5-f517-47e9-9fd5-c9efc0fb4505 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:20:36.764303 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad37dc5-f517-47e9-9fd5-c9efc0fb4505 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:20:36.765654 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 762/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 21:20:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:20:36.771976 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe6aa4-42b1-4921-9e42-4538d2483090 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:20:36.772450 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe6aa4-42b1-4921-9e42-4538d2483090 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:20:36.772578 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe6aa4-42b1-4921-9e42-4538d2483090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:20:36.793888 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-55fe6aa4-42b1-4921-9e42-4538d2483090 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:20:36.795131 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-55fe6aa4-42b1-4921-9e42-4538d2483090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:20:36.804131 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 753/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 21:20:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:20:36.959048 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad37dc5-f517-47e9-9fd5-c9efc0fb4505 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:20:36.973368 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad37dc5-f517-47e9-9fd5-c9efc0fb4505 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:20:36.979494 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eafc0b-cfba-4353-bc48-3b1d4084528a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:20:36.980116 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eafc0b-cfba-4353-bc48-3b1d4084528a service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:20:36.980412 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eafc0b-cfba-4353-bc48-3b1d4084528a service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:20:36.980712 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eafc0b-cfba-4353-bc48-3b1d4084528a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:20:36.989476 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eafc0b-cfba-4353-bc48-3b1d4084528a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:20:36.991927 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eafc0b-cfba-4353-bc48-3b1d4084528a service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:20:37.001554 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 763/1516] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:20:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:20:37.089132 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090dae3-1309-40ed-bb43-0778583e907f None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:20:37.089417 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090dae3-1309-40ed-bb43-0778583e907f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:20:37.089692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090dae3-1309-40ed-bb43-0778583e907f None None] PATH_INFO: `/v3` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:20:37.090984 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 754/1517] 10.222.0.75 () {54 vars in 925 bytes} [Tue Sep 6 21:20:37 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:20:37.097263 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce34de-4be9-4629-b33b-1207a3f71a24 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:20:37.097535 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce34de-4be9-4629-b33b-1207a3f71a24 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:20:37.097812 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce34de-4be9-4629-b33b-1207a3f71a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:20:37.152111 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-86ce34de-4be9-4629-b33b-1207a3f71a24 None None] MFA Rules not processed for user `c3295306746f4552837f1bb12b2c500f`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:20:37.153347 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-86ce34de-4be9-4629-b33b-1207a3f71a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:20:37.225426 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 764/1518] 10.222.0.75 () {58 vars in 1015 bytes} [Tue Sep 6 21:20:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:20:41.032217 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73235531-d2c2-4ca5-a035-9373c723a5dd None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:20:41.032665 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73235531-d2c2-4ca5-a035-9373c723a5dd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:20:41.032762 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73235531-d2c2-4ca5-a035-9373c723a5dd None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:20:41.034070 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 755/1519] 10.222.0.81 () {54 vars in 961 bytes} [Tue Sep 6 21:20:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:20:41.039909 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e75505-2016-4919-bfcb-0a1291cadf41 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:20:41.040353 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e75505-2016-4919-bfcb-0a1291cadf41 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:20:41.040479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e75505-2016-4919-bfcb-0a1291cadf41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:20:41.059816 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c7e75505-2016-4919-bfcb-0a1291cadf41 None None] MFA Rules not processed for user `c3295306746f4552837f1bb12b2c500f`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:20:41.061446 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c7e75505-2016-4919-bfcb-0a1291cadf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:20:41.072065 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 765/1520] 10.222.0.81 () {58 vars in 1058 bytes} [Tue Sep 6 21:20:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:20:41.079273 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73235531-d2c2-4ca5-a035-9373c723a5dd None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:20:41.093257 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73235531-d2c2-4ca5-a035-9373c723a5dd None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:20:41.098366 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91e606-fdd0-4e98-8a27-0d54deb2506a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3295306746f4552837f1bb12b2c500f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:20:41.098972 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91e606-fdd0-4e98-8a27-0d54deb2506a service placement] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:20:41.099253 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91e606-fdd0-4e98-8a27-0d54deb2506a service placement] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:20:41.099559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91e606-fdd0-4e98-8a27-0d54deb2506a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:20:41.109104 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec91e606-fdd0-4e98-8a27-0d54deb2506a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:20:41.110684 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec91e606-fdd0-4e98-8a27-0d54deb2506a service placement] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:20:41.120490 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 756/1521] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:20:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:20:48.463769 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0595f29-6516-4ed7-ba5d-e62024edac7c None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:20:48.464480 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0595f29-6516-4ed7-ba5d-e62024edac7c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:20:48.464480 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0595f29-6516-4ed7-ba5d-e62024edac7c None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:20:48.465768 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 766/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 21:20:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:20:48.472080 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d12b54-42b2-4411-9a7b-841d4a9c3c0a None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:20:48.472559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d12b54-42b2-4411-9a7b-841d4a9c3c0a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:20:48.472667 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d12b54-42b2-4411-9a7b-841d4a9c3c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:20:48.499363 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-37d12b54-42b2-4411-9a7b-841d4a9c3c0a None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:20:48.500607 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-37d12b54-42b2-4411-9a7b-841d4a9c3c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:20:48.508505 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 757/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 21:20:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:20:48.662054 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0595f29-6516-4ed7-ba5d-e62024edac7c None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:20:48.678119 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0595f29-6516-4ed7-ba5d-e62024edac7c None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:20:48.683792 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b259799-91bd-49a9-8725-14101f78af89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:20:48.684437 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b259799-91bd-49a9-8725-14101f78af89 service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:20:48.684718 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b259799-91bd-49a9-8725-14101f78af89 service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:20:48.684997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b259799-91bd-49a9-8725-14101f78af89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:20:48.693834 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b259799-91bd-49a9-8725-14101f78af89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:20:48.695486 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b259799-91bd-49a9-8725-14101f78af89 service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:20:48.704904 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 767/1524] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:20:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:20:49.770559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5de23-7156-4964-9f2a-eb77d55d002f None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:20:49.771112 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5de23-7156-4964-9f2a-eb77d55d002f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:20:49.771112 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5de23-7156-4964-9f2a-eb77d55d002f None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:20:49.772514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 758/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 6 21:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:20:49.778764 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117a63e-2a03-4362-b6c5-55dfe2236762 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:20:49.779188 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117a63e-2a03-4362-b6c5-55dfe2236762 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:20:49.779395 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117a63e-2a03-4362-b6c5-55dfe2236762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:20:49.801100 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-7117a63e-2a03-4362-b6c5-55dfe2236762 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:20:49.802367 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7117a63e-2a03-4362-b6c5-55dfe2236762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:20:49.810972 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 768/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 6 21:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:20:49.965137 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5de23-7156-4964-9f2a-eb77d55d002f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:20:49.980004 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5de23-7156-4964-9f2a-eb77d55d002f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:20:49.985389 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2f3df-45d4-4156-8167-b45579184995 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:20:49.985982 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2f3df-45d4-4156-8167-b45579184995 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:20:49.986270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2f3df-45d4-4156-8167-b45579184995 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:20:49.986538 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2f3df-45d4-4156-8167-b45579184995 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:20:49.994558 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2f3df-45d4-4156-8167-b45579184995 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:20:49.996151 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2f3df-45d4-4156-8167-b45579184995 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:20:50.005368 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 759/1527] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:20:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:20:54.137051 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced91626-3f6c-458c-b574-a7d53200fc55 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:20:54.137601 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced91626-3f6c-458c-b574-a7d53200fc55 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:20:54.137601 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced91626-3f6c-458c-b574-a7d53200fc55 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:20:54.138923 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 769/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 21:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:20:54.144044 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab9bbd-6ce3-4390-9fd9-6a8683ceb389 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:20:54.144482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab9bbd-6ce3-4390-9fd9-6a8683ceb389 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:20:54.144624 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feab9bbd-6ce3-4390-9fd9-6a8683ceb389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:20:54.164142 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-feab9bbd-6ce3-4390-9fd9-6a8683ceb389 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:20:54.165326 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-feab9bbd-6ce3-4390-9fd9-6a8683ceb389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:20:54.173609 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 760/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 21:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:20:54.461843 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced91626-3f6c-458c-b574-a7d53200fc55 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:20:54.463566 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ced91626-3f6c-458c-b574-a7d53200fc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:20:54.491689 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:20:54.519637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced91626-3f6c-458c-b574-a7d53200fc55 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:20:54.523648 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d7b87-d28f-4f4c-be65-932fb1724477 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:20:54.524275 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d7b87-d28f-4f4c-be65-932fb1724477 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:20:54.524574 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d7b87-d28f-4f4c-be65-932fb1724477 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:20:54.524832 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d7b87-d28f-4f4c-be65-932fb1724477 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:20:54.534044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d7b87-d28f-4f4c-be65-932fb1724477 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:20:54.535457 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d7b87-d28f-4f4c-be65-932fb1724477 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:20:54.545401 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 770/1530] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:20:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:20:56.676564 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bfe1e-11be-4dbc-8c98-9606e054eb9d None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:20:56.677163 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bfe1e-11be-4dbc-8c98-9606e054eb9d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:20:56.677163 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bfe1e-11be-4dbc-8c98-9606e054eb9d None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:20:56.679008 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 761/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 21:20:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:20:56.684478 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008890f-c430-470e-9faa-09844cf2853c None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:20:56.684903 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008890f-c430-470e-9faa-09844cf2853c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:20:56.685033 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008890f-c430-470e-9faa-09844cf2853c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:20:56.704650 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f008890f-c430-470e-9faa-09844cf2853c None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:20:56.705842 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f008890f-c430-470e-9faa-09844cf2853c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:20:56.713456 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 771/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 21:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:20:57.003656 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9bfe1e-11be-4dbc-8c98-9606e054eb9d None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:20:57.014995 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9bfe1e-11be-4dbc-8c98-9606e054eb9d None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:20:57.018480 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798605e4-d495-4781-ab96-b2bf20534621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:20:57.019073 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798605e4-d495-4781-ab96-b2bf20534621 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:20:57.019350 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798605e4-d495-4781-ab96-b2bf20534621 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:20:57.019619 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798605e4-d495-4781-ab96-b2bf20534621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:20:57.028346 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798605e4-d495-4781-ab96-b2bf20534621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:20:57.029751 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798605e4-d495-4781-ab96-b2bf20534621 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:20:57.039627 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 762/1533] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:20:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:21:03.629811 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44d2b6-c3cb-4437-a9b4-8eb9f5513de8 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:21:03.630470 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44d2b6-c3cb-4437-a9b4-8eb9f5513de8 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:21:03.630470 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d44d2b6-c3cb-4437-a9b4-8eb9f5513de8 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:21:03.631733 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 772/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 21:21:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:21:03.637437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c2783-fe31-4f6e-9fb5-0efe92e1d7c3 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:21:03.637877 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c2783-fe31-4f6e-9fb5-0efe92e1d7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:21:03.637986 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c2783-fe31-4f6e-9fb5-0efe92e1d7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:21:03.645721 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=74 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:21:03.658095 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-7f5c2783-fe31-4f6e-9fb5-0efe92e1d7c3 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:21:03.659292 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7f5c2783-fe31-4f6e-9fb5-0efe92e1d7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:21:03.667255 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 763/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 21:21:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:21:03.965548 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44d2b6-c3cb-4437-a9b4-8eb9f5513de8 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:21:03.967222 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-0d44d2b6-c3cb-4437-a9b4-8eb9f5513de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:21:04.023427 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d44d2b6-c3cb-4437-a9b4-8eb9f5513de8 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:21:04.026912 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449c03e-e3c9-4174-b438-69982d7f7354 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:21:04.027515 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449c03e-e3c9-4174-b438-69982d7f7354 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:21:04.027793 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449c03e-e3c9-4174-b438-69982d7f7354 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:21:04.028066 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449c03e-e3c9-4174-b438-69982d7f7354 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:21:04.036859 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449c03e-e3c9-4174-b438-69982d7f7354 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:21:04.038285 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449c03e-e3c9-4174-b438-69982d7f7354 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:21:04.048370 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 773/1536] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:21:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:21:06.173327 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da9d16-a9d5-4e48-a753-fc8aaaa4d32b None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:21:06.173909 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da9d16-a9d5-4e48-a753-fc8aaaa4d32b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:21:06.173909 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da9d16-a9d5-4e48-a753-fc8aaaa4d32b None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:21:06.175414 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 764/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 6 21:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:21:06.181773 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bff152-d174-40b5-9188-a73c11df92d6 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:21:06.182410 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bff152-d174-40b5-9188-a73c11df92d6 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:21:06.182410 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bff152-d174-40b5-9188-a73c11df92d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:21:06.202088 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f4bff152-d174-40b5-9188-a73c11df92d6 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:21:06.203287 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f4bff152-d174-40b5-9188-a73c11df92d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:21:06.210964 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 774/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 6 21:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:21:06.527277 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da9d16-a9d5-4e48-a753-fc8aaaa4d32b None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:21:06.528942 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-69da9d16-a9d5-4e48-a753-fc8aaaa4d32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:21:06.541668 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da9d16-a9d5-4e48-a753-fc8aaaa4d32b None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:21:06.545425 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb2e1c5-f5cd-42aa-8630-5998fd6a3b50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:21:06.546014 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2e1c5-f5cd-42aa-8630-5998fd6a3b50 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:21:06.546290 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2e1c5-f5cd-42aa-8630-5998fd6a3b50 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:21:06.546562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb2e1c5-f5cd-42aa-8630-5998fd6a3b50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:21:06.555644 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2e1c5-f5cd-42aa-8630-5998fd6a3b50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:21:06.557083 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb2e1c5-f5cd-42aa-8630-5998fd6a3b50 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:21:06.566140 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 765/1539] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:21:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:21:16.196742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=47 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:21:16.562162 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=8 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:35.014201 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655aef19-22dc-45e7-b8fc-92c393081d71 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:35.015232 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655aef19-22dc-45e7-b8fc-92c393081d71 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:35.015710 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655aef19-22dc-45e7-b8fc-92c393081d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:35.041184 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-655aef19-22dc-45e7-b8fc-92c393081d71 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:35.042410 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-655aef19-22dc-45e7-b8fc-92c393081d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:35.056476 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 775/1540] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:35.065247 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f654391-25fe-4b60-b34f-366b14ec7504 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:35.067057 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f654391-25fe-4b60-b34f-366b14ec7504 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:35.067057 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f654391-25fe-4b60-b34f-366b14ec7504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:35.097707 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-4f654391-25fe-4b60-b34f-366b14ec7504 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:35.099371 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4f654391-25fe-4b60-b34f-366b14ec7504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:35.109171 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 766/1541] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:35.114347 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655aef19-22dc-45e7-b8fc-92c393081d71 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:35.124453 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565481f-df0b-4b9e-8ea9-ad1b6b7faa0d None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:35.125364 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565481f-df0b-4b9e-8ea9-ad1b6b7faa0d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:35.125364 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565481f-df0b-4b9e-8ea9-ad1b6b7faa0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:35.127457 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655aef19-22dc-45e7-b8fc-92c393081d71 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:35.143210 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea226b-fb37-48d1-bfdc-97ce9b8a90d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:35.143872 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea226b-fb37-48d1-bfdc-97ce9b8a90d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:35.144185 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea226b-fb37-48d1-bfdc-97ce9b8a90d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:35.144461 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea226b-fb37-48d1-bfdc-97ce9b8a90d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:35.145143 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea226b-fb37-48d1-bfdc-97ce9b8a90d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:22:35.145453 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea226b-fb37-48d1-bfdc-97ce9b8a90d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:35.147149 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfea226b-fb37-48d1-bfdc-97ce9b8a90d8 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:35.159212 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-e565481f-df0b-4b9e-8ea9-ad1b6b7faa0d None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:35.160515 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e565481f-df0b-4b9e-8ea9-ad1b6b7faa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:35.170995 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 776/1542] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:22:35.172766 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c2478-46db-41c2-ad56-323565ed0608 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:35.173240 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c2478-46db-41c2-ad56-323565ed0608 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:35.174296 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8c2478-46db-41c2-ad56-323565ed0608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:35.182592 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 767/1543] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:22:35.192684 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf6ead-b484-449f-a21a-6833403d8a0c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:35.192969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf6ead-b484-449f-a21a-6833403d8a0c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:35.193249 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf6ead-b484-449f-a21a-6833403d8a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:35.205712 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-0b8c2478-46db-41c2-ad56-323565ed0608 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:35.207231 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-0b8c2478-46db-41c2-ad56-323565ed0608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:35.223051 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 777/1544] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:35.226345 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-c6bf6ead-b484-449f-a21a-6833403d8a0c None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:35.227667 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c6bf6ead-b484-449f-a21a-6833403d8a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:35.227948 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b266b7c-3558-4dd1-929d-6193ca87fa67 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:35.228271 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b266b7c-3558-4dd1-929d-6193ca87fa67 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:35.228552 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b266b7c-3558-4dd1-929d-6193ca87fa67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:35.248625 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 768/1545] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:22:35.249883 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf6ead-b484-449f-a21a-6833403d8a0c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:35.280091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf6ead-b484-449f-a21a-6833403d8a0c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:35.286055 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-7b266b7c-3558-4dd1-929d-6193ca87fa67 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:35.287278 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7b266b7c-3558-4dd1-929d-6193ca87fa67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:35.294102 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c68709-bd56-4168-b0a3-8b6c627e59eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:35.295143 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c68709-bd56-4168-b0a3-8b6c627e59eb admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:35.296066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c68709-bd56-4168-b0a3-8b6c627e59eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:35.296544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c68709-bd56-4168-b0a3-8b6c627e59eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:35.297831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c68709-bd56-4168-b0a3-8b6c627e59eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:35.300336 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c68709-bd56-4168-b0a3-8b6c627e59eb admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:35.307362 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 778/1546] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:35.309518 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7701b-6393-4ccf-b4a5-1d92822bdf1b None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:35.311578 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7701b-6393-4ccf-b4a5-1d92822bdf1b None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:35.312064 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7701b-6393-4ccf-b4a5-1d92822bdf1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:35.346916 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-44d7701b-6393-4ccf-b4a5-1d92822bdf1b None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:35.350772 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-44d7701b-6393-4ccf-b4a5-1d92822bdf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:35.356419 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 779/1547] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:35.357323 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7701b-6393-4ccf-b4a5-1d92822bdf1b None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:35.367846 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7701b-6393-4ccf-b4a5-1d92822bdf1b None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:35.372464 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a85de6-c70e-4816-a9ed-3a659e857658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:35.373696 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a85de6-c70e-4816-a9ed-3a659e857658 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:35.373696 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a85de6-c70e-4816-a9ed-3a659e857658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:35.373696 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a85de6-c70e-4816-a9ed-3a659e857658 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:35.374198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a85de6-c70e-4816-a9ed-3a659e857658 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:22:35.374500 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a85de6-c70e-4816-a9ed-3a659e857658 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:35.376319 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a85de6-c70e-4816-a9ed-3a659e857658 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:35.389054 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 780/1548] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:22:35.390269 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00021e4-21b6-46f4-b9d2-73ac262cbc4a None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:35.390554 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00021e4-21b6-46f4-b9d2-73ac262cbc4a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:35.390899 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00021e4-21b6-46f4-b9d2-73ac262cbc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:35.391290 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 769/1549] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:22:35 2022] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:22:35.392881 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59d077-afc2-41b8-99d3-bcd0e31e6e8b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:35.394111 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59d077-afc2-41b8-99d3-bcd0e31e6e8b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:35.394542 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59d077-afc2-41b8-99d3-bcd0e31e6e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:35.418177 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-a00021e4-21b6-46f4-b9d2-73ac262cbc4a None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:35.418408 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8c59d077-afc2-41b8-99d3-bcd0e31e6e8b None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:35.419691 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8c59d077-afc2-41b8-99d3-bcd0e31e6e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:35.419824 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a00021e4-21b6-46f4-b9d2-73ac262cbc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:35.482952 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 781/1550] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:35.484776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729edf44-4cc1-4b4d-acbd-7337b939c5fc None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:35.488278 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 770/1551] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:35.488278 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6f24a-a624-4d85-88c6-27c5fd20c879 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:35.488278 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6f24a-a624-4d85-88c6-27c5fd20c879 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:35.488278 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6f24a-a624-4d85-88c6-27c5fd20c879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:35.488688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729edf44-4cc1-4b4d-acbd-7337b939c5fc None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:35.488688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729edf44-4cc1-4b4d-acbd-7337b939c5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:35.506866 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-6bb6f24a-a624-4d85-88c6-27c5fd20c879 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:35.508057 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6bb6f24a-a624-4d85-88c6-27c5fd20c879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:35.509538 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-729edf44-4cc1-4b4d-acbd-7337b939c5fc None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:35.510714 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-729edf44-4cc1-4b4d-acbd-7337b939c5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:35.515697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 771/1552] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:35.516490 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6f24a-a624-4d85-88c6-27c5fd20c879 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:35.526302 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 782/1553] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:35.526302 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729edf44-4cc1-4b4d-acbd-7337b939c5fc None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:35.526589 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6f24a-a624-4d85-88c6-27c5fd20c879 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:35.530661 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89057ae-094f-4fa7-bbdc-9d6fe1d9a760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:35.531462 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89057ae-094f-4fa7-bbdc-9d6fe1d9a760 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:35.531738 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89057ae-094f-4fa7-bbdc-9d6fe1d9a760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:35.532007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89057ae-094f-4fa7-bbdc-9d6fe1d9a760 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:35.532695 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89057ae-094f-4fa7-bbdc-9d6fe1d9a760 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:22:35.532999 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89057ae-094f-4fa7-bbdc-9d6fe1d9a760 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:35.534002 dv-cinder-749155-11-smb devstack@keystone.service[81778]: WARNING py.warnings [None req-f89057ae-094f-4fa7-bbdc-9d6fe1d9a760 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 06 21:22:35.534002 dv-cinder-749155-11-smb devstack@keystone.service[81778]: warnings.warn(msg) Sep 06 21:22:35.534002 dv-cinder-749155-11-smb devstack@keystone.service[81778]: Sep 06 21:22:35.534878 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89057ae-094f-4fa7-bbdc-9d6fe1d9a760 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:35.535617 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729edf44-4cc1-4b4d-acbd-7337b939c5fc None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:35.540832 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa5033-6e07-4e0b-866a-b1c098440695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:35.541434 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa5033-6e07-4e0b-866a-b1c098440695 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:35.541714 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa5033-6e07-4e0b-866a-b1c098440695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:35.541990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa5033-6e07-4e0b-866a-b1c098440695 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:35.542618 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa5033-6e07-4e0b-866a-b1c098440695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:35.544827 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa5033-6e07-4e0b-866a-b1c098440695 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:35.546650 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 772/1554] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:22:35.547510 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89057ae-094f-4fa7-bbdc-9d6fe1d9a760 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:35.559675 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89057ae-094f-4fa7-bbdc-9d6fe1d9a760 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:35.565134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba07e7c-f79f-46ec-83e0-dea5129d3052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:35.572656 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba07e7c-f79f-46ec-83e0-dea5129d3052 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:35.572656 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba07e7c-f79f-46ec-83e0-dea5129d3052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:35.572656 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba07e7c-f79f-46ec-83e0-dea5129d3052 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:35.572656 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba07e7c-f79f-46ec-83e0-dea5129d3052 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:35.572656 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba07e7c-f79f-46ec-83e0-dea5129d3052 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:35.646381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 783/1555] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:22:35 2022] POST /identity/v3/users => generated 290 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:22:35.647748 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692428c7-b660-41b4-9c22-9494ed701a75 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:35.648037 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692428c7-b660-41b4-9c22-9494ed701a75 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:35.648335 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692428c7-b660-41b4-9c22-9494ed701a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:35.668075 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-692428c7-b660-41b4-9c22-9494ed701a75 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:35.669538 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-692428c7-b660-41b4-9c22-9494ed701a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:35.674520 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 773/1556] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:22:35 2022] POST /identity/v3/projects => generated 391 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:22:35.674520 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba07e7c-f79f-46ec-83e0-dea5129d3052 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:35.730302 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 784/1557] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:35.731862 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ca86c-8c0f-419e-94dd-9d40c17be6a9 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:35.732171 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ca86c-8c0f-419e-94dd-9d40c17be6a9 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:35.732451 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ca86c-8c0f-419e-94dd-9d40c17be6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:35.736608 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba07e7c-f79f-46ec-83e0-dea5129d3052 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:35.741905 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d692f-0b7b-450d-adc4-1c37a94d5aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:35.742545 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d692f-0b7b-450d-adc4-1c37a94d5aec admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:35.742833 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d692f-0b7b-450d-adc4-1c37a94d5aec admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:35.743109 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d692f-0b7b-450d-adc4-1c37a94d5aec admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:35.743757 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d692f-0b7b-450d-adc4-1c37a94d5aec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:22:35.744064 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d692f-0b7b-450d-adc4-1c37a94d5aec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:35.745691 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d692f-0b7b-450d-adc4-1c37a94d5aec admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:35.753340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-387ca86c-8c0f-419e-94dd-9d40c17be6a9 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:35.754551 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-387ca86c-8c0f-419e-94dd-9d40c17be6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:35.760135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 774/1558] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:22:35.760135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0e268-988a-422a-841f-2da8ada30725 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:35.760135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0e268-988a-422a-841f-2da8ada30725 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:35.760135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0e268-988a-422a-841f-2da8ada30725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:35.769681 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 785/1559] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:35.771024 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c36750-a360-4ae2-a03a-e3f201a66fae None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:35.771316 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c36750-a360-4ae2-a03a-e3f201a66fae None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:35.771586 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c36750-a360-4ae2-a03a-e3f201a66fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:35.779556 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-5cb0e268-988a-422a-841f-2da8ada30725 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:35.780791 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5cb0e268-988a-422a-841f-2da8ada30725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:35.788696 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 775/1560] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:35.789502 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0e268-988a-422a-841f-2da8ada30725 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:35.790672 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-34c36750-a360-4ae2-a03a-e3f201a66fae None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:35.791842 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-34c36750-a360-4ae2-a03a-e3f201a66fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:35.798145 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:35.801130 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 786/1561] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:35.801945 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c36750-a360-4ae2-a03a-e3f201a66fae None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:35.802756 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0e268-988a-422a-841f-2da8ada30725 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:35.809901 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf2ab2-ef96-4fc2-a3b1-3f0a523df5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:35.810923 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf2ab2-ef96-4fc2-a3b1-3f0a523df5ef admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:35.810923 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf2ab2-ef96-4fc2-a3b1-3f0a523df5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:35.811189 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf2ab2-ef96-4fc2-a3b1-3f0a523df5ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:35.811886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf2ab2-ef96-4fc2-a3b1-3f0a523df5ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:35.812267 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c36750-a360-4ae2-a03a-e3f201a66fae None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:35.813850 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf2ab2-ef96-4fc2-a3b1-3f0a523df5ef admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:35.819976 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6784705-ffb4-4203-afe8-5054ef097c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:35.820599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6784705-ffb4-4203-afe8-5054ef097c88 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:35.820874 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6784705-ffb4-4203-afe8-5054ef097c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:35.821146 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6784705-ffb4-4203-afe8-5054ef097c88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:35.821832 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6784705-ffb4-4203-afe8-5054ef097c88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:35.823430 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6784705-ffb4-4203-afe8-5054ef097c88 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:35.829125 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:35.834066 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 787/1562] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:22:35.834839 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6784705-ffb4-4203-afe8-5054ef097c88 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:35.844393 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6784705-ffb4-4203-afe8-5054ef097c88 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:35.849472 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42666c-25a1-41f0-9572-12fdf0359dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:35.850146 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42666c-25a1-41f0-9572-12fdf0359dd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:35.850429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42666c-25a1-41f0-9572-12fdf0359dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:35.850696 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b42666c-25a1-41f0-9572-12fdf0359dd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:35.851337 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b42666c-25a1-41f0-9572-12fdf0359dd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:35.853269 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b42666c-25a1-41f0-9572-12fdf0359dd8 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:35.910463 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 776/1563] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:22:35 2022] POST /identity/v3/projects => generated 401 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:22:35.911675 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fd575-0133-4715-aa5d-9dca9df16080 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:35.911957 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fd575-0133-4715-aa5d-9dca9df16080 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:35.912260 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83fd575-0133-4715-aa5d-9dca9df16080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:35.930337 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 788/1564] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:22:35 2022] POST /identity/v3/users => generated 296 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:22:35.930337 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42666c-25a1-41f0-9572-12fdf0359dd8 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:35.935182 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f83fd575-0133-4715-aa5d-9dca9df16080 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:35.936505 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f83fd575-0133-4715-aa5d-9dca9df16080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:35.938312 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b42666c-25a1-41f0-9572-12fdf0359dd8 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:35.996518 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607d8c3-7e77-46f1-ab5b-61e5fd6e6999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:35.997137 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607d8c3-7e77-46f1-ab5b-61e5fd6e6999 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:35.997419 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607d8c3-7e77-46f1-ab5b-61e5fd6e6999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:35.997700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607d8c3-7e77-46f1-ab5b-61e5fd6e6999 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:35.997850 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 777/1565] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:35.998332 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607d8c3-7e77-46f1-ab5b-61e5fd6e6999 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:35.998550 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fd575-0133-4715-aa5d-9dca9df16080 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:35.999457 dv-cinder-749155-11-smb devstack@keystone.service[81777]: WARNING py.warnings [None req-a607d8c3-7e77-46f1-ab5b-61e5fd6e6999 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 21:22:35.999457 dv-cinder-749155-11-smb devstack@keystone.service[81777]: warnings.warn(msg) Sep 06 21:22:35.999457 dv-cinder-749155-11-smb devstack@keystone.service[81777]: Sep 06 21:22:36.000693 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607d8c3-7e77-46f1-ab5b-61e5fd6e6999 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:36.009188 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83fd575-0133-4715-aa5d-9dca9df16080 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:36.013930 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d947e13-514c-422e-995f-e986cdb4aa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:36.014542 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d947e13-514c-422e-995f-e986cdb4aa79 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:36.014848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d947e13-514c-422e-995f-e986cdb4aa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:36.015143 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d947e13-514c-422e-995f-e986cdb4aa79 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:36.015808 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d947e13-514c-422e-995f-e986cdb4aa79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:22:36.016137 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d947e13-514c-422e-995f-e986cdb4aa79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:36.017777 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d947e13-514c-422e-995f-e986cdb4aa79 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:36.029216 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 778/1566] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:22:36.030009 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d947e13-514c-422e-995f-e986cdb4aa79 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:36.040970 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d947e13-514c-422e-995f-e986cdb4aa79 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:36.045982 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27124d5-511e-44ea-af34-7c22f1f4c62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:36.046579 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27124d5-511e-44ea-af34-7c22f1f4c62f admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:36.046862 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27124d5-511e-44ea-af34-7c22f1f4c62f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:36.047135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27124d5-511e-44ea-af34-7c22f1f4c62f admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:36.047767 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27124d5-511e-44ea-af34-7c22f1f4c62f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:22:36.048067 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27124d5-511e-44ea-af34-7c22f1f4c62f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:36.051889 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27124d5-511e-44ea-af34-7c22f1f4c62f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:36.062324 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 779/1567] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:22:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:22:36.063115 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27124d5-511e-44ea-af34-7c22f1f4c62f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:36.075083 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27124d5-511e-44ea-af34-7c22f1f4c62f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:36.076247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 789/1568] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:22:35 2022] POST /identity/v3/projects => generated 379 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:22:36.077222 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607d8c3-7e77-46f1-ab5b-61e5fd6e6999 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:36.137048 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13255bc9-c7c8-4779-8e3f-7f972d771c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:36.137668 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13255bc9-c7c8-4779-8e3f-7f972d771c9f admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:36.137952 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13255bc9-c7c8-4779-8e3f-7f972d771c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:36.138361 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13255bc9-c7c8-4779-8e3f-7f972d771c9f admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:36.139012 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13255bc9-c7c8-4779-8e3f-7f972d771c9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:22:36.139316 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13255bc9-c7c8-4779-8e3f-7f972d771c9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:36.140631 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607d8c3-7e77-46f1-ab5b-61e5fd6e6999 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:36.140974 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13255bc9-c7c8-4779-8e3f-7f972d771c9f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:36.145426 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2710ec2-184f-4a40-a300-4074adbe7a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:36.146069 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2710ec2-184f-4a40-a300-4074adbe7a31 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:36.146375 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2710ec2-184f-4a40-a300-4074adbe7a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:36.146650 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2710ec2-184f-4a40-a300-4074adbe7a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:36.147291 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2710ec2-184f-4a40-a300-4074adbe7a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:36.148938 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2710ec2-184f-4a40-a300-4074adbe7a31 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:36.152739 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 780/1569] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:22:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:22:36.153622 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13255bc9-c7c8-4779-8e3f-7f972d771c9f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:36.163762 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13255bc9-c7c8-4779-8e3f-7f972d771c9f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:36.166213 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 790/1570] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:22:36.167134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2710ec2-184f-4a40-a300-4074adbe7a31 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:36.168638 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16af93-d6db-4b36-b5ad-ae5772e5129a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:36.169825 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16af93-d6db-4b36-b5ad-ae5772e5129a admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:36.170111 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16af93-d6db-4b36-b5ad-ae5772e5129a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:36.170387 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16af93-d6db-4b36-b5ad-ae5772e5129a admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:36.171018 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16af93-d6db-4b36-b5ad-ae5772e5129a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:36.172020 dv-cinder-749155-11-smb devstack@keystone.service[81778]: WARNING py.warnings [None req-4a16af93-d6db-4b36-b5ad-ae5772e5129a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 21:22:36.172020 dv-cinder-749155-11-smb devstack@keystone.service[81778]: warnings.warn(msg) Sep 06 21:22:36.172020 dv-cinder-749155-11-smb devstack@keystone.service[81778]: Sep 06 21:22:36.173335 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16af93-d6db-4b36-b5ad-ae5772e5129a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:36.177967 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2710ec2-184f-4a40-a300-4074adbe7a31 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:36.182669 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5f491-8c85-475a-ae11-4c0869e92cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:36.183273 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5f491-8c85-475a-ae11-4c0869e92cbe admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:36.183577 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5f491-8c85-475a-ae11-4c0869e92cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:36.183860 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5f491-8c85-475a-ae11-4c0869e92cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:36.184549 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5f491-8c85-475a-ae11-4c0869e92cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:36.186824 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5f491-8c85-475a-ae11-4c0869e92cbe admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:36.197169 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 791/1571] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:22:36.200209 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5f491-8c85-475a-ae11-4c0869e92cbe admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:36.207505 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5f491-8c85-475a-ae11-4c0869e92cbe admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:36.212066 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee45a1e-8aa6-4dbd-9123-e5123153aebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:36.212668 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee45a1e-8aa6-4dbd-9123-e5123153aebd admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:36.212953 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee45a1e-8aa6-4dbd-9123-e5123153aebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:36.213230 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee45a1e-8aa6-4dbd-9123-e5123153aebd admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:36.213857 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee45a1e-8aa6-4dbd-9123-e5123153aebd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:22:36.214162 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee45a1e-8aa6-4dbd-9123-e5123153aebd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:36.215757 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee45a1e-8aa6-4dbd-9123-e5123153aebd admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:36.228170 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 792/1572] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:22:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:22:36.228940 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee45a1e-8aa6-4dbd-9123-e5123153aebd admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:36.238794 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee45a1e-8aa6-4dbd-9123-e5123153aebd admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:36.243498 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a2f61-60ab-48c5-9473-f6277a0c6a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:36.244114 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a2f61-60ab-48c5-9473-f6277a0c6a0d admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:36.244411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a2f61-60ab-48c5-9473-f6277a0c6a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:36.244682 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1a2f61-60ab-48c5-9473-f6277a0c6a0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:36.245337 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a2f61-60ab-48c5-9473-f6277a0c6a0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:36.247232 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1a2f61-60ab-48c5-9473-f6277a0c6a0d admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:36.260069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 781/1573] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:22:36 2022] POST /identity/v3/users => generated 301 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:22:36.260786 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16af93-d6db-4b36-b5ad-ae5772e5129a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:36.271524 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16af93-d6db-4b36-b5ad-ae5772e5129a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:36.276261 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc8ad7-b452-4950-8134-c2e1eb41dce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:36.276878 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc8ad7-b452-4950-8134-c2e1eb41dce7 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:36.277163 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc8ad7-b452-4950-8134-c2e1eb41dce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:36.277438 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc8ad7-b452-4950-8134-c2e1eb41dce7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:36.278121 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc8ad7-b452-4950-8134-c2e1eb41dce7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:36.280025 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc8ad7-b452-4950-8134-c2e1eb41dce7 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:36.332595 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 793/1574] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:22:36 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:22:36.333524 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a2f61-60ab-48c5-9473-f6277a0c6a0d admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:36.352992 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:36.362492 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 782/1575] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:22:36 2022] POST /identity/v3/projects => generated 389 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:22:36.362492 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc8ad7-b452-4950-8134-c2e1eb41dce7 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:36.374620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:36.403132 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1a2f61-60ab-48c5-9473-f6277a0c6a0d admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:36.425892 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc8ad7-b452-4950-8134-c2e1eb41dce7 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:36.431005 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a8851-5461-4a59-9554-3fd229b7697b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:36.431835 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a8851-5461-4a59-9554-3fd229b7697b admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:36.432256 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a8851-5461-4a59-9554-3fd229b7697b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:36.432623 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a8851-5461-4a59-9554-3fd229b7697b admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:36.433411 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a8851-5461-4a59-9554-3fd229b7697b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:36.435717 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a8851-5461-4a59-9554-3fd229b7697b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:36.463341 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41beaf-876b-4df4-a124-fdc6624acf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:36.464017 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41beaf-876b-4df4-a124-fdc6624acf6a admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:36.464453 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41beaf-876b-4df4-a124-fdc6624acf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:36.464733 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41beaf-876b-4df4-a124-fdc6624acf6a admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:36.465361 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41beaf-876b-4df4-a124-fdc6624acf6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:36.467364 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41beaf-876b-4df4-a124-fdc6624acf6a admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:36.507307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 783/1576] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:22:36 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:22:36.507307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a8851-5461-4a59-9554-3fd229b7697b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:36.548651 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 794/1577] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:22:36 2022] POST /identity/v3/users => generated 290 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:22:36.551126 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41beaf-876b-4df4-a124-fdc6624acf6a admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:36.561676 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41beaf-876b-4df4-a124-fdc6624acf6a admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:36.566974 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad675ec3-9a63-47ce-8b9e-6df9327eb324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:36.567667 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad675ec3-9a63-47ce-8b9e-6df9327eb324 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:36.567947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad675ec3-9a63-47ce-8b9e-6df9327eb324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:36.568259 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad675ec3-9a63-47ce-8b9e-6df9327eb324 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:36.568903 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad675ec3-9a63-47ce-8b9e-6df9327eb324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:36.569014 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a8851-5461-4a59-9554-3fd229b7697b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:36.570581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad675ec3-9a63-47ce-8b9e-6df9327eb324 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:36.573711 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c116590-7f05-4a3a-8e99-7f50db8f8a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:36.574380 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c116590-7f05-4a3a-8e99-7f50db8f8a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:36.574662 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c116590-7f05-4a3a-8e99-7f50db8f8a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:36.574939 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c116590-7f05-4a3a-8e99-7f50db8f8a5d admin admin] PATH_INFO: `/v3/projects/b0c73543f3f14dd7bd183255594ee8f4/users/3163c51824b74260ab73e068b7a7fa58/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:36.581553 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 795/1578] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:22:36.582371 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad675ec3-9a63-47ce-8b9e-6df9327eb324 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:36.591967 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c116590-7f05-4a3a-8e99-7f50db8f8a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0c73543f3f14dd7bd183255594ee8f4, user_id=3163c51824b74260ab73e068b7a7fa58, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:36.592210 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad675ec3-9a63-47ce-8b9e-6df9327eb324 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:36.594695 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c116590-7f05-4a3a-8e99-7f50db8f8a5d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:36.597458 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029026ec-ad40-4b07-bf29-b0c944d3760c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:36.598048 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029026ec-ad40-4b07-bf29-b0c944d3760c admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:36.598331 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029026ec-ad40-4b07-bf29-b0c944d3760c admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:36.598604 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029026ec-ad40-4b07-bf29-b0c944d3760c admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:36.599221 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029026ec-ad40-4b07-bf29-b0c944d3760c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:36.601138 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029026ec-ad40-4b07-bf29-b0c944d3760c admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:36.674683 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 784/1579] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:22:36 2022] PUT /identity/v3/projects/b0c73543f3f14dd7bd183255594ee8f4/users/3163c51824b74260ab73e068b7a7fa58/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:22:36.675512 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c116590-7f05-4a3a-8e99-7f50db8f8a5d admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:36.705041 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 796/1580] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:22:36 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:22:36.705041 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029026ec-ad40-4b07-bf29-b0c944d3760c admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:36.742857 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c116590-7f05-4a3a-8e99-7f50db8f8a5d admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:36.763259 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029026ec-ad40-4b07-bf29-b0c944d3760c admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:36.766555 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:36.768927 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcebf34-c5e7-461a-b37a-a3a57bb7eff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:36.769539 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcebf34-c5e7-461a-b37a-a3a57bb7eff7 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:36.769880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcebf34-c5e7-461a-b37a-a3a57bb7eff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:36.770275 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcebf34-c5e7-461a-b37a-a3a57bb7eff7 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:36.770902 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcebf34-c5e7-461a-b37a-a3a57bb7eff7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:36.772863 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcebf34-c5e7-461a-b37a-a3a57bb7eff7 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:36.800048 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699e3a6-0bde-4d33-b09e-fb2b008aa275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:36.800686 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699e3a6-0bde-4d33-b09e-fb2b008aa275 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:36.800968 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699e3a6-0bde-4d33-b09e-fb2b008aa275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:36.801240 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699e3a6-0bde-4d33-b09e-fb2b008aa275 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:36.801874 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699e3a6-0bde-4d33-b09e-fb2b008aa275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:36.803463 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699e3a6-0bde-4d33-b09e-fb2b008aa275 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:36.816879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 785/1581] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:22:36.816879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699e3a6-0bde-4d33-b09e-fb2b008aa275 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:36.827604 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699e3a6-0bde-4d33-b09e-fb2b008aa275 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:36.832943 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a660e4-ec15-473f-a1e1-7a7a99d13ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:36.833592 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a660e4-ec15-473f-a1e1-7a7a99d13ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:36.833865 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a660e4-ec15-473f-a1e1-7a7a99d13ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:36.834140 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a660e4-ec15-473f-a1e1-7a7a99d13ad7 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:36.834761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a660e4-ec15-473f-a1e1-7a7a99d13ad7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:36.836773 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a660e4-ec15-473f-a1e1-7a7a99d13ad7 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:36.874501 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 797/1582] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:22:36 2022] POST /identity/v3/users => generated 285 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:22:36.875386 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcebf34-c5e7-461a-b37a-a3a57bb7eff7 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:36.886168 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcebf34-c5e7-461a-b37a-a3a57bb7eff7 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:36.891132 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf97c76-7946-4fa5-9447-93dab986396a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:36.891585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf97c76-7946-4fa5-9447-93dab986396a admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:36.891892 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf97c76-7946-4fa5-9447-93dab986396a admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:36.892745 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf97c76-7946-4fa5-9447-93dab986396a admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:36.893366 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf97c76-7946-4fa5-9447-93dab986396a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:36.895301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf97c76-7946-4fa5-9447-93dab986396a admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:36.905557 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:36.949364 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 786/1583] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:22:36 2022] POST /identity/v3/users => generated 295 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:22:36.949731 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a660e4-ec15-473f-a1e1-7a7a99d13ad7 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:36.960041 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a660e4-ec15-473f-a1e1-7a7a99d13ad7 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:36.965030 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619bb3f-ea3c-4ba7-8374-791eec7e08f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:36.965661 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619bb3f-ea3c-4ba7-8374-791eec7e08f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:36.965939 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619bb3f-ea3c-4ba7-8374-791eec7e08f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:36.966212 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619bb3f-ea3c-4ba7-8374-791eec7e08f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:36.966876 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1619bb3f-ea3c-4ba7-8374-791eec7e08f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:36.968505 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1619bb3f-ea3c-4ba7-8374-791eec7e08f3 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:36.978237 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 798/1584] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:22:36 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:22:36.979045 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf97c76-7946-4fa5-9447-93dab986396a admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:36.985377 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 787/1585] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:22:36.985377 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d970abd-b3e7-4ac3-ab60-b1377d36e9b0 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:36.985377 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d970abd-b3e7-4ac3-ab60-b1377d36e9b0 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:36.985377 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d970abd-b3e7-4ac3-ab60-b1377d36e9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:36.991207 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf97c76-7946-4fa5-9447-93dab986396a admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:36.995925 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d069bdf-3199-4482-99e0-4d52b615ef6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:36.996632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d069bdf-3199-4482-99e0-4d52b615ef6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:36.996915 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d069bdf-3199-4482-99e0-4d52b615ef6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:36.997186 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d069bdf-3199-4482-99e0-4d52b615ef6a admin admin] PATH_INFO: `/v3/projects/9d7eb586a5284df5b9bc2e10f80b98db/users/f3fabba09a4746328dcee545ff38cf78/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:37.011124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-7d970abd-b3e7-4ac3-ab60-b1377d36e9b0 None None] MFA Rules not processed for user `3163c51824b74260ab73e068b7a7fa58`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:37.012356 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7d970abd-b3e7-4ac3-ab60-b1377d36e9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:37.013290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d069bdf-3199-4482-99e0-4d52b615ef6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d7eb586a5284df5b9bc2e10f80b98db, user_id=f3fabba09a4746328dcee545ff38cf78, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:37.014358 dv-cinder-749155-11-smb devstack@keystone.service[81777]: WARNING py.warnings [None req-1d069bdf-3199-4482-99e0-4d52b615ef6a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 21:22:37.014358 dv-cinder-749155-11-smb devstack@keystone.service[81777]: warnings.warn(msg) Sep 06 21:22:37.014358 dv-cinder-749155-11-smb devstack@keystone.service[81777]: Sep 06 21:22:37.016441 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d069bdf-3199-4482-99e0-4d52b615ef6a admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:37.077504 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 788/1586] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:37.078476 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d970abd-b3e7-4ac3-ab60-b1377d36e9b0 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:37.089018 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d970abd-b3e7-4ac3-ab60-b1377d36e9b0 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:37.093533 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405bcd7-7bb7-4677-9f02-42df2cd54e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:37.094121 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405bcd7-7bb7-4677-9f02-42df2cd54e1a admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:37.094400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405bcd7-7bb7-4677-9f02-42df2cd54e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:37.094672 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405bcd7-7bb7-4677-9f02-42df2cd54e1a admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:37.095318 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405bcd7-7bb7-4677-9f02-42df2cd54e1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:37.097260 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405bcd7-7bb7-4677-9f02-42df2cd54e1a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:37.108527 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 799/1587] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:22:36 2022] PUT /identity/v3/projects/9d7eb586a5284df5b9bc2e10f80b98db/users/f3fabba09a4746328dcee545ff38cf78/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:22:37.109355 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d069bdf-3199-4482-99e0-4d52b615ef6a admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:37.169857 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d069bdf-3199-4482-99e0-4d52b615ef6a admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:37.174529 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402db4bf-159b-4a43-b834-81e1d6b638e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:37.175189 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402db4bf-159b-4a43-b834-81e1d6b638e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:37.175471 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402db4bf-159b-4a43-b834-81e1d6b638e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:37.175773 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402db4bf-159b-4a43-b834-81e1d6b638e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:37.176488 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402db4bf-159b-4a43-b834-81e1d6b638e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:37.178128 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402db4bf-159b-4a43-b834-81e1d6b638e4 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:37.189589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 800/1588] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:22:37.190656 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402db4bf-159b-4a43-b834-81e1d6b638e4 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:37.195622 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 789/1589] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:22:37 2022] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:22:37.198342 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405bcd7-7bb7-4677-9f02-42df2cd54e1a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:37.202438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402db4bf-159b-4a43-b834-81e1d6b638e4 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:37.208477 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405bcd7-7bb7-4677-9f02-42df2cd54e1a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:37.208844 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1007c7-95a1-4c04-a756-4858ca4e581f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:37.209454 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1007c7-95a1-4c04-a756-4858ca4e581f admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:37.209769 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1007c7-95a1-4c04-a756-4858ca4e581f admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:37.210234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1007c7-95a1-4c04-a756-4858ca4e581f admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:37.210812 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1007c7-95a1-4c04-a756-4858ca4e581f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:37.212447 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1007c7-95a1-4c04-a756-4858ca4e581f admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:37.213267 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47dbf1-670a-40eb-ab45-20340f167e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:37.213871 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47dbf1-670a-40eb-ab45-20340f167e2f admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:37.214184 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47dbf1-670a-40eb-ab45-20340f167e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:37.214459 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47dbf1-670a-40eb-ab45-20340f167e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:37.215103 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47dbf1-670a-40eb-ab45-20340f167e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:37.216749 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47dbf1-670a-40eb-ab45-20340f167e2f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:37.224429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 801/1590] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:22:37.224429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1007c7-95a1-4c04-a756-4858ca4e581f admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:37.230765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 790/1591] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:22:37.230765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47dbf1-670a-40eb-ab45-20340f167e2f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:37.234719 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1007c7-95a1-4c04-a756-4858ca4e581f admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:37.239956 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332fc40-47e6-4221-962e-706ed4faf438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:37.240585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332fc40-47e6-4221-962e-706ed4faf438 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:37.240867 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332fc40-47e6-4221-962e-706ed4faf438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:37.240976 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47dbf1-670a-40eb-ab45-20340f167e2f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:37.241138 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332fc40-47e6-4221-962e-706ed4faf438 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:37.241773 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332fc40-47e6-4221-962e-706ed4faf438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:37.243602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332fc40-47e6-4221-962e-706ed4faf438 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:37.245695 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd49b0-520f-4935-8950-fe587866283f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:37.246297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd49b0-520f-4935-8950-fe587866283f admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:37.246584 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd49b0-520f-4935-8950-fe587866283f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:37.246863 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd49b0-520f-4935-8950-fe587866283f admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:37.247514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd49b0-520f-4935-8950-fe587866283f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:37.249157 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd49b0-520f-4935-8950-fe587866283f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:37.257546 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 802/1592] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:22:37.258563 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332fc40-47e6-4221-962e-706ed4faf438 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:37.265576 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 791/1593] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:22:37.266759 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf5c83-87b7-4e75-b078-d5bdaf336bf8 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:37.267588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf5c83-87b7-4e75-b078-d5bdaf336bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:37.267986 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf5c83-87b7-4e75-b078-d5bdaf336bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:37.274188 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332fc40-47e6-4221-962e-706ed4faf438 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:37.279137 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12edb1a3-acfe-4644-973b-2cae18b98060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:37.279737 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edb1a3-acfe-4644-973b-2cae18b98060 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:37.280016 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edb1a3-acfe-4644-973b-2cae18b98060 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:37.280315 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edb1a3-acfe-4644-973b-2cae18b98060 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:37.280935 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12edb1a3-acfe-4644-973b-2cae18b98060 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:37.283368 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12edb1a3-acfe-4644-973b-2cae18b98060 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:37.287437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-59cf5c83-87b7-4e75-b078-d5bdaf336bf8 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:37.288747 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-59cf5c83-87b7-4e75-b078-d5bdaf336bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:37.296583 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 792/1594] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:37.297346 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf5c83-87b7-4e75-b078-d5bdaf336bf8 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:37.309277 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf5c83-87b7-4e75-b078-d5bdaf336bf8 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:37.313767 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32fab3-d6bc-4fe9-b76a-b274a40d663a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:37.321390 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32fab3-d6bc-4fe9-b76a-b274a40d663a admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:37.321390 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32fab3-d6bc-4fe9-b76a-b274a40d663a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:37.321390 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32fab3-d6bc-4fe9-b76a-b274a40d663a admin admin] PATH_INFO: `/v3/projects/a55d9d6a71474f0fa5432ee50278abe1/users/87ba1c59bb534a1f904b1ced61a078f2/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:37.328957 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f32fab3-d6bc-4fe9-b76a-b274a40d663a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a55d9d6a71474f0fa5432ee50278abe1, user_id=87ba1c59bb534a1f904b1ced61a078f2, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:37.332538 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f32fab3-d6bc-4fe9-b76a-b274a40d663a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:37.401524 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 803/1595] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:22:37 2022] POST /identity/v3/projects => generated 381 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:22:37.402511 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12edb1a3-acfe-4644-973b-2cae18b98060 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:37.430617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 793/1596] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:22:37 2022] PUT /identity/v3/projects/a55d9d6a71474f0fa5432ee50278abe1/users/87ba1c59bb534a1f904b1ced61a078f2/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:22:37.431573 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32fab3-d6bc-4fe9-b76a-b274a40d663a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:37.445480 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:37.477340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12edb1a3-acfe-4644-973b-2cae18b98060 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:37.497167 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32fab3-d6bc-4fe9-b76a-b274a40d663a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:37.502011 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9c72a-acb7-4294-9b3c-79ff51e54749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:37.502629 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9c72a-acb7-4294-9b3c-79ff51e54749 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:37.502911 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9c72a-acb7-4294-9b3c-79ff51e54749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:37.503181 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9c72a-acb7-4294-9b3c-79ff51e54749 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:37.503294 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:37.503823 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9c72a-acb7-4294-9b3c-79ff51e54749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:37.505452 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9c72a-acb7-4294-9b3c-79ff51e54749 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:37.515672 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 794/1597] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:22:37.516644 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9c72a-acb7-4294-9b3c-79ff51e54749 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:37.527719 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9c72a-acb7-4294-9b3c-79ff51e54749 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:37.532417 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4c0e0-23df-42cd-9b6f-67f652f432ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:37.533596 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4c0e0-23df-42cd-9b6f-67f652f432ab admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:37.533878 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4c0e0-23df-42cd-9b6f-67f652f432ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:37.534151 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4c0e0-23df-42cd-9b6f-67f652f432ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:37.534355 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e9b69-185c-4634-afc8-9ff9e207a1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:37.534786 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4c0e0-23df-42cd-9b6f-67f652f432ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:37.534969 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e9b69-185c-4634-afc8-9ff9e207a1c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:37.535250 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e9b69-185c-4634-afc8-9ff9e207a1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:37.535524 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e9b69-185c-4634-afc8-9ff9e207a1c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:37.536200 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e9b69-185c-4634-afc8-9ff9e207a1c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:37.536497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4c0e0-23df-42cd-9b6f-67f652f432ab admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:37.537785 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3e9b69-185c-4634-afc8-9ff9e207a1c1 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:37.546586 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 795/1598] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:22:37.547376 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4c0e0-23df-42cd-9b6f-67f652f432ab admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:37.552068 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 804/1599] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:22:37.552068 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e9b69-185c-4634-afc8-9ff9e207a1c1 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:37.557850 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4c0e0-23df-42cd-9b6f-67f652f432ab admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:37.562157 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3e9b69-185c-4634-afc8-9ff9e207a1c1 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:37.562676 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549751c1-e06c-42f4-819c-bbc4bd631bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:37.563340 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549751c1-e06c-42f4-819c-bbc4bd631bd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:37.563622 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549751c1-e06c-42f4-819c-bbc4bd631bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:37.564432 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549751c1-e06c-42f4-819c-bbc4bd631bd7 admin admin] PATH_INFO: `/v3/projects/97fb647ae3424cbe820eaf015be7e7d2/users/c225198d426c46fd8f30afb37d753a3b/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:37.567288 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067f73c-73bf-4e9b-8484-7f991e88a309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:37.567885 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067f73c-73bf-4e9b-8484-7f991e88a309 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:37.568199 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067f73c-73bf-4e9b-8484-7f991e88a309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:37.568480 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067f73c-73bf-4e9b-8484-7f991e88a309 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:37.569110 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067f73c-73bf-4e9b-8484-7f991e88a309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:37.570739 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067f73c-73bf-4e9b-8484-7f991e88a309 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:37.580692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549751c1-e06c-42f4-819c-bbc4bd631bd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97fb647ae3424cbe820eaf015be7e7d2, user_id=c225198d426c46fd8f30afb37d753a3b, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:37.582348 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 805/1600] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:22:37.582348 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067f73c-73bf-4e9b-8484-7f991e88a309 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:37.583434 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549751c1-e06c-42f4-819c-bbc4bd631bd7 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:37.638980 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067f73c-73bf-4e9b-8484-7f991e88a309 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:37.645684 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 796/1601] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:22:37 2022] PUT /identity/v3/projects/97fb647ae3424cbe820eaf015be7e7d2/users/c225198d426c46fd8f30afb37d753a3b/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:22:37.646580 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549751c1-e06c-42f4-819c-bbc4bd631bd7 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:37.690156 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6db28-bbab-40b2-8eca-6900eae8aa80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:37.691054 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6db28-bbab-40b2-8eca-6900eae8aa80 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:37.691331 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6db28-bbab-40b2-8eca-6900eae8aa80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:37.691598 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6db28-bbab-40b2-8eca-6900eae8aa80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:37.713594 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549751c1-e06c-42f4-819c-bbc4bd631bd7 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:37.718315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d5c23-b4a6-4253-af5a-ef61b9883fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:37.718924 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d5c23-b4a6-4253-af5a-ef61b9883fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:37.719207 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d5c23-b4a6-4253-af5a-ef61b9883fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:37.719478 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d5c23-b4a6-4253-af5a-ef61b9883fa2 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:37.720125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d5c23-b4a6-4253-af5a-ef61b9883fa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:37.722552 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5d5c23-b4a6-4253-af5a-ef61b9883fa2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:37.752168 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6db28-bbab-40b2-8eca-6900eae8aa80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:37.753555 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6db28-bbab-40b2-8eca-6900eae8aa80 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:37.763661 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 806/1602] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:22:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:22:37.765086 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ad775-b091-4cf2-9a0b-59cfc3c5c7ba None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:37.765374 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ad775-b091-4cf2-9a0b-59cfc3c5c7ba None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:37.765654 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ad775-b091-4cf2-9a0b-59cfc3c5c7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:37.794153 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-bb8ad775-b091-4cf2-9a0b-59cfc3c5c7ba None None] MFA Rules not processed for user `87ba1c59bb534a1f904b1ced61a078f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:37.795396 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-bb8ad775-b091-4cf2-9a0b-59cfc3c5c7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:37.804321 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:37.818243 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 797/1603] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:22:37 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:22:37.819810 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d5c23-b4a6-4253-af5a-ef61b9883fa2 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:37.829559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d5c23-b4a6-4253-af5a-ef61b9883fa2 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:37.834204 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62a593-85eb-43d5-94d5-74d753118376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:37.834857 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62a593-85eb-43d5-94d5-74d753118376 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:37.835131 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62a593-85eb-43d5-94d5-74d753118376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:37.835454 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62a593-85eb-43d5-94d5-74d753118376 admin admin] PATH_INFO: `/v3/projects/d868149af06f40cbabe8bbfb63e3d878/users/434a51ca0fb94799a493f436417016a5/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:37.853063 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62a593-85eb-43d5-94d5-74d753118376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d868149af06f40cbabe8bbfb63e3d878, user_id=434a51ca0fb94799a493f436417016a5, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:37.855724 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a62a593-85eb-43d5-94d5-74d753118376 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:37.865776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 807/1604] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:37 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:37.866722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ad775-b091-4cf2-9a0b-59cfc3c5c7ba None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:37.881400 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ad775-b091-4cf2-9a0b-59cfc3c5c7ba None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:37.887290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8305f9-6cef-4e5b-8c72-574fc581a106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:37.888801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8305f9-6cef-4e5b-8c72-574fc581a106 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:37.889156 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8305f9-6cef-4e5b-8c72-574fc581a106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:37.889759 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8305f9-6cef-4e5b-8c72-574fc581a106 admin admin] PATH_INFO: `/v3/projects/15e5a4d7e5cd4bfd9af9e3e3d4c5a0ca/users/7f06e823c4ad4725896e7452eecfcc4c/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:37.908961 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8305f9-6cef-4e5b-8c72-574fc581a106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15e5a4d7e5cd4bfd9af9e3e3d4c5a0ca, user_id=7f06e823c4ad4725896e7452eecfcc4c, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:37.912208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8305f9-6cef-4e5b-8c72-574fc581a106 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:37.955424 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 798/1605] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:22:37 2022] PUT /identity/v3/projects/d868149af06f40cbabe8bbfb63e3d878/users/434a51ca0fb94799a493f436417016a5/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:22:37.956164 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62a593-85eb-43d5-94d5-74d753118376 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:37.978088 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 808/1606] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:22:37 2022] PUT /identity/v3/projects/15e5a4d7e5cd4bfd9af9e3e3d4c5a0ca/users/7f06e823c4ad4725896e7452eecfcc4c/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:22:37.978944 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8305f9-6cef-4e5b-8c72-574fc581a106 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:38.007464 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:38.030809 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62a593-85eb-43d5-94d5-74d753118376 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:38.049049 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8305f9-6cef-4e5b-8c72-574fc581a106 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:38.055640 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255d944-3db9-43d0-9e26-6159d7ac9d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:38.056574 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255d944-3db9-43d0-9e26-6159d7ac9d91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:38.056917 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255d944-3db9-43d0-9e26-6159d7ac9d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:38.057252 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255d944-3db9-43d0-9e26-6159d7ac9d91 admin admin] PATH_INFO: `/v3/projects/7f074237bbd947f686615e2d05c7a30d/users/f5835f0d03e84cdc92bad4375ba01d91/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:38.073683 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255d944-3db9-43d0-9e26-6159d7ac9d91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f074237bbd947f686615e2d05c7a30d, user_id=f5835f0d03e84cdc92bad4375ba01d91, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:38.076866 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255d944-3db9-43d0-9e26-6159d7ac9d91 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:38.100312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50d978-e9bd-477d-91f4-4890c0910981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:38.100312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50d978-e9bd-477d-91f4-4890c0910981 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:38.100312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50d978-e9bd-477d-91f4-4890c0910981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:38.100312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50d978-e9bd-477d-91f4-4890c0910981 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:38.101036 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50d978-e9bd-477d-91f4-4890c0910981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:38.101341 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df50d978-e9bd-477d-91f4-4890c0910981 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:38.112893 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 799/1607] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:22:38.114323 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551ca36-8760-4462-938c-d47ed5b35ea2 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:38.114616 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551ca36-8760-4462-938c-d47ed5b35ea2 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:38.114895 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1551ca36-8760-4462-938c-d47ed5b35ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:38.134483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-1551ca36-8760-4462-938c-d47ed5b35ea2 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:38.135830 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1551ca36-8760-4462-938c-d47ed5b35ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:38.144233 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 800/1608] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:38.145122 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551ca36-8760-4462-938c-d47ed5b35ea2 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:38.155250 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1551ca36-8760-4462-938c-d47ed5b35ea2 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:38.162402 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 809/1609] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:22:37 2022] PUT /identity/v3/projects/7f074237bbd947f686615e2d05c7a30d/users/f5835f0d03e84cdc92bad4375ba01d91/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:22:38.164037 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255d944-3db9-43d0-9e26-6159d7ac9d91 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:38.240129 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c2b0a-00cb-40ca-a6f8-e047534f2edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:38.241019 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c2b0a-00cb-40ca-a6f8-e047534f2edd admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:38.241310 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c2b0a-00cb-40ca-a6f8-e047534f2edd admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:38.241587 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c2b0a-00cb-40ca-a6f8-e047534f2edd admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:38.242898 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c2b0a-00cb-40ca-a6f8-e047534f2edd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:38.244827 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c2b0a-00cb-40ca-a6f8-e047534f2edd admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:38.256519 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 801/1610] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:22:38.258009 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157836e-9304-4453-ade6-38941208a7c9 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:38.258247 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157836e-9304-4453-ade6-38941208a7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:38.258510 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157836e-9304-4453-ade6-38941208a7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:38.262024 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255d944-3db9-43d0-9e26-6159d7ac9d91 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:38.273661 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c304e2-a0a1-47a4-b572-e8bb5f89200f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:38.274573 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c304e2-a0a1-47a4-b572-e8bb5f89200f admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:38.274922 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c304e2-a0a1-47a4-b572-e8bb5f89200f admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:38.275262 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c304e2-a0a1-47a4-b572-e8bb5f89200f admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:38.275972 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c304e2-a0a1-47a4-b572-e8bb5f89200f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:38.278212 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c304e2-a0a1-47a4-b572-e8bb5f89200f admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:38.293599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a157836e-9304-4453-ade6-38941208a7c9 None None] MFA Rules not processed for user `434a51ca0fb94799a493f436417016a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:38.295114 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a157836e-9304-4453-ade6-38941208a7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:38.298361 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:38.375478 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 802/1611] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:38.377294 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068466d-5c6e-4d28-b936-d311f2f3e313 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:38.377581 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068466d-5c6e-4d28-b936-d311f2f3e313 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:38.377906 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e068466d-5c6e-4d28-b936-d311f2f3e313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:38.385883 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:38.394399 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 810/1612] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:22:38 2022] POST /identity/v3/projects => generated 401 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:22:38.394878 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c304e2-a0a1-47a4-b572-e8bb5f89200f admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:38.401177 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-e068466d-5c6e-4d28-b936-d311f2f3e313 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:38.402410 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e068466d-5c6e-4d28-b936-d311f2f3e313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:38.472452 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 803/1613] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:38.475945 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068466d-5c6e-4d28-b936-d311f2f3e313 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:38.475945 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e068466d-5c6e-4d28-b936-d311f2f3e313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:38.483322 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c304e2-a0a1-47a4-b572-e8bb5f89200f admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:38.488719 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47f250-7105-4b63-8b37-e5adabc71592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:38.489412 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47f250-7105-4b63-8b37-e5adabc71592 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:38.489891 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47f250-7105-4b63-8b37-e5adabc71592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:38.490211 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47f250-7105-4b63-8b37-e5adabc71592 admin admin] PATH_INFO: `/v3/projects/c28dfa296c2c46088aa3b19e550ee828/users/7ad886fd7cd445a18918965391eade77/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:38.507770 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47f250-7105-4b63-8b37-e5adabc71592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c28dfa296c2c46088aa3b19e550ee828, user_id=7ad886fd7cd445a18918965391eade77, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:38.510552 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c47f250-7105-4b63-8b37-e5adabc71592 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:38.543270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e068466d-5c6e-4d28-b936-d311f2f3e313 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:38.547397 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3dd1c-43eb-4722-9e5a-516920bc458c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:38.548127 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3dd1c-43eb-4722-9e5a-516920bc458c service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:38.548523 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3dd1c-43eb-4722-9e5a-516920bc458c service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:38.548806 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3dd1c-43eb-4722-9e5a-516920bc458c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:38.559066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3dd1c-43eb-4722-9e5a-516920bc458c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:38.560535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3dd1c-43eb-4722-9e5a-516920bc458c service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:38.571475 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 804/1614] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:22:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:22:38.575179 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0027a-4c30-4640-927d-ef6edc71a516 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:38.575179 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0027a-4c30-4640-927d-ef6edc71a516 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:38.575179 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0027a-4c30-4640-927d-ef6edc71a516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:38.578179 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 811/1615] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:22:38 2022] PUT /identity/v3/projects/c28dfa296c2c46088aa3b19e550ee828/users/7ad886fd7cd445a18918965391eade77/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:22:38.578899 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47f250-7105-4b63-8b37-e5adabc71592 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:38.605856 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-04d0027a-4c30-4640-927d-ef6edc71a516 None None] MFA Rules not processed for user `f5835f0d03e84cdc92bad4375ba01d91`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:38.608074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-04d0027a-4c30-4640-927d-ef6edc71a516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:38.662867 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47f250-7105-4b63-8b37-e5adabc71592 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:38.668740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17b89e-e605-4a96-86a9-ffe34d061103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:38.669898 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17b89e-e605-4a96-86a9-ffe34d061103 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:38.670179 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17b89e-e605-4a96-86a9-ffe34d061103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:38.670456 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17b89e-e605-4a96-86a9-ffe34d061103 admin admin] PATH_INFO: `/v3/projects/03dae27e2d824c5d907c6864cdeb938c/users/3ef9dfb7a2e145baaa62220ee15713d9/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:38.683389 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 805/1616] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:38.684334 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0027a-4c30-4640-927d-ef6edc71a516 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:38.693340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17b89e-e605-4a96-86a9-ffe34d061103 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03dae27e2d824c5d907c6864cdeb938c, user_id=3ef9dfb7a2e145baaa62220ee15713d9, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:38.697043 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17b89e-e605-4a96-86a9-ffe34d061103 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:38.699780 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0027a-4c30-4640-927d-ef6edc71a516 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:38.705930 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25afbb5-c955-4e9e-ad02-bb99b75a4ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:38.709485 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25afbb5-c955-4e9e-ad02-bb99b75a4ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:38.709485 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25afbb5-c955-4e9e-ad02-bb99b75a4ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:38.709485 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25afbb5-c955-4e9e-ad02-bb99b75a4ab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:38.709485 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25afbb5-c955-4e9e-ad02-bb99b75a4ab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:38.710093 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25afbb5-c955-4e9e-ad02-bb99b75a4ab2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:38.748697 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 812/1617] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:22:38 2022] PUT /identity/v3/projects/03dae27e2d824c5d907c6864cdeb938c/users/3ef9dfb7a2e145baaa62220ee15713d9/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:22:38.753015 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17b89e-e605-4a96-86a9-ffe34d061103 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:38.805796 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 806/1618] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:22:38 2022] POST /identity/v3/projects => generated 369 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:22:38.805796 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25afbb5-c955-4e9e-ad02-bb99b75a4ab2 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:38.819236 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:38.824239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17b89e-e605-4a96-86a9-ffe34d061103 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:38.825665 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:38.865307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25afbb5-c955-4e9e-ad02-bb99b75a4ab2 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:38.869307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec8a49-b8de-4973-bced-b7a4e11434c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:38.870016 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec8a49-b8de-4973-bced-b7a4e11434c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:38.870700 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec8a49-b8de-4973-bced-b7a4e11434c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:38.870979 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec8a49-b8de-4973-bced-b7a4e11434c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:38.886503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d287f9-fe18-4636-bab5-8a1f3a4b0734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:38.887472 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d287f9-fe18-4636-bab5-8a1f3a4b0734 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:38.887799 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d287f9-fe18-4636-bab5-8a1f3a4b0734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:38.888130 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d287f9-fe18-4636-bab5-8a1f3a4b0734 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:38.888803 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d287f9-fe18-4636-bab5-8a1f3a4b0734 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:38.890938 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d287f9-fe18-4636-bab5-8a1f3a4b0734 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:38.945860 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec8a49-b8de-4973-bced-b7a4e11434c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:38.947493 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec8a49-b8de-4973-bced-b7a4e11434c7 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:38.959760 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 807/1619] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:22:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:22:38.961813 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71413f86-a9a8-4ee2-934d-ff9033307da3 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:38.962086 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71413f86-a9a8-4ee2-934d-ff9033307da3 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:38.962358 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71413f86-a9a8-4ee2-934d-ff9033307da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:38.982891 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-71413f86-a9a8-4ee2-934d-ff9033307da3 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:38.984374 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-71413f86-a9a8-4ee2-934d-ff9033307da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:38.998145 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 808/1620] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:39.002711 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71413f86-a9a8-4ee2-934d-ff9033307da3 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:39.010491 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 813/1621] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:22:38 2022] POST /identity/v3/users => generated 307 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:22:39.011423 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d287f9-fe18-4636-bab5-8a1f3a4b0734 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:39.018097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71413f86-a9a8-4ee2-934d-ff9033307da3 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:39.028277 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f3bee-f137-4990-858b-d191a18e0ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:39.028277 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f3bee-f137-4990-858b-d191a18e0ecf admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:39.028277 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f3bee-f137-4990-858b-d191a18e0ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:39.028277 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f3bee-f137-4990-858b-d191a18e0ecf admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:39.028987 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f3bee-f137-4990-858b-d191a18e0ecf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:39.031045 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f3bee-f137-4990-858b-d191a18e0ecf admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:39.034547 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d287f9-fe18-4636-bab5-8a1f3a4b0734 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:39.051574 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534312a-034f-4fd6-aaa2-3d6f6394ad7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:39.053825 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534312a-034f-4fd6-aaa2-3d6f6394ad7c admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:39.054342 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534312a-034f-4fd6-aaa2-3d6f6394ad7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:39.054689 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534312a-034f-4fd6-aaa2-3d6f6394ad7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:39.055417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3534312a-034f-4fd6-aaa2-3d6f6394ad7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:39.059833 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3534312a-034f-4fd6-aaa2-3d6f6394ad7c admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:39.072146 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 814/1622] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:22:39.073087 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534312a-034f-4fd6-aaa2-3d6f6394ad7c admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:39.083759 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534312a-034f-4fd6-aaa2-3d6f6394ad7c admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:39.097264 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fae8b6-5e21-496d-bbbc-81337216c333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:39.097604 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fae8b6-5e21-496d-bbbc-81337216c333 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:39.097604 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fae8b6-5e21-496d-bbbc-81337216c333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:39.097999 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fae8b6-5e21-496d-bbbc-81337216c333 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:39.098529 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fae8b6-5e21-496d-bbbc-81337216c333 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:39.100548 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fae8b6-5e21-496d-bbbc-81337216c333 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:39.117019 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 809/1623] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:22:38 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:22:39.117866 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f3bee-f137-4990-858b-d191a18e0ecf admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:39.178811 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f3bee-f137-4990-858b-d191a18e0ecf admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:39.182509 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb44b4a-1824-4c99-b695-f9f3b56ffa27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:39.183114 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb44b4a-1824-4c99-b695-f9f3b56ffa27 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:39.183395 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb44b4a-1824-4c99-b695-f9f3b56ffa27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:39.183669 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb44b4a-1824-4c99-b695-f9f3b56ffa27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:39.198679 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 815/1624] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:22:39 2022] POST /identity/v3/users => generated 291 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:22:39.198679 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fae8b6-5e21-496d-bbbc-81337216c333 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:39.207841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fae8b6-5e21-496d-bbbc-81337216c333 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:39.233614 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:39.251553 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb44b4a-1824-4c99-b695-f9f3b56ffa27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:39.253157 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb44b4a-1824-4c99-b695-f9f3b56ffa27 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:39.265260 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 810/1625] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:22:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:22:39.265867 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb44b4a-1824-4c99-b695-f9f3b56ffa27 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:39.278102 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb44b4a-1824-4c99-b695-f9f3b56ffa27 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:39.299850 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40909863-e81d-404b-86a5-657f6eb54278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:39.301016 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40909863-e81d-404b-86a5-657f6eb54278 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:39.302243 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40909863-e81d-404b-86a5-657f6eb54278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:39.304376 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40909863-e81d-404b-86a5-657f6eb54278 admin admin] PATH_INFO: `/v3/projects/03dae27e2d824c5d907c6864cdeb938c/users/3ef9dfb7a2e145baaa62220ee15713d9/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:39.309439 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40909863-e81d-404b-86a5-657f6eb54278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03dae27e2d824c5d907c6864cdeb938c, user_id=3ef9dfb7a2e145baaa62220ee15713d9, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:39.313586 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40909863-e81d-404b-86a5-657f6eb54278 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:39.329922 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 811/1626] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:22:39 2022] PUT /identity/v3/projects/03dae27e2d824c5d907c6864cdeb938c/users/3ef9dfb7a2e145baaa62220ee15713d9/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:22:39.331356 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40909863-e81d-404b-86a5-657f6eb54278 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:39.339859 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92a9f8-a420-4df5-8294-b87c0fa69ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:39.340583 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92a9f8-a420-4df5-8294-b87c0fa69ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:39.341052 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92a9f8-a420-4df5-8294-b87c0fa69ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:39.341337 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92a9f8-a420-4df5-8294-b87c0fa69ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:39.341987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e92a9f8-a420-4df5-8294-b87c0fa69ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:39.344022 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e92a9f8-a420-4df5-8294-b87c0fa69ea8 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:39.365932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 816/1627] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:22:39.365932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92a9f8-a420-4df5-8294-b87c0fa69ea8 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:39.382169 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92a9f8-a420-4df5-8294-b87c0fa69ea8 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:39.461507 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b837fda-ea10-49b0-9cc4-302720db8234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:39.462315 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b837fda-ea10-49b0-9cc4-302720db8234 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:39.462637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b837fda-ea10-49b0-9cc4-302720db8234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:39.462877 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b837fda-ea10-49b0-9cc4-302720db8234 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:39.463594 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b837fda-ea10-49b0-9cc4-302720db8234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:39.465363 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b837fda-ea10-49b0-9cc4-302720db8234 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:39.473046 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:39.479454 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 817/1628] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:22:39.481809 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a093ed5-f12e-4476-b077-2745028884e8 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:39.481809 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a093ed5-f12e-4476-b077-2745028884e8 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:39.482987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a093ed5-f12e-4476-b077-2745028884e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:39.490853 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40909863-e81d-404b-86a5-657f6eb54278 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:39.498829 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0cad8-9b91-4cf4-a8a7-c5a4a85d7bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:39.499467 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0cad8-9b91-4cf4-a8a7-c5a4a85d7bda admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:39.499753 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0cad8-9b91-4cf4-a8a7-c5a4a85d7bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:39.500562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0cad8-9b91-4cf4-a8a7-c5a4a85d7bda admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:39.500704 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0cad8-9b91-4cf4-a8a7-c5a4a85d7bda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:39.503929 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0cad8-9b91-4cf4-a8a7-c5a4a85d7bda admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:39.518329 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-1a093ed5-f12e-4476-b077-2745028884e8 None None] MFA Rules not processed for user `3ef9dfb7a2e145baaa62220ee15713d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:39.519669 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1a093ed5-f12e-4476-b077-2745028884e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:39.604740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 818/1629] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:39 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:39.606310 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a093ed5-f12e-4476-b077-2745028884e8 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:39.629721 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 812/1630] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:22:39 2022] POST /identity/v3/users => generated 293 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:22:39.631289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0cad8-9b91-4cf4-a8a7-c5a4a85d7bda admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:39.631418 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a093ed5-f12e-4476-b077-2745028884e8 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:39.643449 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0cad8-9b91-4cf4-a8a7-c5a4a85d7bda admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:39.647821 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f50f6c-9d64-454f-99ea-2fc08242e8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:39.648945 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f50f6c-9d64-454f-99ea-2fc08242e8c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:39.649749 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f50f6c-9d64-454f-99ea-2fc08242e8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:39.650539 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f50f6c-9d64-454f-99ea-2fc08242e8c0 admin admin] PATH_INFO: `/v3/projects/95b73536d8864c19a6e96bf89d8b3778/users/5e81279deecc420fb922a72cdb78e38e/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:39.652070 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cca58e-6b9e-42f8-b9a3-776f74e252e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:39.652973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cca58e-6b9e-42f8-b9a3-776f74e252e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:39.653408 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cca58e-6b9e-42f8-b9a3-776f74e252e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:39.653910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cca58e-6b9e-42f8-b9a3-776f74e252e8 admin admin] PATH_INFO: `/v3/projects/e6c9e91a81a149e19bb2f5c5f970e882/users/883ced3cfba04ba7bbdf4c502027a938/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:39.675529 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f50f6c-9d64-454f-99ea-2fc08242e8c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95b73536d8864c19a6e96bf89d8b3778, user_id=5e81279deecc420fb922a72cdb78e38e, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:39.676984 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cca58e-6b9e-42f8-b9a3-776f74e252e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6c9e91a81a149e19bb2f5c5f970e882, user_id=883ced3cfba04ba7bbdf4c502027a938, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:39.679376 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f50f6c-9d64-454f-99ea-2fc08242e8c0 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:39.680566 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cca58e-6b9e-42f8-b9a3-776f74e252e8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:39.775073 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 819/1631] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:22:39 2022] PUT /identity/v3/projects/95b73536d8864c19a6e96bf89d8b3778/users/5e81279deecc420fb922a72cdb78e38e/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:22:39.775765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 813/1632] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:22:39 2022] PUT /identity/v3/projects/e6c9e91a81a149e19bb2f5c5f970e882/users/883ced3cfba04ba7bbdf4c502027a938/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:22:39.776619 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cca58e-6b9e-42f8-b9a3-776f74e252e8 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:39.777065 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f50f6c-9d64-454f-99ea-2fc08242e8c0 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:39.881364 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f50f6c-9d64-454f-99ea-2fc08242e8c0 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:39.937960 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cca58e-6b9e-42f8-b9a3-776f74e252e8 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:39.951734 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b7865-b672-4e82-b1c4-6e0807b4b512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:39.957727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b7865-b672-4e82-b1c4-6e0807b4b512 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:39.957727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b7865-b672-4e82-b1c4-6e0807b4b512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:39.957727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b7865-b672-4e82-b1c4-6e0807b4b512 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:39.957727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b7865-b672-4e82-b1c4-6e0807b4b512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:39.957727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b7865-b672-4e82-b1c4-6e0807b4b512 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:39.978014 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 814/1633] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:22:39.978014 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b7865-b672-4e82-b1c4-6e0807b4b512 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:39.978674 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c42634-9ff3-4c41-b4f1-3b8455eab171 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:39.979183 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c42634-9ff3-4c41-b4f1-3b8455eab171 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:39.979463 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c42634-9ff3-4c41-b4f1-3b8455eab171 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:39.979737 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c42634-9ff3-4c41-b4f1-3b8455eab171 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:39.999397 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b7865-b672-4e82-b1c4-6e0807b4b512 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:40.015387 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf1570-86a0-45b7-8c9f-1c1f51d691e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:40.015387 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf1570-86a0-45b7-8c9f-1c1f51d691e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:40.015387 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf1570-86a0-45b7-8c9f-1c1f51d691e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:40.015387 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf1570-86a0-45b7-8c9f-1c1f51d691e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:40.015792 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf1570-86a0-45b7-8c9f-1c1f51d691e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:40.016962 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcf1570-86a0-45b7-8c9f-1c1f51d691e5 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:40.290723 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 815/1634] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:22:39 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:22:40.290723 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf1570-86a0-45b7-8c9f-1c1f51d691e5 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:40.292169 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:40.294651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf1570-86a0-45b7-8c9f-1c1f51d691e5 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:40.294965 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c42634-9ff3-4c41-b4f1-3b8455eab171 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:40.295098 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64361260-17e6-4249-9bc9-a5ad78aafd09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:40.295257 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c42634-9ff3-4c41-b4f1-3b8455eab171 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:40.295391 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64361260-17e6-4249-9bc9-a5ad78aafd09 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:40.295391 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64361260-17e6-4249-9bc9-a5ad78aafd09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:40.295391 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64361260-17e6-4249-9bc9-a5ad78aafd09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:40.295391 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64361260-17e6-4249-9bc9-a5ad78aafd09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:40.295391 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64361260-17e6-4249-9bc9-a5ad78aafd09 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:40.295998 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 820/1635] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:22:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:22:40.296147 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 816/1636] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:22:40.296147 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64361260-17e6-4249-9bc9-a5ad78aafd09 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:40.296147 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64361260-17e6-4249-9bc9-a5ad78aafd09 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:40.296556 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c42634-9ff3-4c41-b4f1-3b8455eab171 service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:40.296821 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e62da-f693-4323-b57c-47e4fa234002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:40.296821 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e62da-f693-4323-b57c-47e4fa234002 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:40.296821 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e62da-f693-4323-b57c-47e4fa234002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:40.296821 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184e62da-f693-4323-b57c-47e4fa234002 admin admin] PATH_INFO: `/v3/projects/95b73536d8864c19a6e96bf89d8b3778/users/5e81279deecc420fb922a72cdb78e38e/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:40.297502 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184e62da-f693-4323-b57c-47e4fa234002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95b73536d8864c19a6e96bf89d8b3778, user_id=5e81279deecc420fb922a72cdb78e38e, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:40.297502 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184e62da-f693-4323-b57c-47e4fa234002 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:40.297502 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 817/1637] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:22:40 2022] PUT /identity/v3/projects/95b73536d8864c19a6e96bf89d8b3778/users/5e81279deecc420fb922a72cdb78e38e/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:22:40.297502 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:40.297502 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e62da-f693-4323-b57c-47e4fa234002 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:40.298105 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c42634-9ff3-4c41-b4f1-3b8455eab171 service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:40.298105 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe097a50-7c05-4fbe-82bd-074d29e1305b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:40.298105 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe097a50-7c05-4fbe-82bd-074d29e1305b admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:40.298105 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe097a50-7c05-4fbe-82bd-074d29e1305b admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:40.299179 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe097a50-7c05-4fbe-82bd-074d29e1305b admin admin] PATH_INFO: `/v3/projects/821a0e017541443787d89638b99da3a7/users/02ac1ac1698e453eafa11247bf0c35c3/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:40.299310 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184e62da-f693-4323-b57c-47e4fa234002 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:40.299310 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e6fb0-91f2-4d6b-b521-4f1e42fcb8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:40.299310 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e6fb0-91f2-4d6b-b521-4f1e42fcb8e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:40.299310 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e6fb0-91f2-4d6b-b521-4f1e42fcb8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:40.299822 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e6fb0-91f2-4d6b-b521-4f1e42fcb8e6 admin admin] PATH_INFO: `/v3/projects/e6c9e91a81a149e19bb2f5c5f970e882/users/883ced3cfba04ba7bbdf4c502027a938/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:40.299822 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e6fb0-91f2-4d6b-b521-4f1e42fcb8e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6c9e91a81a149e19bb2f5c5f970e882, user_id=883ced3cfba04ba7bbdf4c502027a938, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:40.300080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe097a50-7c05-4fbe-82bd-074d29e1305b admin admin] RBAC: Authorizing `identity:create_grant(project_id=821a0e017541443787d89638b99da3a7, user_id=02ac1ac1698e453eafa11247bf0c35c3, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:40.300862 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e6fb0-91f2-4d6b-b521-4f1e42fcb8e6 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:40.301020 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe097a50-7c05-4fbe-82bd-074d29e1305b admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:40.301182 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 818/1638] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:22:40 2022] PUT /identity/v3/projects/e6c9e91a81a149e19bb2f5c5f970e882/users/883ced3cfba04ba7bbdf4c502027a938/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:22:40.301182 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99e3f7-116f-497f-8aab-3d714f9491d6 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:40.301182 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99e3f7-116f-497f-8aab-3d714f9491d6 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:40.301182 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b99e3f7-116f-497f-8aab-3d714f9491d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:40.355201 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-6b99e3f7-116f-497f-8aab-3d714f9491d6 None None] MFA Rules not processed for user `5e81279deecc420fb922a72cdb78e38e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:40.355201 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6b99e3f7-116f-497f-8aab-3d714f9491d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:40.428066 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 821/1639] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:22:40 2022] PUT /identity/v3/projects/821a0e017541443787d89638b99da3a7/users/02ac1ac1698e453eafa11247bf0c35c3/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:22:40.429559 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e2709-7ed5-4f6a-9161-18c5f8f3c975 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:40.429851 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e2709-7ed5-4f6a-9161-18c5f8f3c975 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:40.430182 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4e2709-7ed5-4f6a-9161-18c5f8f3c975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:40.441753 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 819/1640] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:40 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:40.442927 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99e3f7-116f-497f-8aab-3d714f9491d6 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:40.471628 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-4e4e2709-7ed5-4f6a-9161-18c5f8f3c975 None None] MFA Rules not processed for user `883ced3cfba04ba7bbdf4c502027a938`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:40.472637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4e4e2709-7ed5-4f6a-9161-18c5f8f3c975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:40.554236 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b99e3f7-116f-497f-8aab-3d714f9491d6 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:40.624370 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8818e86-d69f-4698-8e9e-edce7bc614b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:40.625339 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8818e86-d69f-4698-8e9e-edce7bc614b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:40.625927 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8818e86-d69f-4698-8e9e-edce7bc614b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:40.626433 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8818e86-d69f-4698-8e9e-edce7bc614b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:40.628012 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 822/1641] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:40 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:40.628452 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8818e86-d69f-4698-8e9e-edce7bc614b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:40.630198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e2709-7ed5-4f6a-9161-18c5f8f3c975 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:40.630791 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8818e86-d69f-4698-8e9e-edce7bc614b6 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:40.647317 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 820/1642] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:22:40.648729 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8818e86-d69f-4698-8e9e-edce7bc614b6 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:40.724566 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4e2709-7ed5-4f6a-9161-18c5f8f3c975 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:40.727987 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8818e86-d69f-4698-8e9e-edce7bc614b6 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:40.729310 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c8ed9-b211-4ec8-9837-a51d4d1c0017 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:40.729980 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c8ed9-b211-4ec8-9837-a51d4d1c0017 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:40.730310 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c8ed9-b211-4ec8-9837-a51d4d1c0017 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:40.730589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c8ed9-b211-4ec8-9837-a51d4d1c0017 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:40.735982 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608734f-3fa0-4f8c-b24b-1bafd6b3b749 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:40.735982 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608734f-3fa0-4f8c-b24b-1bafd6b3b749 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:40.735982 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608734f-3fa0-4f8c-b24b-1bafd6b3b749 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:40.735982 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608734f-3fa0-4f8c-b24b-1bafd6b3b749 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:40.837673 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608734f-3fa0-4f8c-b24b-1bafd6b3b749 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:40.840498 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9608734f-3fa0-4f8c-b24b-1bafd6b3b749 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:40.856266 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 821/1643] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:22:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:22:40.858245 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c8ed9-b211-4ec8-9837-a51d4d1c0017 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:40.860221 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c8ed9-b211-4ec8-9837-a51d4d1c0017 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:40.882728 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608734f-3fa0-4f8c-b24b-1bafd6b3b749 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:40.908194 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 823/1644] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:22:40 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:22:40.926364 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:40.992837 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608734f-3fa0-4f8c-b24b-1bafd6b3b749 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:41.020138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e156d0-aae4-46f1-ba8d-c7f2598ab98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:41.020849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e156d0-aae4-46f1-ba8d-c7f2598ab98f admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:41.021928 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e156d0-aae4-46f1-ba8d-c7f2598ab98f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:41.022621 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e156d0-aae4-46f1-ba8d-c7f2598ab98f admin admin] PATH_INFO: `/v3/projects/821a0e017541443787d89638b99da3a7/users/02ac1ac1698e453eafa11247bf0c35c3/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:41.025261 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e156d0-aae4-46f1-ba8d-c7f2598ab98f admin admin] RBAC: Authorizing `identity:create_grant(project_id=821a0e017541443787d89638b99da3a7, user_id=02ac1ac1698e453eafa11247bf0c35c3, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:41.029145 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e156d0-aae4-46f1-ba8d-c7f2598ab98f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:41.050717 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 822/1645] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:22:40 2022] PUT /identity/v3/projects/821a0e017541443787d89638b99da3a7/users/02ac1ac1698e453eafa11247bf0c35c3/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:22:41.063512 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03adaf-86f9-4dc8-918d-8ed00acb638b None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:41.063512 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03adaf-86f9-4dc8-918d-8ed00acb638b None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:41.063512 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03adaf-86f9-4dc8-918d-8ed00acb638b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:41.073738 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e156d0-aae4-46f1-ba8d-c7f2598ab98f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:41.131085 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-8f03adaf-86f9-4dc8-918d-8ed00acb638b None None] MFA Rules not processed for user `02ac1ac1698e453eafa11247bf0c35c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:41.131262 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:41.132445 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8f03adaf-86f9-4dc8-918d-8ed00acb638b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:41.199310 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e156d0-aae4-46f1-ba8d-c7f2598ab98f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:41.206094 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d160e7e-a889-4b5a-9d8d-7c9684444a05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:41.206789 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d160e7e-a889-4b5a-9d8d-7c9684444a05 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:41.207079 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d160e7e-a889-4b5a-9d8d-7c9684444a05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:41.207359 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d160e7e-a889-4b5a-9d8d-7c9684444a05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:41.269139 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 824/1646] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:41.302358 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d160e7e-a889-4b5a-9d8d-7c9684444a05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:41.304621 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d160e7e-a889-4b5a-9d8d-7c9684444a05 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:41.331422 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 823/1647] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:22:41 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:22:41.535136 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03adaf-86f9-4dc8-918d-8ed00acb638b None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:41.544256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03adaf-86f9-4dc8-918d-8ed00acb638b None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:41.550335 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056d7fb-9db0-41d3-bd5d-5cd61016c4d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:41.551340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056d7fb-9db0-41d3-bd5d-5cd61016c4d2 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:41.551626 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056d7fb-9db0-41d3-bd5d-5cd61016c4d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:41.552998 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5056d7fb-9db0-41d3-bd5d-5cd61016c4d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:41.587868 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056d7fb-9db0-41d3-bd5d-5cd61016c4d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:41.591421 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5056d7fb-9db0-41d3-bd5d-5cd61016c4d2 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:41.592283 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d160e7e-a889-4b5a-9d8d-7c9684444a05 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:41.616543 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d160e7e-a889-4b5a-9d8d-7c9684444a05 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:41.622826 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc92b68-95b9-4290-9eb0-e8a7878ec800 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:41.623966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc92b68-95b9-4290-9eb0-e8a7878ec800 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:41.624433 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc92b68-95b9-4290-9eb0-e8a7878ec800 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:41.625345 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc92b68-95b9-4290-9eb0-e8a7878ec800 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:41.631643 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 825/1648] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:22:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:22:41.724486 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc92b68-95b9-4290-9eb0-e8a7878ec800 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:41.727261 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc92b68-95b9-4290-9eb0-e8a7878ec800 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:41.756020 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 824/1649] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:22:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:22:41.921152 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056d7fb-9db0-41d3-bd5d-5cd61016c4d2 service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:41.934069 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5056d7fb-9db0-41d3-bd5d-5cd61016c4d2 service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:41.948732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67e2001-84f2-488e-9dbc-9f28cc041f01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:41.949951 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e2001-84f2-488e-9dbc-9f28cc041f01 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:41.951381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e2001-84f2-488e-9dbc-9f28cc041f01 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:41.951663 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67e2001-84f2-488e-9dbc-9f28cc041f01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:42.068768 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:42.119086 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:42.129549 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e2001-84f2-488e-9dbc-9f28cc041f01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:42.134647 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67e2001-84f2-488e-9dbc-9f28cc041f01 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:42.156148 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 826/1650] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:22:41 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:22:43.496293 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc92b68-95b9-4290-9eb0-e8a7878ec800 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:43.506691 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc92b68-95b9-4290-9eb0-e8a7878ec800 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:43.512997 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1c32e-9172-4bc3-a85f-3b88ebb38019 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:43.513621 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1c32e-9172-4bc3-a85f-3b88ebb38019 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:43.513910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1c32e-9172-4bc3-a85f-3b88ebb38019 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:43.514931 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a1c32e-9172-4bc3-a85f-3b88ebb38019 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:43.641202 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1c32e-9172-4bc3-a85f-3b88ebb38019 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:43.642813 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a1c32e-9172-4bc3-a85f-3b88ebb38019 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:43.675562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 825/1651] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:22:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:22:50.175974 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340528bd-d5fe-409f-a207-2f8bf1565cc9 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:50.176585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340528bd-d5fe-409f-a207-2f8bf1565cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:50.178119 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340528bd-d5fe-409f-a207-2f8bf1565cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:50.280569 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1c32e-9172-4bc3-a85f-3b88ebb38019 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:50.292074 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-340528bd-d5fe-409f-a207-2f8bf1565cc9 None None] MFA Rules not processed for user `f3fabba09a4746328dcee545ff38cf78`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:50.294157 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-340528bd-d5fe-409f-a207-2f8bf1565cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:50.446793 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:50.462233 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 827/1652] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:50.466588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a1c32e-9172-4bc3-a85f-3b88ebb38019 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:50.471082 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34171c19-29ae-49b1-92f5-9aff66706ac1 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:50.471379 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34171c19-29ae-49b1-92f5-9aff66706ac1 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:50.471660 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34171c19-29ae-49b1-92f5-9aff66706ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:50.479534 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d5a4a-2ba3-4b3a-918d-0701ec97025e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:50.484612 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d5a4a-2ba3-4b3a-918d-0701ec97025e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:50.484612 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d5a4a-2ba3-4b3a-918d-0701ec97025e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:50.484612 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d5a4a-2ba3-4b3a-918d-0701ec97025e admin admin] PATH_INFO: `/v3/users/434a51ca0fb94799a493f436417016a5` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:50.485896 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d5a4a-2ba3-4b3a-918d-0701ec97025e admin admin] RBAC: Authorizing `identity:delete_user(user_id=434a51ca0fb94799a493f436417016a5)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:50.491685 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d5a4a-2ba3-4b3a-918d-0701ec97025e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:50.517715 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-34171c19-29ae-49b1-92f5-9aff66706ac1 None None] MFA Rules not processed for user `f3fabba09a4746328dcee545ff38cf78`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:50.521328 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-34171c19-29ae-49b1-92f5-9aff66706ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:50.550797 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 828/1653] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:50.617643 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38de5f-1dd9-40a7-b33d-49b305d92e24 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:50.617925 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38de5f-1dd9-40a7-b33d-49b305d92e24 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:50.618202 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38de5f-1dd9-40a7-b33d-49b305d92e24 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:50.620649 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 829/1654] 10.222.0.81 () {54 vars in 962 bytes} [Tue Sep 6 21:22:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:22:50.662018 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd7e27-5e7e-47d6-a80d-59f6ad84aad3 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:50.662344 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd7e27-5e7e-47d6-a80d-59f6ad84aad3 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:50.662580 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd7e27-5e7e-47d6-a80d-59f6ad84aad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:50.734165 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-317d5a4a-2ba3-4b3a-918d-0701ec97025e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '434a51ca0fb94799a493f436417016a5'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:50.784386 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-e1dd7e27-5e7e-47d6-a80d-59f6ad84aad3 None None] MFA Rules not processed for user `4441d8fea57f401a96fb8cbd2b501059`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:50.785606 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e1dd7e27-5e7e-47d6-a80d-59f6ad84aad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:50.846639 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-317d5a4a-2ba3-4b3a-918d-0701ec97025e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '434a51ca0fb94799a493f436417016a5'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:50.872870 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-317d5a4a-2ba3-4b3a-918d-0701ec97025e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '434a51ca0fb94799a493f436417016a5'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:50.873772 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-317d5a4a-2ba3-4b3a-918d-0701ec97025e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '434a51ca0fb94799a493f436417016a5'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:50.887627 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-317d5a4a-2ba3-4b3a-918d-0701ec97025e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '434a51ca0fb94799a493f436417016a5'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:50.898003 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 826/1655] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:22:50 2022] DELETE /identity/v3/users/434a51ca0fb94799a493f436417016a5 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:22:50.904382 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb9b4b-6905-411f-b21a-0daf811e1bd5 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:50.904682 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb9b4b-6905-411f-b21a-0daf811e1bd5 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:50.910373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb9b4b-6905-411f-b21a-0daf811e1bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:50.911966 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 830/1656] 10.222.0.81 () {58 vars in 1059 bytes} [Tue Sep 6 21:22:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:50.924358 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd7e27-5e7e-47d6-a80d-59f6ad84aad3 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:50.946809 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd7e27-5e7e-47d6-a80d-59f6ad84aad3 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:50.953829 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-26fb9b4b-6905-411f-b21a-0daf811e1bd5 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:50.954877 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-26fb9b4b-6905-411f-b21a-0daf811e1bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:51.079908 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 827/1657] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:51.089024 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:51.095361 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb9b4b-6905-411f-b21a-0daf811e1bd5 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:51.096945 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-26fb9b4b-6905-411f-b21a-0daf811e1bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:51.127093 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07509a-6866-4b49-b03a-0ea1327415e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:51.130905 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07509a-6866-4b49-b03a-0ea1327415e4 service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:51.130905 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07509a-6866-4b49-b03a-0ea1327415e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:51.130905 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07509a-6866-4b49-b03a-0ea1327415e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:51.136616 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-9a07509a-6866-4b49-b03a-0ea1327415e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:51.222904 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a07509a-6866-4b49-b03a-0ea1327415e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:51.224807 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a07509a-6866-4b49-b03a-0ea1327415e4 service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:51.239153 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 831/1658] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:22:50 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:22:51.252886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb9b4b-6905-411f-b21a-0daf811e1bd5 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:51.257981 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd975c-fe8d-4704-b7fb-4f2d6f96fa38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:51.258793 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd975c-fe8d-4704-b7fb-4f2d6f96fa38 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:51.259074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd975c-fe8d-4704-b7fb-4f2d6f96fa38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:51.259358 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd975c-fe8d-4704-b7fb-4f2d6f96fa38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:51.279892 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd975c-fe8d-4704-b7fb-4f2d6f96fa38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:51.281567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd975c-fe8d-4704-b7fb-4f2d6f96fa38 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:51.330886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 828/1659] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:22:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:22:51.983859 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec838078-9cc5-40e2-b558-11085796414c None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:51.984364 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec838078-9cc5-40e2-b558-11085796414c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:51.992733 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec838078-9cc5-40e2-b558-11085796414c None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:51.992733 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 832/1660] 10.222.0.81 () {54 vars in 912 bytes} [Tue Sep 6 21:22:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:22:52.004831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a5838-5d44-4aa9-a6da-89b5e2793523 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:52.005570 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a5838-5d44-4aa9-a6da-89b5e2793523 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:52.005990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a5838-5d44-4aa9-a6da-89b5e2793523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:52.089342 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-486a5838-5d44-4aa9-a6da-89b5e2793523 None None] MFA Rules not processed for user `4441d8fea57f401a96fb8cbd2b501059`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:52.097307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-486a5838-5d44-4aa9-a6da-89b5e2793523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:52.133735 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 829/1661] 10.222.0.81 () {58 vars in 1009 bytes} [Tue Sep 6 21:22:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:22:52.142876 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec838078-9cc5-40e2-b558-11085796414c None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:52.146056 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ec838078-9cc5-40e2-b558-11085796414c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:52.257256 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a5838-5d44-4aa9-a6da-89b5e2793523 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:52.258683 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-486a5838-5d44-4aa9-a6da-89b5e2793523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:52.275765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:52.291479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a5838-5d44-4aa9-a6da-89b5e2793523 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:52.309887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a42bf0-863d-4013-b49f-af2af79a6cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:52.310563 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a42bf0-863d-4013-b49f-af2af79a6cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:52.310844 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a42bf0-863d-4013-b49f-af2af79a6cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:52.311120 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a42bf0-863d-4013-b49f-af2af79a6cd7 admin admin] PATH_INFO: `/v3/users/87ba1c59bb534a1f904b1ced61a078f2` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:52.325110 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a42bf0-863d-4013-b49f-af2af79a6cd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87ba1c59bb534a1f904b1ced61a078f2)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:52.330742 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a42bf0-863d-4013-b49f-af2af79a6cd7 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:52.384053 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec838078-9cc5-40e2-b558-11085796414c None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:52.397727 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a72be1-4b6d-4b65-b56c-1315574681c0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ba30d9c40641bf8abb580a219b5352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:52.399554 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a72be1-4b6d-4b65-b56c-1315574681c0 service glance] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:52.399845 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a72be1-4b6d-4b65-b56c-1315574681c0 service glance] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:52.401332 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a72be1-4b6d-4b65-b56c-1315574681c0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:52.440932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a72be1-4b6d-4b65-b56c-1315574681c0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:52.448643 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a72be1-4b6d-4b65-b56c-1315574681c0 service glance] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:52.490113 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 833/1662] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:22:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:22:52.491104 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a72be1-4b6d-4b65-b56c-1315574681c0 service glance] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:52.496705 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e5a72be1-4b6d-4b65-b56c-1315574681c0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:52.528714 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a72be1-4b6d-4b65-b56c-1315574681c0 service glance] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:52.560110 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23da4f-a5f5-43fe-b338-d37b0e1106da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:52.567218 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23da4f-a5f5-43fe-b338-d37b0e1106da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:52.567626 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23da4f-a5f5-43fe-b338-d37b0e1106da admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:52.567891 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f23da4f-a5f5-43fe-b338-d37b0e1106da admin admin] PATH_INFO: `/v3/projects/d868149af06f40cbabe8bbfb63e3d878` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:52.570596 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f23da4f-a5f5-43fe-b338-d37b0e1106da admin admin] RBAC: Authorizing `identity:delete_project(project_id=d868149af06f40cbabe8bbfb63e3d878)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:52.579259 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f23da4f-a5f5-43fe-b338-d37b0e1106da admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:52.604004 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-28a42bf0-863d-4013-b49f-af2af79a6cd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87ba1c59bb534a1f904b1ced61a078f2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:52.697220 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-28a42bf0-863d-4013-b49f-af2af79a6cd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87ba1c59bb534a1f904b1ced61a078f2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:52.725090 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-28a42bf0-863d-4013-b49f-af2af79a6cd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87ba1c59bb534a1f904b1ced61a078f2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:52.729635 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-28a42bf0-863d-4013-b49f-af2af79a6cd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87ba1c59bb534a1f904b1ced61a078f2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:52.756203 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-28a42bf0-863d-4013-b49f-af2af79a6cd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87ba1c59bb534a1f904b1ced61a078f2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:52.791136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 830/1663] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:22:52 2022] DELETE /identity/v3/users/87ba1c59bb534a1f904b1ced61a078f2 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:22:52.797116 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1cc5f-941e-4ce7-adc0-38b7f7fa09e9 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:52.797755 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1cc5f-941e-4ce7-adc0-38b7f7fa09e9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:52.798728 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1cc5f-941e-4ce7-adc0-38b7f7fa09e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:52.834275 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1f23da4f-a5f5-43fe-b338-d37b0e1106da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd868149af06f40cbabe8bbfb63e3d878', 'request_id': 'req-1f23da4f-a5f5-43fe-b338-d37b0e1106da'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:52.858941 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-feb1cc5f-941e-4ce7-adc0-38b7f7fa09e9 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:52.860247 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-feb1cc5f-941e-4ce7-adc0-38b7f7fa09e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:52.906430 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1f23da4f-a5f5-43fe-b338-d37b0e1106da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd868149af06f40cbabe8bbfb63e3d878', 'request_id': 'req-1f23da4f-a5f5-43fe-b338-d37b0e1106da'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:52.927089 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1f23da4f-a5f5-43fe-b338-d37b0e1106da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd868149af06f40cbabe8bbfb63e3d878', 'request_id': 'req-1f23da4f-a5f5-43fe-b338-d37b0e1106da'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:52.952257 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:52.962058 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1f23da4f-a5f5-43fe-b338-d37b0e1106da admin admin] The token cache is being invalidate because project d868149af06f40cbabe8bbfb63e3d878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:22:52.962363 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1f23da4f-a5f5-43fe-b338-d37b0e1106da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:52.964631 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1f23da4f-a5f5-43fe-b338-d37b0e1106da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:52.971311 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 834/1664] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:22:52 2022] DELETE /identity/v3/projects/d868149af06f40cbabe8bbfb63e3d878 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:22:52.979021 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23da4f-a5f5-43fe-b338-d37b0e1106da admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:52.980972 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1f23da4f-a5f5-43fe-b338-d37b0e1106da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:53.020990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 831/1665] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:53.066942 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1cc5f-941e-4ce7-adc0-38b7f7fa09e9 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:53.068875 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-feb1cc5f-941e-4ce7-adc0-38b7f7fa09e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:53.198707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f23da4f-a5f5-43fe-b338-d37b0e1106da admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:53.212302 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b3f00-b937-43be-8338-10eb9d162586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:53.213336 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b3f00-b937-43be-8338-10eb9d162586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:53.214247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b3f00-b937-43be-8338-10eb9d162586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:53.214607 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3b3f00-b937-43be-8338-10eb9d162586 admin admin] PATH_INFO: `/v3/users/883ced3cfba04ba7bbdf4c502027a938` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:53.217833 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b3f00-b937-43be-8338-10eb9d162586 admin admin] RBAC: Authorizing `identity:delete_user(user_id=883ced3cfba04ba7bbdf4c502027a938)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:53.222204 dv-cinder-749155-11-smb devstack@keystone.service[81777]: WARNING py.warnings [None req-dd3b3f00-b937-43be-8338-10eb9d162586 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 21:22:53.222204 dv-cinder-749155-11-smb devstack@keystone.service[81777]: warnings.warn(msg) Sep 06 21:22:53.222204 dv-cinder-749155-11-smb devstack@keystone.service[81777]: Sep 06 21:22:53.229892 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3b3f00-b937-43be-8338-10eb9d162586 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:53.249878 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1cc5f-941e-4ce7-adc0-38b7f7fa09e9 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:53.267840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c6523-86fa-4c66-a2c6-2182fcc44b23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:53.269406 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c6523-86fa-4c66-a2c6-2182fcc44b23 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:53.269698 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c6523-86fa-4c66-a2c6-2182fcc44b23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:53.270338 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c6523-86fa-4c66-a2c6-2182fcc44b23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:53.296075 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c6523-86fa-4c66-a2c6-2182fcc44b23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:53.301131 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c6523-86fa-4c66-a2c6-2182fcc44b23 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:53.335069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 832/1666] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:22:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:22:53.614588 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-dd3b3f00-b937-43be-8338-10eb9d162586 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '883ced3cfba04ba7bbdf4c502027a938'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:53.713996 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-dd3b3f00-b937-43be-8338-10eb9d162586 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '883ced3cfba04ba7bbdf4c502027a938'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:53.750354 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed935e-55f5-4cf9-b593-1736bf2a8fa2 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:53.750655 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed935e-55f5-4cf9-b593-1736bf2a8fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:53.751059 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed935e-55f5-4cf9-b593-1736bf2a8fa2 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:53.754375 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 833/1667] 10.222.0.81 () {54 vars in 912 bytes} [Tue Sep 6 21:22:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:22:53.756508 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-dd3b3f00-b937-43be-8338-10eb9d162586 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '883ced3cfba04ba7bbdf4c502027a938'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:53.758346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-dd3b3f00-b937-43be-8338-10eb9d162586 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '883ced3cfba04ba7bbdf4c502027a938'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:53.761357 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dff11-b3e7-4ad4-a9ef-964f6bf798b0 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:53.764335 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dff11-b3e7-4ad4-a9ef-964f6bf798b0 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:53.764335 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1dff11-b3e7-4ad4-a9ef-964f6bf798b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:53.810213 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-dd3b3f00-b937-43be-8338-10eb9d162586 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '883ced3cfba04ba7bbdf4c502027a938'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:53.841487 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 835/1668] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:22:52 2022] DELETE /identity/v3/users/883ced3cfba04ba7bbdf4c502027a938 => generated 0 bytes in 863 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:22:53.985687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:54.009514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-2d1dff11-b3e7-4ad4-a9ef-964f6bf798b0 None None] MFA Rules not processed for user `c9aebd6c7ef24f42949918c99a72722d`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:54.019133 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2d1dff11-b3e7-4ad4-a9ef-964f6bf798b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:54.130460 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 834/1669] 10.222.0.81 () {58 vars in 1009 bytes} [Tue Sep 6 21:22:53 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:54.145180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b3f00-b937-43be-8338-10eb9d162586 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:54.146999 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-dd3b3f00-b937-43be-8338-10eb9d162586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:54.175588 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3b3f00-b937-43be-8338-10eb9d162586 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:54.192648 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3468e-14de-4f7d-8268-ebeb242a130f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:54.196648 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3468e-14de-4f7d-8268-ebeb242a130f service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:54.200080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3468e-14de-4f7d-8268-ebeb242a130f service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:54.200799 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc3468e-14de-4f7d-8268-ebeb242a130f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:54.222388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3468e-14de-4f7d-8268-ebeb242a130f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:54.224265 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc3468e-14de-4f7d-8268-ebeb242a130f service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:54.253484 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 836/1670] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:22:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:22:54.388123 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1dff11-b3e7-4ad4-a9ef-964f6bf798b0 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:54.392925 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2d1dff11-b3e7-4ad4-a9ef-964f6bf798b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:54.597327 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1dff11-b3e7-4ad4-a9ef-964f6bf798b0 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:54.611304 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e3b88e-4f72-4c6a-8b1d-d7b20507ea7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:54.612303 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3b88e-4f72-4c6a-8b1d-d7b20507ea7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:54.612726 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3b88e-4f72-4c6a-8b1d-d7b20507ea7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:54.613694 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e3b88e-4f72-4c6a-8b1d-d7b20507ea7d admin admin] PATH_INFO: `/v3/users/3163c51824b74260ab73e068b7a7fa58` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:54.615435 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3b88e-4f72-4c6a-8b1d-d7b20507ea7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3163c51824b74260ab73e068b7a7fa58)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:54.619213 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e3b88e-4f72-4c6a-8b1d-d7b20507ea7d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:54.910405 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c6e3b88e-4f72-4c6a-8b1d-d7b20507ea7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3163c51824b74260ab73e068b7a7fa58'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:54.984216 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3468e-14de-4f7d-8268-ebeb242a130f service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:54.984216 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6cc3468e-14de-4f7d-8268-ebeb242a130f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:54.999809 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c6e3b88e-4f72-4c6a-8b1d-d7b20507ea7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3163c51824b74260ab73e068b7a7fa58'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:55.031321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c6e3b88e-4f72-4c6a-8b1d-d7b20507ea7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3163c51824b74260ab73e068b7a7fa58'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:55.034859 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c6e3b88e-4f72-4c6a-8b1d-d7b20507ea7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3163c51824b74260ab73e068b7a7fa58'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:55.045994 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc3468e-14de-4f7d-8268-ebeb242a130f service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:55.059866 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b36518e-5bd1-431c-bef7-a2352fb6470a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:55.060721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36518e-5bd1-431c-bef7-a2352fb6470a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:55.061182 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36518e-5bd1-431c-bef7-a2352fb6470a admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:55.061587 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b36518e-5bd1-431c-bef7-a2352fb6470a admin admin] PATH_INFO: `/v3/projects/a55d9d6a71474f0fa5432ee50278abe1` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:55.062972 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36518e-5bd1-431c-bef7-a2352fb6470a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a55d9d6a71474f0fa5432ee50278abe1)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:55.071865 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c6e3b88e-4f72-4c6a-8b1d-d7b20507ea7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3163c51824b74260ab73e068b7a7fa58'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:55.085387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b36518e-5bd1-431c-bef7-a2352fb6470a admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:55.115289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 835/1671] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:22:54 2022] DELETE /identity/v3/users/3163c51824b74260ab73e068b7a7fa58 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:22:55.116765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302c816-1958-41d1-b15b-7f0f34f9d5ad None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:55.117057 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302c816-1958-41d1-b15b-7f0f34f9d5ad None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:55.117336 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302c816-1958-41d1-b15b-7f0f34f9d5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:55.218450 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-1302c816-1958-41d1-b15b-7f0f34f9d5ad None None] MFA Rules not processed for user `7f06e823c4ad4725896e7452eecfcc4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:55.220633 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1302c816-1958-41d1-b15b-7f0f34f9d5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:55.338471 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-2b36518e-5bd1-431c-bef7-a2352fb6470a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a55d9d6a71474f0fa5432ee50278abe1', 'request_id': 'req-2b36518e-5bd1-431c-bef7-a2352fb6470a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:55.382459 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 836/1672] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:55.382459 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaee627-b098-4dac-bef8-22741f4123c1 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:55.382459 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaee627-b098-4dac-bef8-22741f4123c1 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:55.382459 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaee627-b098-4dac-bef8-22741f4123c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:55.405817 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-3eaee627-b098-4dac-bef8-22741f4123c1 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:55.407199 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3eaee627-b098-4dac-bef8-22741f4123c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:55.463017 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-2b36518e-5bd1-431c-bef7-a2352fb6470a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a55d9d6a71474f0fa5432ee50278abe1', 'request_id': 'req-2b36518e-5bd1-431c-bef7-a2352fb6470a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:55.469529 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:55.476540 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-2b36518e-5bd1-431c-bef7-a2352fb6470a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a55d9d6a71474f0fa5432ee50278abe1', 'request_id': 'req-2b36518e-5bd1-431c-bef7-a2352fb6470a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:55.494985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-2b36518e-5bd1-431c-bef7-a2352fb6470a admin admin] The token cache is being invalidate because project a55d9d6a71474f0fa5432ee50278abe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:22:55.495405 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-2b36518e-5bd1-431c-bef7-a2352fb6470a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:55.496159 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-2b36518e-5bd1-431c-bef7-a2352fb6470a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:55.498369 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 837/1673] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:22:54 2022] DELETE /identity/v3/projects/a55d9d6a71474f0fa5432ee50278abe1 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:22:55.499843 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00f44d-17fc-47eb-97df-4346b6654b6a None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:55.500277 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00f44d-17fc-47eb-97df-4346b6654b6a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:55.501778 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00f44d-17fc-47eb-97df-4346b6654b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:55.554897 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:55.571211 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-4f00f44d-17fc-47eb-97df-4346b6654b6a None None] MFA Rules not processed for user `c225198d426c46fd8f30afb37d753a3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:55.586711 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4f00f44d-17fc-47eb-97df-4346b6654b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:55.590099 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 837/1674] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:55.595375 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b1a00-aaa4-44ae-b24c-338c5e54ac3f None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:55.595748 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b1a00-aaa4-44ae-b24c-338c5e54ac3f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:55.596026 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b1a00-aaa4-44ae-b24c-338c5e54ac3f None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:55.597491 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 838/1675] 10.222.0.81 () {54 vars in 962 bytes} [Tue Sep 6 21:22:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:22:55.602749 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b1a00-aaa4-44ae-b24c-338c5e54ac3f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:55.621215 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c90b1a00-aaa4-44ae-b24c-338c5e54ac3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:55.655813 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b1a00-aaa4-44ae-b24c-338c5e54ac3f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:55.668863 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee8b34-ae6c-484f-b7be-95dc00c15b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:55.674996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee8b34-ae6c-484f-b7be-95dc00c15b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:55.674996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee8b34-ae6c-484f-b7be-95dc00c15b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:55.674996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee8b34-ae6c-484f-b7be-95dc00c15b32 admin admin] PATH_INFO: `/v3/users/5e81279deecc420fb922a72cdb78e38e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:55.674996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee8b34-ae6c-484f-b7be-95dc00c15b32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e81279deecc420fb922a72cdb78e38e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:55.676483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee8b34-ae6c-484f-b7be-95dc00c15b32 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:55.832522 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 838/1676] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:55.834271 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29db308-c355-451d-831f-adab5fd735a7 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:55.835053 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29db308-c355-451d-831f-adab5fd735a7 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:55.835397 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29db308-c355-451d-831f-adab5fd735a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:55.901052 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f29db308-c355-451d-831f-adab5fd735a7 None None] MFA Rules not processed for user `4441d8fea57f401a96fb8cbd2b501059`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:55.902829 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f29db308-c355-451d-831f-adab5fd735a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:55.946604 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-baee8b34-ae6c-484f-b7be-95dc00c15b32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e81279deecc420fb922a72cdb78e38e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:56.028281 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-baee8b34-ae6c-484f-b7be-95dc00c15b32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e81279deecc420fb922a72cdb78e38e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:56.048333 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-baee8b34-ae6c-484f-b7be-95dc00c15b32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e81279deecc420fb922a72cdb78e38e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:56.058117 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-baee8b34-ae6c-484f-b7be-95dc00c15b32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e81279deecc420fb922a72cdb78e38e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:56.075543 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-baee8b34-ae6c-484f-b7be-95dc00c15b32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e81279deecc420fb922a72cdb78e38e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:56.080857 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 839/1677] 10.222.0.81 () {58 vars in 1059 bytes} [Tue Sep 6 21:22:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:56.082234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29db308-c355-451d-831f-adab5fd735a7 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:56.084077 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f29db308-c355-451d-831f-adab5fd735a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:56.093882 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 839/1678] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:22:55 2022] DELETE /identity/v3/users/5e81279deecc420fb922a72cdb78e38e => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:22:56.095678 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee8b34-ae6c-484f-b7be-95dc00c15b32 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:56.099456 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-baee8b34-ae6c-484f-b7be-95dc00c15b32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:56.250394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29db308-c355-451d-831f-adab5fd735a7 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:56.304203 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee8b34-ae6c-484f-b7be-95dc00c15b32 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:56.319424 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc7fd2-3626-46bf-98af-54eef78de163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:56.320074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc7fd2-3626-46bf-98af-54eef78de163 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:56.320397 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc7fd2-3626-46bf-98af-54eef78de163 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:56.320764 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc7fd2-3626-46bf-98af-54eef78de163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:56.327352 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8cdc7fd2-3626-46bf-98af-54eef78de163 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:56.396818 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da86f55-38e3-4dac-a566-a36ce54550cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3295306746f4552837f1bb12b2c500f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:56.397464 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da86f55-38e3-4dac-a566-a36ce54550cf service placement] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:56.397757 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da86f55-38e3-4dac-a566-a36ce54550cf service placement] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:56.398066 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da86f55-38e3-4dac-a566-a36ce54550cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:56.400441 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1da86f55-38e3-4dac-a566-a36ce54550cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:56.413999 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da86f55-38e3-4dac-a566-a36ce54550cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:56.415689 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da86f55-38e3-4dac-a566-a36ce54550cf service placement] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:56.444147 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 840/1679] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:22:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:22:56.445037 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da86f55-38e3-4dac-a566-a36ce54550cf service placement] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:56.449394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1da86f55-38e3-4dac-a566-a36ce54550cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:56.573923 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc7fd2-3626-46bf-98af-54eef78de163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:56.576213 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc7fd2-3626-46bf-98af-54eef78de163 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:56.592773 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 840/1680] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:22:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:22:56.597284 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8dcd72-8f8f-4b17-8012-e68bd827995e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:56.598880 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8dcd72-8f8f-4b17-8012-e68bd827995e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:56.599315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8dcd72-8f8f-4b17-8012-e68bd827995e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:56.648978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ca8dcd72-8f8f-4b17-8012-e68bd827995e None None] MFA Rules not processed for user `c225198d426c46fd8f30afb37d753a3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:56.650265 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ca8dcd72-8f8f-4b17-8012-e68bd827995e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:56.718173 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da86f55-38e3-4dac-a566-a36ce54550cf service placement] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:56.721514 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:56.743095 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cad3a9-8d46-469e-af9a-db5a75ebe40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:56.743757 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cad3a9-8d46-469e-af9a-db5a75ebe40c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:56.744042 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cad3a9-8d46-469e-af9a-db5a75ebe40c admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:56.745513 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cad3a9-8d46-469e-af9a-db5a75ebe40c admin admin] PATH_INFO: `/v3/projects/e6c9e91a81a149e19bb2f5c5f970e882` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:56.749636 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cad3a9-8d46-469e-af9a-db5a75ebe40c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6c9e91a81a149e19bb2f5c5f970e882)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:56.755725 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cad3a9-8d46-469e-af9a-db5a75ebe40c admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:56.797190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:56.809645 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 841/1681] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:56.811352 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd795f-c903-4f32-bdb1-90a798a18310 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:56.811794 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd795f-c903-4f32-bdb1-90a798a18310 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:56.812283 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd795f-c903-4f32-bdb1-90a798a18310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:56.858937 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d6bd795f-c903-4f32-bdb1-90a798a18310 None None] MFA Rules not processed for user `f3fabba09a4746328dcee545ff38cf78`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:56.860849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d6bd795f-c903-4f32-bdb1-90a798a18310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:56.950095 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 842/1682] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:56.950790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd795f-c903-4f32-bdb1-90a798a18310 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:57.024252 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-19cad3a9-8d46-469e-af9a-db5a75ebe40c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6c9e91a81a149e19bb2f5c5f970e882', 'request_id': 'req-19cad3a9-8d46-469e-af9a-db5a75ebe40c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:57.126642 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-19cad3a9-8d46-469e-af9a-db5a75ebe40c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6c9e91a81a149e19bb2f5c5f970e882', 'request_id': 'req-19cad3a9-8d46-469e-af9a-db5a75ebe40c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:57.136557 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-19cad3a9-8d46-469e-af9a-db5a75ebe40c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6c9e91a81a149e19bb2f5c5f970e882', 'request_id': 'req-19cad3a9-8d46-469e-af9a-db5a75ebe40c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:57.156522 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-19cad3a9-8d46-469e-af9a-db5a75ebe40c admin admin] The token cache is being invalidate because project e6c9e91a81a149e19bb2f5c5f970e882 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:22:57.156876 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-19cad3a9-8d46-469e-af9a-db5a75ebe40c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:57.157531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-19cad3a9-8d46-469e-af9a-db5a75ebe40c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:57.160442 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd795f-c903-4f32-bdb1-90a798a18310 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:57.175854 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 841/1683] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:22:56 2022] DELETE /identity/v3/projects/e6c9e91a81a149e19bb2f5c5f970e882 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:22:57.176817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cad3a9-8d46-469e-af9a-db5a75ebe40c admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:57.178238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-19cad3a9-8d46-469e-af9a-db5a75ebe40c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:57.277075 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:57.291697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8a5cd-0313-444a-9615-eea3da3a9a1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:57.292869 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8a5cd-0313-444a-9615-eea3da3a9a1b service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:57.295291 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8a5cd-0313-444a-9615-eea3da3a9a1b service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:57.295934 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8a5cd-0313-444a-9615-eea3da3a9a1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:57.299556 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f0b8a5cd-0313-444a-9615-eea3da3a9a1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:57.355881 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cad3a9-8d46-469e-af9a-db5a75ebe40c admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:57.363206 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2fb4b-8442-4e3a-90cc-e25c65cc2119 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:57.363860 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2fb4b-8442-4e3a-90cc-e25c65cc2119 service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:57.364136 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2fb4b-8442-4e3a-90cc-e25c65cc2119 service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:57.364419 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2fb4b-8442-4e3a-90cc-e25c65cc2119 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:57.367596 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-faf2fb4b-8442-4e3a-90cc-e25c65cc2119 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:57.416386 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8a5cd-0313-444a-9615-eea3da3a9a1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:57.418018 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b8a5cd-0313-444a-9615-eea3da3a9a1b service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:57.434559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 843/1684] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:22:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:22:57.449147 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8a5cd-0313-444a-9615-eea3da3a9a1b service nova] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:57.455640 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f0b8a5cd-0313-444a-9615-eea3da3a9a1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:57.510377 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2fb4b-8442-4e3a-90cc-e25c65cc2119 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:57.511782 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2fb4b-8442-4e3a-90cc-e25c65cc2119 service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:57.531711 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 842/1685] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:22:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:22:57.533232 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c4581-26c2-4df6-8b2d-08f078f3ed0a None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:57.533591 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c4581-26c2-4df6-8b2d-08f078f3ed0a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:57.533930 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c4581-26c2-4df6-8b2d-08f078f3ed0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:57.573711 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b8a5cd-0313-444a-9615-eea3da3a9a1b service nova] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:57.582652 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de593ef1-9bb5-46b9-8c6f-05ed5f7ea0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:57.583873 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de593ef1-9bb5-46b9-8c6f-05ed5f7ea0e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:57.584356 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de593ef1-9bb5-46b9-8c6f-05ed5f7ea0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:57.584770 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de593ef1-9bb5-46b9-8c6f-05ed5f7ea0e8 admin admin] PATH_INFO: `/v3/projects/95b73536d8864c19a6e96bf89d8b3778` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:57.586568 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de593ef1-9bb5-46b9-8c6f-05ed5f7ea0e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95b73536d8864c19a6e96bf89d8b3778)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:57.588054 dv-cinder-749155-11-smb devstack@keystone.service[81778]: WARNING py.warnings [None req-de593ef1-9bb5-46b9-8c6f-05ed5f7ea0e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 06 21:22:57.588054 dv-cinder-749155-11-smb devstack@keystone.service[81778]: warnings.warn(msg) Sep 06 21:22:57.588054 dv-cinder-749155-11-smb devstack@keystone.service[81778]: Sep 06 21:22:57.589772 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de593ef1-9bb5-46b9-8c6f-05ed5f7ea0e8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:57.605631 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c68c4581-26c2-4df6-8b2d-08f078f3ed0a None None] MFA Rules not processed for user `7ad886fd7cd445a18918965391eade77`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:57.609917 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c68c4581-26c2-4df6-8b2d-08f078f3ed0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:57.758289 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 843/1686] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:57.758289 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996945c6-6ec7-477c-b335-8bace681fa2d None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:57.758289 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996945c6-6ec7-477c-b335-8bace681fa2d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:57.758289 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996945c6-6ec7-477c-b335-8bace681fa2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:57.788965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-de593ef1-9bb5-46b9-8c6f-05ed5f7ea0e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95b73536d8864c19a6e96bf89d8b3778', 'request_id': 'req-de593ef1-9bb5-46b9-8c6f-05ed5f7ea0e8'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:57.817135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:57.818654 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-de593ef1-9bb5-46b9-8c6f-05ed5f7ea0e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95b73536d8864c19a6e96bf89d8b3778', 'request_id': 'req-de593ef1-9bb5-46b9-8c6f-05ed5f7ea0e8'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:57.818831 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-996945c6-6ec7-477c-b335-8bace681fa2d None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:57.821284 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-996945c6-6ec7-477c-b335-8bace681fa2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:57.837900 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-de593ef1-9bb5-46b9-8c6f-05ed5f7ea0e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95b73536d8864c19a6e96bf89d8b3778', 'request_id': 'req-de593ef1-9bb5-46b9-8c6f-05ed5f7ea0e8'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:57.949576 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-de593ef1-9bb5-46b9-8c6f-05ed5f7ea0e8 admin admin] The token cache is being invalidate because project 95b73536d8864c19a6e96bf89d8b3778 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:22:57.950264 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-de593ef1-9bb5-46b9-8c6f-05ed5f7ea0e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:57.951996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-de593ef1-9bb5-46b9-8c6f-05ed5f7ea0e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:57.962036 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 844/1687] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:22:57 2022] DELETE /identity/v3/projects/95b73536d8864c19a6e96bf89d8b3778 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:22:57.964087 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de593ef1-9bb5-46b9-8c6f-05ed5f7ea0e8 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:57.973235 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 844/1688] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:57.974511 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073624f7-0427-4712-96a1-f1c458486509 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:57.977976 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-de593ef1-9bb5-46b9-8c6f-05ed5f7ea0e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:57.982015 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073624f7-0427-4712-96a1-f1c458486509 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:57.982410 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073624f7-0427-4712-96a1-f1c458486509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:58.008150 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de593ef1-9bb5-46b9-8c6f-05ed5f7ea0e8 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:58.016203 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb73695-e25f-4f13-8f11-c49a943f9734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:58.017923 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb73695-e25f-4f13-8f11-c49a943f9734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:58.018370 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb73695-e25f-4f13-8f11-c49a943f9734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:58.018758 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb73695-e25f-4f13-8f11-c49a943f9734 admin admin] PATH_INFO: `/v3/projects/b0c73543f3f14dd7bd183255594ee8f4` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:58.020270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb73695-e25f-4f13-8f11-c49a943f9734 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0c73543f3f14dd7bd183255594ee8f4)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:58.022910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb73695-e25f-4f13-8f11-c49a943f9734 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:58.044416 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-073624f7-0427-4712-96a1-f1c458486509 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:58.045264 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-073624f7-0427-4712-96a1-f1c458486509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:58.062674 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 845/1689] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:58.064560 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd90e8-9232-4f2a-8172-b31f1f00cc08 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:58.065677 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd90e8-9232-4f2a-8172-b31f1f00cc08 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:58.065956 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd90e8-9232-4f2a-8172-b31f1f00cc08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:58.106052 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-1fcd90e8-9232-4f2a-8172-b31f1f00cc08 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:58.108301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1fcd90e8-9232-4f2a-8172-b31f1f00cc08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:58.132554 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 846/1690] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:58.133968 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d81b85-408d-4083-a094-6b4f5532a92d None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:58.134438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d81b85-408d-4083-a094-6b4f5532a92d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:58.134695 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d81b85-408d-4083-a094-6b4f5532a92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:58.190436 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-58d81b85-408d-4083-a094-6b4f5532a92d None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:58.191816 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-58d81b85-408d-4083-a094-6b4f5532a92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:58.215903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5fb73695-e25f-4f13-8f11-c49a943f9734 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0c73543f3f14dd7bd183255594ee8f4', 'request_id': 'req-5fb73695-e25f-4f13-8f11-c49a943f9734'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:58.229673 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5fb73695-e25f-4f13-8f11-c49a943f9734 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0c73543f3f14dd7bd183255594ee8f4', 'request_id': 'req-5fb73695-e25f-4f13-8f11-c49a943f9734'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:58.245307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5fb73695-e25f-4f13-8f11-c49a943f9734 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0c73543f3f14dd7bd183255594ee8f4', 'request_id': 'req-5fb73695-e25f-4f13-8f11-c49a943f9734'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:58.315055 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 847/1691] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:58.318341 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d81b85-408d-4083-a094-6b4f5532a92d None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:58.331900 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5fb73695-e25f-4f13-8f11-c49a943f9734 admin admin] The token cache is being invalidate because project b0c73543f3f14dd7bd183255594ee8f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:22:58.331900 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5fb73695-e25f-4f13-8f11-c49a943f9734 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:58.331900 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5fb73695-e25f-4f13-8f11-c49a943f9734 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:58.332254 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d81b85-408d-4083-a094-6b4f5532a92d None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:58.334307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 845/1692] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:22:57 2022] DELETE /identity/v3/projects/b0c73543f3f14dd7bd183255594ee8f4 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:22:58.335983 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd0f22-5993-465a-b90e-b6f73222a4ed None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:58.336932 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd0f22-5993-465a-b90e-b6f73222a4ed None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:58.337949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd0f22-5993-465a-b90e-b6f73222a4ed None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:58.340955 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 846/1693] 10.222.0.81 () {54 vars in 912 bytes} [Tue Sep 6 21:22:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:22:58.349312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd0f22-5993-465a-b90e-b6f73222a4ed None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:58.350637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbba03-a3e6-464b-a505-4e85bd9e69c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:58.351390 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbba03-a3e6-464b-a505-4e85bd9e69c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:58.351925 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbba03-a3e6-464b-a505-4e85bd9e69c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:58.352260 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:58.352522 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbba03-a3e6-464b-a505-4e85bd9e69c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:58.353284 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbba03-a3e6-464b-a505-4e85bd9e69c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:22:58.354252 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbba03-a3e6-464b-a505-4e85bd9e69c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:58.356656 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fadd0f22-5993-465a-b90e-b6f73222a4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:58.359978 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbba03-a3e6-464b-a505-4e85bd9e69c3 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:58.386689 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd0f22-5993-465a-b90e-b6f73222a4ed None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:58.396743 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 848/1694] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:22:58.401076 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbba03-a3e6-464b-a505-4e85bd9e69c3 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:58.403058 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054027d3-dd17-49fb-86f1-3414b44b38bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:58.405922 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-bcbbba03-a3e6-464b-a505-4e85bd9e69c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:58.406768 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054027d3-dd17-49fb-86f1-3414b44b38bf admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:58.407612 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054027d3-dd17-49fb-86f1-3414b44b38bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:58.407966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054027d3-dd17-49fb-86f1-3414b44b38bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:58.408783 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054027d3-dd17-49fb-86f1-3414b44b38bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:22:58.411168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054027d3-dd17-49fb-86f1-3414b44b38bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:58.413077 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054027d3-dd17-49fb-86f1-3414b44b38bf admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:58.424920 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbba03-a3e6-464b-a505-4e85bd9e69c3 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:58.431867 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 847/1695] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:22:58.431867 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e100b-90ef-4048-8eb1-d3ac40a4e5a7 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:58.431867 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e100b-90ef-4048-8eb1-d3ac40a4e5a7 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:58.431867 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e100b-90ef-4048-8eb1-d3ac40a4e5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:58.432963 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107037e4-0458-4e0a-b531-30442c356a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:58.433789 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107037e4-0458-4e0a-b531-30442c356a58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:58.434293 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107037e4-0458-4e0a-b531-30442c356a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:58.434572 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107037e4-0458-4e0a-b531-30442c356a58 admin admin] PATH_INFO: `/v3/users/3ef9dfb7a2e145baaa62220ee15713d9` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:58.436574 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107037e4-0458-4e0a-b531-30442c356a58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ef9dfb7a2e145baaa62220ee15713d9)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:58.439671 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107037e4-0458-4e0a-b531-30442c356a58 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:58.460915 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-2a2e100b-90ef-4048-8eb1-d3ac40a4e5a7 None None] MFA Rules not processed for user `4441d8fea57f401a96fb8cbd2b501059`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:22:58.462624 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2a2e100b-90ef-4048-8eb1-d3ac40a4e5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:58.567535 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:58.634088 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 848/1696] 10.222.0.81 () {58 vars in 1009 bytes} [Tue Sep 6 21:22:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:22:58.634088 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e100b-90ef-4048-8eb1-d3ac40a4e5a7 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:58.639772 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2a2e100b-90ef-4048-8eb1-d3ac40a4e5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:58.679771 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-107037e4-0458-4e0a-b531-30442c356a58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ef9dfb7a2e145baaa62220ee15713d9'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:58.692303 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e100b-90ef-4048-8eb1-d3ac40a4e5a7 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:58.707064 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24148feb-7447-4fd0-bc52-aa4975769f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:58.708435 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24148feb-7447-4fd0-bc52-aa4975769f70 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:58.708855 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24148feb-7447-4fd0-bc52-aa4975769f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:58.714693 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24148feb-7447-4fd0-bc52-aa4975769f70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:58.714693 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24148feb-7447-4fd0-bc52-aa4975769f70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:58.714693 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24148feb-7447-4fd0-bc52-aa4975769f70 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:58.747228 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:58.798005 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-107037e4-0458-4e0a-b531-30442c356a58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ef9dfb7a2e145baaa62220ee15713d9'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:58.844272 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 849/1697] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:22:58 2022] POST /identity/v3/projects => generated 379 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:22:58.844272 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24148feb-7447-4fd0-bc52-aa4975769f70 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:58.847736 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-107037e4-0458-4e0a-b531-30442c356a58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ef9dfb7a2e145baaa62220ee15713d9'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:58.849543 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-107037e4-0458-4e0a-b531-30442c356a58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ef9dfb7a2e145baaa62220ee15713d9'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:58.864603 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-107037e4-0458-4e0a-b531-30442c356a58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ef9dfb7a2e145baaa62220ee15713d9'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:22:58.897687 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 849/1698] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:22:58 2022] DELETE /identity/v3/users/3ef9dfb7a2e145baaa62220ee15713d9 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:22:58.897687 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107037e4-0458-4e0a-b531-30442c356a58 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:58.901451 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-107037e4-0458-4e0a-b531-30442c356a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:59.011344 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24148feb-7447-4fd0-bc52-aa4975769f70 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:59.105451 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:22:59.120008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107037e4-0458-4e0a-b531-30442c356a58 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:59.153191 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d5d66-6da8-40dd-847f-589c9495d160 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ba30d9c40641bf8abb580a219b5352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:59.153864 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d5d66-6da8-40dd-847f-589c9495d160 service glance] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:59.154106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d5d66-6da8-40dd-847f-589c9495d160 service glance] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:59.154381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d5d66-6da8-40dd-847f-589c9495d160 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:59.158119 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b236b-4a38-454b-94d2-418a749da2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:59.158557 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b236b-4a38-454b-94d2-418a749da2f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:59.158838 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b236b-4a38-454b-94d2-418a749da2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:59.159109 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75b236b-4a38-454b-94d2-418a749da2f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:59.159751 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b236b-4a38-454b-94d2-418a749da2f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:59.163907 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b43d5d66-6da8-40dd-847f-589c9495d160 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:59.164992 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75b236b-4a38-454b-94d2-418a749da2f4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:59.308485 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d5d66-6da8-40dd-847f-589c9495d160 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:59.309962 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d5d66-6da8-40dd-847f-589c9495d160 service glance] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:59.327997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 850/1699] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:22:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:22:59.336144 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 850/1700] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:22:58 2022] POST /identity/v3/projects => generated 371 bytes in 494 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:22:59.337138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b236b-4a38-454b-94d2-418a749da2f4 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:59.337550 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d5d66-6da8-40dd-847f-589c9495d160 service glance] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:59.339298 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b75b236b-4a38-454b-94d2-418a749da2f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:59.341169 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b43d5d66-6da8-40dd-847f-589c9495d160 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:59.374606 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d5d66-6da8-40dd-847f-589c9495d160 service glance] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:59.569293 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75b236b-4a38-454b-94d2-418a749da2f4 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:59.588764 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930dc3a4-4264-45da-8690-2411d4f965ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:59.591356 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930dc3a4-4264-45da-8690-2411d4f965ee admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:59.595044 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930dc3a4-4264-45da-8690-2411d4f965ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:59.595362 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930dc3a4-4264-45da-8690-2411d4f965ee admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:59.596036 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930dc3a4-4264-45da-8690-2411d4f965ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:59.606321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930dc3a4-4264-45da-8690-2411d4f965ee admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:59.623853 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961afe69-9fa3-4f0f-919a-9d438f8a2e6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:59.624818 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961afe69-9fa3-4f0f-919a-9d438f8a2e6a service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:59.628889 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961afe69-9fa3-4f0f-919a-9d438f8a2e6a service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:59.629043 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961afe69-9fa3-4f0f-919a-9d438f8a2e6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:59.630923 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-961afe69-9fa3-4f0f-919a-9d438f8a2e6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:59.774010 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 851/1701] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:22:59 2022] POST /identity/v3/users => generated 290 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:22:59.775951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930dc3a4-4264-45da-8690-2411d4f965ee admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:59.777910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-930dc3a4-4264-45da-8690-2411d4f965ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:59.799468 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930dc3a4-4264-45da-8690-2411d4f965ee admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:59.807644 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f109d5-ded3-4b0b-8384-c7c59dd4390c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:59.808751 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f109d5-ded3-4b0b-8384-c7c59dd4390c admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:59.821228 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f109d5-ded3-4b0b-8384-c7c59dd4390c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:59.821737 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f109d5-ded3-4b0b-8384-c7c59dd4390c admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:59.824965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f109d5-ded3-4b0b-8384-c7c59dd4390c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:59.829506 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961afe69-9fa3-4f0f-919a-9d438f8a2e6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:59.831840 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961afe69-9fa3-4f0f-919a-9d438f8a2e6a service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:59.834870 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f109d5-ded3-4b0b-8384-c7c59dd4390c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:59.854960 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 851/1702] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:22:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:22:59.856389 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961afe69-9fa3-4f0f-919a-9d438f8a2e6a service nova] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:59.872718 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961afe69-9fa3-4f0f-919a-9d438f8a2e6a service nova] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:59.879257 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b005775-a234-478a-b592-2c4688368511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:59.880029 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b005775-a234-478a-b592-2c4688368511 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:59.881556 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b005775-a234-478a-b592-2c4688368511 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:59.881938 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b005775-a234-478a-b592-2c4688368511 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:59.882790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b005775-a234-478a-b592-2c4688368511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:59.885541 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b005775-a234-478a-b592-2c4688368511 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:22:59.902065 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 852/1703] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:22:59.926171 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b005775-a234-478a-b592-2c4688368511 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:59.931803 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4b005775-a234-478a-b592-2c4688368511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:22:59.939700 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 852/1704] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:22:59 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:22:59.941363 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f109d5-ded3-4b0b-8384-c7c59dd4390c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:22:59.965327 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f109d5-ded3-4b0b-8384-c7c59dd4390c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:59.971843 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b005775-a234-478a-b592-2c4688368511 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:22:59.985379 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816d15c-a277-4447-b0ff-c4dab3cafbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:59.994710 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816d15c-a277-4447-b0ff-c4dab3cafbf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:59.994710 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816d15c-a277-4447-b0ff-c4dab3cafbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:22:59.994710 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816d15c-a277-4447-b0ff-c4dab3cafbf0 admin admin] PATH_INFO: `/v3/projects/03dae27e2d824c5d907c6864cdeb938c` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:22:59.994710 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816d15c-a277-4447-b0ff-c4dab3cafbf0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03dae27e2d824c5d907c6864cdeb938c)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:22:59.995080 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1a286-7cfe-4ac1-915d-7ba7fb4fe0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:22:59.997785 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1a286-7cfe-4ac1-915d-7ba7fb4fe0be admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:22:59.999743 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816d15c-a277-4447-b0ff-c4dab3cafbf0 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:00.000412 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1a286-7cfe-4ac1-915d-7ba7fb4fe0be admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:00.000768 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1a286-7cfe-4ac1-915d-7ba7fb4fe0be admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:00.002897 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1a286-7cfe-4ac1-915d-7ba7fb4fe0be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:00.004983 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1a286-7cfe-4ac1-915d-7ba7fb4fe0be admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:00.026736 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 853/1705] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:00.029047 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd76c2-a417-4da7-b1c2-c4994fa71cff None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:00.029338 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd76c2-a417-4da7-b1c2-c4994fa71cff None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:00.029617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd76c2-a417-4da7-b1c2-c4994fa71cff None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:00.031502 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 854/1706] 10.222.0.81 () {54 vars in 912 bytes} [Tue Sep 6 21:23:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:23:00.046284 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd76c2-a417-4da7-b1c2-c4994fa71cff None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:00.085161 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd76c2-a417-4da7-b1c2-c4994fa71cff None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:00.092612 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47682fab-7732-42af-867a-8d36b3bf9892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:00.093437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47682fab-7732-42af-867a-8d36b3bf9892 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:00.093782 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47682fab-7732-42af-867a-8d36b3bf9892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:00.096218 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47682fab-7732-42af-867a-8d36b3bf9892 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:00.096218 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47682fab-7732-42af-867a-8d36b3bf9892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:00.098005 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47682fab-7732-42af-867a-8d36b3bf9892 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:00.135837 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 855/1707] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:00.135837 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47682fab-7732-42af-867a-8d36b3bf9892 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:00.152600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47682fab-7732-42af-867a-8d36b3bf9892 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:00.160187 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dc1ad7-a115-49d8-93b6-cef179c6a4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:00.164720 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc1ad7-a115-49d8-93b6-cef179c6a4fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:00.164720 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc1ad7-a115-49d8-93b6-cef179c6a4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:00.164720 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dc1ad7-a115-49d8-93b6-cef179c6a4fa admin admin] PATH_INFO: `/v3/projects/ce77b87859a2461689feb95f3b091a1d/users/c8ac70617454428bb8426aafd4ef92e4/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:00.180714 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc1ad7-a115-49d8-93b6-cef179c6a4fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce77b87859a2461689feb95f3b091a1d, user_id=c8ac70617454428bb8426aafd4ef92e4, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:00.183825 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dc1ad7-a115-49d8-93b6-cef179c6a4fa admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:00.258341 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-c816d15c-a277-4447-b0ff-c4dab3cafbf0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03dae27e2d824c5d907c6864cdeb938c', 'request_id': 'req-c816d15c-a277-4447-b0ff-c4dab3cafbf0'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:00.280573 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 856/1708] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:00 2022] PUT /identity/v3/projects/ce77b87859a2461689feb95f3b091a1d/users/c8ac70617454428bb8426aafd4ef92e4/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:00.284616 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042f73c-f154-49f1-abd5-a4de8b6cef38 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:00.284616 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042f73c-f154-49f1-abd5-a4de8b6cef38 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:00.284616 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c042f73c-f154-49f1-abd5-a4de8b6cef38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:00.303930 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:00.315036 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-c042f73c-f154-49f1-abd5-a4de8b6cef38 None None] MFA Rules not processed for user `c9aebd6c7ef24f42949918c99a72722d`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:00.320543 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c042f73c-f154-49f1-abd5-a4de8b6cef38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:00.433814 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-c816d15c-a277-4447-b0ff-c4dab3cafbf0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03dae27e2d824c5d907c6864cdeb938c', 'request_id': 'req-c816d15c-a277-4447-b0ff-c4dab3cafbf0'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:00.444791 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-c816d15c-a277-4447-b0ff-c4dab3cafbf0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03dae27e2d824c5d907c6864cdeb938c', 'request_id': 'req-c816d15c-a277-4447-b0ff-c4dab3cafbf0'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:00.467925 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 857/1709] 10.222.0.81 () {58 vars in 1009 bytes} [Tue Sep 6 21:23:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:00.468994 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042f73c-f154-49f1-abd5-a4de8b6cef38 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:00.517705 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-c816d15c-a277-4447-b0ff-c4dab3cafbf0 admin admin] The token cache is being invalidate because project 03dae27e2d824c5d907c6864cdeb938c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:23:00.518223 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-c816d15c-a277-4447-b0ff-c4dab3cafbf0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:00.519422 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-c816d15c-a277-4447-b0ff-c4dab3cafbf0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:00.525732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 853/1710] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:22:59 2022] DELETE /identity/v3/projects/03dae27e2d824c5d907c6864cdeb938c => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:00.536540 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953ef65-6b82-44b5-aa1c-e29c9f34fe97 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:00.536855 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953ef65-6b82-44b5-aa1c-e29c9f34fe97 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:00.537713 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953ef65-6b82-44b5-aa1c-e29c9f34fe97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:00.620852 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c042f73c-f154-49f1-abd5-a4de8b6cef38 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:00.634341 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c76c20-aaa8-4b13-904f-891c939ba9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:00.635317 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c76c20-aaa8-4b13-904f-891c939ba9a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:00.637283 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c76c20-aaa8-4b13-904f-891c939ba9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:00.643781 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c76c20-aaa8-4b13-904f-891c939ba9a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:00.643781 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c76c20-aaa8-4b13-904f-891c939ba9a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:00.644278 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-1953ef65-6b82-44b5-aa1c-e29c9f34fe97 None None] MFA Rules not processed for user `c8ac70617454428bb8426aafd4ef92e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:00.644278 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1953ef65-6b82-44b5-aa1c-e29c9f34fe97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:00.644438 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c76c20-aaa8-4b13-904f-891c939ba9a2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:00.672459 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 858/1711] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:00.674589 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6da20-6875-42dc-a71e-f9205b42c04b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:00.674876 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6da20-6875-42dc-a71e-f9205b42c04b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:00.677652 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6da20-6875-42dc-a71e-f9205b42c04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:00.721118 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-7be6da20-6875-42dc-a71e-f9205b42c04b None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:00.724040 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7be6da20-6875-42dc-a71e-f9205b42c04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:00.752990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 859/1712] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:00.756528 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6da20-6875-42dc-a71e-f9205b42c04b None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:00.760439 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7be6da20-6875-42dc-a71e-f9205b42c04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:00.797269 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6da20-6875-42dc-a71e-f9205b42c04b None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:00.815355 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9448ed94-ea2a-4ed7-8831-e1273b510b2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:00.818235 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448ed94-ea2a-4ed7-8831-e1273b510b2d service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:00.818571 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448ed94-ea2a-4ed7-8831-e1273b510b2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:00.820163 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9448ed94-ea2a-4ed7-8831-e1273b510b2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:00.828002 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9448ed94-ea2a-4ed7-8831-e1273b510b2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:00.836499 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 854/1713] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:00.836972 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953ef65-6b82-44b5-aa1c-e29c9f34fe97 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:00.840294 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1953ef65-6b82-44b5-aa1c-e29c9f34fe97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:00.853702 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448ed94-ea2a-4ed7-8831-e1273b510b2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:00.855303 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9448ed94-ea2a-4ed7-8831-e1273b510b2d service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:00.870160 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 860/1714] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:23:00.870731 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953ef65-6b82-44b5-aa1c-e29c9f34fe97 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:00.871405 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335ec07-94b6-480d-8eb2-d0a19fc9372d None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:00.871763 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335ec07-94b6-480d-8eb2-d0a19fc9372d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:00.872046 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b335ec07-94b6-480d-8eb2-d0a19fc9372d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:00.886101 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b96b2b-ca42-465f-9ef0-bfbb970c5acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:00.887108 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b96b2b-ca42-465f-9ef0-bfbb970c5acd admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:00.887391 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b96b2b-ca42-465f-9ef0-bfbb970c5acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:00.887670 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b96b2b-ca42-465f-9ef0-bfbb970c5acd admin admin] PATH_INFO: `/v3/projects/ed9089e888aa4598916d257986dc0b70/users/caa6c1fb5b354a409bc8f1a69dc2e718/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:00.916671 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b96b2b-ca42-465f-9ef0-bfbb970c5acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed9089e888aa4598916d257986dc0b70, user_id=caa6c1fb5b354a409bc8f1a69dc2e718, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:00.923836 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b96b2b-ca42-465f-9ef0-bfbb970c5acd admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:00.968151 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-b335ec07-94b6-480d-8eb2-d0a19fc9372d None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:00.984149 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b335ec07-94b6-480d-8eb2-d0a19fc9372d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:01.001819 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 855/1715] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:00 2022] PUT /identity/v3/projects/ed9089e888aa4598916d257986dc0b70/users/caa6c1fb5b354a409bc8f1a69dc2e718/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:01.002817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b96b2b-ca42-465f-9ef0-bfbb970c5acd admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:01.009684 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-63b96b2b-ca42-465f-9ef0-bfbb970c5acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:01.023333 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 861/1716] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:01.024230 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad3557-156c-48d9-a3cf-2cd39872aa52 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:01.024518 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad3557-156c-48d9-a3cf-2cd39872aa52 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:01.024937 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad3557-156c-48d9-a3cf-2cd39872aa52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:01.129118 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-c9ad3557-156c-48d9-a3cf-2cd39872aa52 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:01.135250 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c9ad3557-156c-48d9-a3cf-2cd39872aa52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:01.151471 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:01.156624 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b96b2b-ca42-465f-9ef0-bfbb970c5acd admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:01.162409 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74b58d-54e5-4296-94d4-cba75d54dc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:01.163295 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74b58d-54e5-4296-94d4-cba75d54dc9d admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:01.163688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74b58d-54e5-4296-94d4-cba75d54dc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:01.164028 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74b58d-54e5-4296-94d4-cba75d54dc9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:01.165072 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74b58d-54e5-4296-94d4-cba75d54dc9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:01.167445 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a74b58d-54e5-4296-94d4-cba75d54dc9d admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:01.173430 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 862/1717] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:01.174551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad3557-156c-48d9-a3cf-2cd39872aa52 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:01.198432 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad3557-156c-48d9-a3cf-2cd39872aa52 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:01.213450 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dacbea-7bda-4e78-b4f2-ccb91cf99d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:01.214695 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dacbea-7bda-4e78-b4f2-ccb91cf99d48 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:01.215098 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dacbea-7bda-4e78-b4f2-ccb91cf99d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:01.215375 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dacbea-7bda-4e78-b4f2-ccb91cf99d48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:01.216228 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dacbea-7bda-4e78-b4f2-ccb91cf99d48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:23:01.216542 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dacbea-7bda-4e78-b4f2-ccb91cf99d48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:01.218168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dacbea-7bda-4e78-b4f2-ccb91cf99d48 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:01.271440 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 863/1718] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:23:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:23:01.276514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dacbea-7bda-4e78-b4f2-ccb91cf99d48 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:01.304217 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dacbea-7bda-4e78-b4f2-ccb91cf99d48 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:01.320502 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9385c8-5d1a-4461-8807-374e58a027f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:01.320877 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9385c8-5d1a-4461-8807-374e58a027f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:01.321162 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9385c8-5d1a-4461-8807-374e58a027f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:01.321440 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9385c8-5d1a-4461-8807-374e58a027f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:01.322089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9385c8-5d1a-4461-8807-374e58a027f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:01.334112 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9385c8-5d1a-4461-8807-374e58a027f7 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:01.342875 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 856/1719] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:23:01 2022] POST /identity/v3/projects => generated 379 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:01.349193 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74b58d-54e5-4296-94d4-cba75d54dc9d admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:01.356889 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5a74b58d-54e5-4296-94d4-cba75d54dc9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:01.489424 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 864/1720] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:23:01 2022] POST /identity/v3/projects => generated 357 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:01.490567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9385c8-5d1a-4461-8807-374e58a027f7 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:01.495537 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74b58d-54e5-4296-94d4-cba75d54dc9d admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:01.698316 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750302f-3d55-4c4f-834b-43a87a795fda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:01.699320 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750302f-3d55-4c4f-834b-43a87a795fda service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:01.699827 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750302f-3d55-4c4f-834b-43a87a795fda service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:01.700438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7750302f-3d55-4c4f-834b-43a87a795fda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:01.704826 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9385c8-5d1a-4461-8807-374e58a027f7 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:01.722943 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7750302f-3d55-4c4f-834b-43a87a795fda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:01.726289 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7750302f-3d55-4c4f-834b-43a87a795fda service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:01.727643 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608cfcdd-7c66-4962-b5e6-29d806596717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:01.728316 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cfcdd-7c66-4962-b5e6-29d806596717 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:01.728600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cfcdd-7c66-4962-b5e6-29d806596717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:01.728872 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cfcdd-7c66-4962-b5e6-29d806596717 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:01.729514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608cfcdd-7c66-4962-b5e6-29d806596717 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:01.738867 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608cfcdd-7c66-4962-b5e6-29d806596717 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:01.772307 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 857/1721] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:23:01.773980 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750302f-3d55-4c4f-834b-43a87a795fda service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:01.786991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7750302f-3d55-4c4f-834b-43a87a795fda service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:01.795181 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aec772-3b8f-43c6-872f-4989da1e0809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:01.796304 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aec772-3b8f-43c6-872f-4989da1e0809 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:01.797061 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aec772-3b8f-43c6-872f-4989da1e0809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:01.798851 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aec772-3b8f-43c6-872f-4989da1e0809 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:01.800000 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aec772-3b8f-43c6-872f-4989da1e0809 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:01.802194 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aec772-3b8f-43c6-872f-4989da1e0809 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:01.853676 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:01.863018 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 865/1722] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:23:01 2022] POST /identity/v3/users => generated 296 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:01.864442 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fc4fc-fceb-4056-a4fb-da9f92024470 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:01.864731 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fc4fc-fceb-4056-a4fb-da9f92024470 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:01.865004 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294fc4fc-fceb-4056-a4fb-da9f92024470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:01.924406 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 858/1723] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:23:01 2022] POST /identity/v3/users => generated 279 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:01.924406 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aec772-3b8f-43c6-872f-4989da1e0809 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:01.951830 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aec772-3b8f-43c6-872f-4989da1e0809 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:01.961662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54918c1-701a-4132-b231-4b0c68bc6e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:01.962301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54918c1-701a-4132-b231-4b0c68bc6e0e admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:01.962918 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54918c1-701a-4132-b231-4b0c68bc6e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:01.962918 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54918c1-701a-4132-b231-4b0c68bc6e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:01.963482 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54918c1-701a-4132-b231-4b0c68bc6e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:01.965129 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54918c1-701a-4132-b231-4b0c68bc6e0e admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:01.973056 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:01.993348 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 859/1724] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:01 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:01.994313 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54918c1-701a-4132-b231-4b0c68bc6e0e admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:02.002325 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-294fc4fc-fceb-4056-a4fb-da9f92024470 None None] MFA Rules not processed for user `0ba7376671a24d35a920e0ec3290472b`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:02.015144 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-294fc4fc-fceb-4056-a4fb-da9f92024470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:02.018871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54918c1-701a-4132-b231-4b0c68bc6e0e admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:02.035884 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618a1f1-f381-4df6-81a1-b243ca6305b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:02.036603 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618a1f1-f381-4df6-81a1-b243ca6305b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:02.036866 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618a1f1-f381-4df6-81a1-b243ca6305b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:02.037145 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c618a1f1-f381-4df6-81a1-b243ca6305b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:02.037816 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618a1f1-f381-4df6-81a1-b243ca6305b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:02.039888 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c618a1f1-f381-4df6-81a1-b243ca6305b9 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:02.065249 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 860/1725] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:01 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:02.066282 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618a1f1-f381-4df6-81a1-b243ca6305b9 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:02.093479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c618a1f1-f381-4df6-81a1-b243ca6305b9 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:02.108329 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb739973-71fc-4f71-b138-60dfabca57bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:02.109026 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb739973-71fc-4f71-b138-60dfabca57bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:02.109312 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb739973-71fc-4f71-b138-60dfabca57bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:02.109590 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb739973-71fc-4f71-b138-60dfabca57bc admin admin] PATH_INFO: `/v3/projects/16591812380a4beeac1f2266b7d4450d/users/f7ea0033566a417f9d7c21843acc4ef5/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:02.143859 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb739973-71fc-4f71-b138-60dfabca57bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=16591812380a4beeac1f2266b7d4450d, user_id=f7ea0033566a417f9d7c21843acc4ef5, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:02.155173 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb739973-71fc-4f71-b138-60dfabca57bc admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:02.198837 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 866/1726] 10.222.0.81 () {58 vars in 1009 bytes} [Tue Sep 6 21:23:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:02.201805 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fc4fc-fceb-4056-a4fb-da9f92024470 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:02.239785 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294fc4fc-fceb-4056-a4fb-da9f92024470 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:02.255244 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedfed25-d088-4a1c-aeac-1be641b41978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:02.259659 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedfed25-d088-4a1c-aeac-1be641b41978 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:02.260449 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedfed25-d088-4a1c-aeac-1be641b41978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:02.261714 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedfed25-d088-4a1c-aeac-1be641b41978 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:02.262889 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedfed25-d088-4a1c-aeac-1be641b41978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:02.265932 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedfed25-d088-4a1c-aeac-1be641b41978 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:02.273732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 861/1727] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:02 2022] PUT /identity/v3/projects/16591812380a4beeac1f2266b7d4450d/users/f7ea0033566a417f9d7c21843acc4ef5/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:02.279286 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb739973-71fc-4f71-b138-60dfabca57bc admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:02.286411 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 867/1728] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:02.291222 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedfed25-d088-4a1c-aeac-1be641b41978 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:02.309615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedfed25-d088-4a1c-aeac-1be641b41978 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:02.432652 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb739973-71fc-4f71-b138-60dfabca57bc admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:02.443863 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f7a8a-ab3f-46cd-a176-2f4436892296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:02.444632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f7a8a-ab3f-46cd-a176-2f4436892296 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:02.445644 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f7a8a-ab3f-46cd-a176-2f4436892296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:02.447116 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f7a8a-ab3f-46cd-a176-2f4436892296 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:02.447966 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f7a8a-ab3f-46cd-a176-2f4436892296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:02.452855 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f7a8a-ab3f-46cd-a176-2f4436892296 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:02.470167 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcec4c4-356a-4576-bbb8-a6f9d2514c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:02.471885 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcec4c4-356a-4576-bbb8-a6f9d2514c6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:02.472645 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcec4c4-356a-4576-bbb8-a6f9d2514c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:02.473715 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcec4c4-356a-4576-bbb8-a6f9d2514c6a admin admin] PATH_INFO: `/v3/projects/72f1b0f194b54b349a8478a763cc5d76/users/6684bc9d889842738b578345bcd260f9/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:02.477924 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 862/1729] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:02.485406 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f7a8a-ab3f-46cd-a176-2f4436892296 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:02.506256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f7a8a-ab3f-46cd-a176-2f4436892296 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:02.515198 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcec4c4-356a-4576-bbb8-a6f9d2514c6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=72f1b0f194b54b349a8478a763cc5d76, user_id=6684bc9d889842738b578345bcd260f9, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:02.518737 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcec4c4-356a-4576-bbb8-a6f9d2514c6a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:02.527401 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1923c99-0eda-4c18-8f81-e7dd890e80c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:02.528572 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1923c99-0eda-4c18-8f81-e7dd890e80c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:02.529000 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1923c99-0eda-4c18-8f81-e7dd890e80c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:02.529611 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1923c99-0eda-4c18-8f81-e7dd890e80c1 admin admin] PATH_INFO: `/v3/projects/16591812380a4beeac1f2266b7d4450d/users/f7ea0033566a417f9d7c21843acc4ef5/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:02.532530 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1923c99-0eda-4c18-8f81-e7dd890e80c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16591812380a4beeac1f2266b7d4450d, user_id=f7ea0033566a417f9d7c21843acc4ef5, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:02.535732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1923c99-0eda-4c18-8f81-e7dd890e80c1 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:02.558969 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 863/1730] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:02 2022] PUT /identity/v3/projects/16591812380a4beeac1f2266b7d4450d/users/f7ea0033566a417f9d7c21843acc4ef5/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:02.560759 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c92088-7d9a-46f9-8de7-fe866b311cf8 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:02.561215 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c92088-7d9a-46f9-8de7-fe866b311cf8 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:02.566060 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c92088-7d9a-46f9-8de7-fe866b311cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:02.602278 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-09c92088-7d9a-46f9-8de7-fe866b311cf8 None None] MFA Rules not processed for user `f7ea0033566a417f9d7c21843acc4ef5`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:02.603639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-09c92088-7d9a-46f9-8de7-fe866b311cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:02.747201 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 868/1731] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:02 2022] PUT /identity/v3/projects/72f1b0f194b54b349a8478a763cc5d76/users/6684bc9d889842738b578345bcd260f9/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:02.751566 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae6724-7543-407b-88fe-b479ccc6e761 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:02.751732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae6724-7543-407b-88fe-b479ccc6e761 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:02.752280 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae6724-7543-407b-88fe-b479ccc6e761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:02.794425 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 864/1732] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:02 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:02.795407 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c92088-7d9a-46f9-8de7-fe866b311cf8 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:02.805560 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-09c92088-7d9a-46f9-8de7-fe866b311cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:02.848787 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f4ae6724-7543-407b-88fe-b479ccc6e761 None None] MFA Rules not processed for user `6684bc9d889842738b578345bcd260f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:02.850745 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f4ae6724-7543-407b-88fe-b479ccc6e761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:02.972470 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 869/1733] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:02.986126 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae6724-7543-407b-88fe-b479ccc6e761 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:02.998263 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f4ae6724-7543-407b-88fe-b479ccc6e761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:03.126293 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c92088-7d9a-46f9-8de7-fe866b311cf8 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:03.153956 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae6724-7543-407b-88fe-b479ccc6e761 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:03.165110 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6afa50-7820-42bc-8911-90b5dda60157 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:03.165228 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6afa50-7820-42bc-8911-90b5dda60157 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:03.165440 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6afa50-7820-42bc-8911-90b5dda60157 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:03.165713 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6afa50-7820-42bc-8911-90b5dda60157 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:03.307289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6afa50-7820-42bc-8911-90b5dda60157 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:03.309162 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6afa50-7820-42bc-8911-90b5dda60157 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:03.322722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbc4e5-bb37-46d9-8c61-9d1f6ad3f05f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0aac45d8b549afafae0a3f623bce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:03.323378 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbc4e5-bb37-46d9-8c61-9d1f6ad3f05f service swift] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:03.323763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbc4e5-bb37-46d9-8c61-9d1f6ad3f05f service swift] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:03.324040 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dbc4e5-bb37-46d9-8c61-9d1f6ad3f05f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:03.377519 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 870/1734] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:02 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:23:03.381613 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc09ba-77e1-4b7c-8573-bc4e4ff16f24 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:03.381613 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc09ba-77e1-4b7c-8573-bc4e4ff16f24 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:03.381832 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc09ba-77e1-4b7c-8573-bc4e4ff16f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:03.433242 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-c1cc09ba-77e1-4b7c-8573-bc4e4ff16f24 None None] MFA Rules not processed for user `7f06e823c4ad4725896e7452eecfcc4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:03.436050 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c1cc09ba-77e1-4b7c-8573-bc4e4ff16f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:03.457373 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dbc4e5-bb37-46d9-8c61-9d1f6ad3f05f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:03.459053 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dbc4e5-bb37-46d9-8c61-9d1f6ad3f05f service swift] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:03.494543 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 865/1735] 10.222.0.81 () {60 vars in 1384 bytes} [Tue Sep 6 21:23:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 700 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 21:23:03.499267 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbc4e5-bb37-46d9-8c61-9d1f6ad3f05f service swift] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:03.741090 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 871/1736] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:03.771155 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:03.826919 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dbc4e5-bb37-46d9-8c61-9d1f6ad3f05f service swift] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:03.851509 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf182da2-ff77-4bf9-9390-078275f600ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:03.854289 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf182da2-ff77-4bf9-9390-078275f600ce admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:03.857589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf182da2-ff77-4bf9-9390-078275f600ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:03.861023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf182da2-ff77-4bf9-9390-078275f600ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:03.863005 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf182da2-ff77-4bf9-9390-078275f600ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:03.868066 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf182da2-ff77-4bf9-9390-078275f600ce admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:04.050534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 866/1737] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:23:03 2022] POST /identity/v3/projects => generated 357 bytes in 552 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:04.055234 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc09ba-77e1-4b7c-8573-bc4e4ff16f24 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:04.082358 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc09ba-77e1-4b7c-8573-bc4e4ff16f24 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:04.336039 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d672b-3561-4ca6-9743-a85c8ccc3f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:04.339902 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d672b-3561-4ca6-9743-a85c8ccc3f2b admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:04.341284 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d672b-3561-4ca6-9743-a85c8ccc3f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:04.341743 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d672b-3561-4ca6-9743-a85c8ccc3f2b admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:04.342477 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d672b-3561-4ca6-9743-a85c8ccc3f2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:04.346219 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d672b-3561-4ca6-9743-a85c8ccc3f2b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:04.511326 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 872/1738] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:23:04 2022] POST /identity/v3/users => generated 285 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:04.513214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf182da2-ff77-4bf9-9390-078275f600ce admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:04.539061 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf182da2-ff77-4bf9-9390-078275f600ce admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:04.582236 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a7e2c-126f-4e2e-9bb4-5bdb1754e52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:04.582886 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a7e2c-126f-4e2e-9bb4-5bdb1754e52a admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:04.585937 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a7e2c-126f-4e2e-9bb4-5bdb1754e52a admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:04.586246 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4a7e2c-126f-4e2e-9bb4-5bdb1754e52a admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:04.587003 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a7e2c-126f-4e2e-9bb4-5bdb1754e52a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:04.588610 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4a7e2c-126f-4e2e-9bb4-5bdb1754e52a admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:04.621427 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 867/1739] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:04.626537 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d672b-3561-4ca6-9743-a85c8ccc3f2b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:04.642914 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d672b-3561-4ca6-9743-a85c8ccc3f2b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:04.649980 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9ec8a-d480-4a20-a488-b70ffb22d97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:04.651169 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9ec8a-d480-4a20-a488-b70ffb22d97e admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:04.651516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9ec8a-d480-4a20-a488-b70ffb22d97e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:04.652131 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9ec8a-d480-4a20-a488-b70ffb22d97e admin admin] PATH_INFO: `/v3/projects/9f32c2bb28234f7a801978e7d5621ca2/users/67dfbafd7b124bb98d23a087ab79bf97/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:04.659410 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:04.702387 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9ec8a-d480-4a20-a488-b70ffb22d97e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f32c2bb28234f7a801978e7d5621ca2, user_id=67dfbafd7b124bb98d23a087ab79bf97, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:04.706007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9ec8a-d480-4a20-a488-b70ffb22d97e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:04.846460 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a7e2c-126f-4e2e-9bb4-5bdb1754e52a admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:04.847078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 873/1740] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:04 2022] PUT /identity/v3/projects/9f32c2bb28234f7a801978e7d5621ca2/users/67dfbafd7b124bb98d23a087ab79bf97/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:04.859494 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4a7e2c-126f-4e2e-9bb4-5bdb1754e52a admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:05.069773 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c6cf0-00ae-4f15-8d72-3d3b884a8ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:05.070627 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c6cf0-00ae-4f15-8d72-3d3b884a8ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:05.071152 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c6cf0-00ae-4f15-8d72-3d3b884a8ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:05.071567 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c6cf0-00ae-4f15-8d72-3d3b884a8ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:05.072400 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c6cf0-00ae-4f15-8d72-3d3b884a8ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:05.074614 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c6cf0-00ae-4f15-8d72-3d3b884a8ed9 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:05.095493 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 868/1741] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:23:05.099542 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9ec8a-d480-4a20-a488-b70ffb22d97e admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:05.116698 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9ec8a-d480-4a20-a488-b70ffb22d97e admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:05.132403 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd92a0-fc72-4e70-8e31-86d3c115a3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:05.134544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd92a0-fc72-4e70-8e31-86d3c115a3fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:05.136417 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd92a0-fc72-4e70-8e31-86d3c115a3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:05.136855 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd92a0-fc72-4e70-8e31-86d3c115a3fd admin admin] PATH_INFO: `/v3/projects/9f32c2bb28234f7a801978e7d5621ca2/users/67dfbafd7b124bb98d23a087ab79bf97/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:05.145586 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd92a0-fc72-4e70-8e31-86d3c115a3fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f32c2bb28234f7a801978e7d5621ca2, user_id=67dfbafd7b124bb98d23a087ab79bf97, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:05.149682 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd92a0-fc72-4e70-8e31-86d3c115a3fd admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:05.194066 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c6cf0-00ae-4f15-8d72-3d3b884a8ed9 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:05.195411 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 874/1742] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:05 2022] PUT /identity/v3/projects/9f32c2bb28234f7a801978e7d5621ca2/users/67dfbafd7b124bb98d23a087ab79bf97/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:05.212420 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5151d4-5a9a-49c1-abf2-f96a9c9170f0 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:05.213151 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5151d4-5a9a-49c1-abf2-f96a9c9170f0 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:05.213609 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5151d4-5a9a-49c1-abf2-f96a9c9170f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:05.229176 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:05.301342 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-6c5151d4-5a9a-49c1-abf2-f96a9c9170f0 None None] MFA Rules not processed for user `67dfbafd7b124bb98d23a087ab79bf97`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:05.302699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6c5151d4-5a9a-49c1-abf2-f96a9c9170f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:05.424534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c6cf0-00ae-4f15-8d72-3d3b884a8ed9 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:05.647724 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 875/1743] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:05 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:23:05.649051 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb98d1c-7487-4fb5-8871-344d101f10bc tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ea0033566a417f9d7c21843acc4ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16591812380a4beeac1f2266b7d4450d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:05.649051 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb98d1c-7487-4fb5-8871-344d101f10bc tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:05.649051 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb98d1c-7487-4fb5-8871-344d101f10bc tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:05.650081 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb98d1c-7487-4fb5-8871-344d101f10bc tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:05.650081 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb98d1c-7487-4fb5-8871-344d101f10bc tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:23:05.650081 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb98d1c-7487-4fb5-8871-344d101f10bc tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:05.650081 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb98d1c-7487-4fb5-8871-344d101f10bc tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:05.650081 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 869/1744] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:23:05.650500 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5151d4-5a9a-49c1-abf2-f96a9c9170f0 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:05.650577 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb98d1c-7487-4fb5-8871-344d101f10bc tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:05.650577 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6eb98d1c-7487-4fb5-8871-344d101f10bc tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:05.665793 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5151d4-5a9a-49c1-abf2-f96a9c9170f0 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:05.677861 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fae4df-1494-4d2f-9786-28882f6505e2 tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ea0033566a417f9d7c21843acc4ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16591812380a4beeac1f2266b7d4450d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:05.732775 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fae4df-1494-4d2f-9786-28882f6505e2 tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:05.732775 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fae4df-1494-4d2f-9786-28882f6505e2 tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:05.732775 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fae4df-1494-4d2f-9786-28882f6505e2 tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:05.732775 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fae4df-1494-4d2f-9786-28882f6505e2 tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:05.732775 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fae4df-1494-4d2f-9786-28882f6505e2 tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:05.765313 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb98d1c-7487-4fb5-8871-344d101f10bc tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:05.784397 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61194d-a0e7-48c8-a553-29e6a48a8f1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:05.784397 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61194d-a0e7-48c8-a553-29e6a48a8f1e service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:05.784397 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61194d-a0e7-48c8-a553-29e6a48a8f1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:05.784397 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61194d-a0e7-48c8-a553-29e6a48a8f1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:05.789794 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61194d-a0e7-48c8-a553-29e6a48a8f1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:05.792001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61194d-a0e7-48c8-a553-29e6a48a8f1e service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:05.812130 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 870/1745] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:05 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:23:06.132167 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 876/1746] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:23:05 2022] POST /identity/v3/projects => generated 354 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:06.143303 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61194d-a0e7-48c8-a553-29e6a48a8f1e service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:06.145718 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ee2eb-72d3-48b3-a2d1-549920358099 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:06.148283 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ee2eb-72d3-48b3-a2d1-549920358099 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:06.148283 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ee2eb-72d3-48b3-a2d1-549920358099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:06.155757 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61194d-a0e7-48c8-a553-29e6a48a8f1e service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:06.257082 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-518ee2eb-72d3-48b3-a2d1-549920358099 None None] MFA Rules not processed for user `caa6c1fb5b354a409bc8f1a69dc2e718`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:06.258682 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-518ee2eb-72d3-48b3-a2d1-549920358099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:06.371284 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efcba12-8880-4298-b1ab-99b74bb509c5 tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ea0033566a417f9d7c21843acc4ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16591812380a4beeac1f2266b7d4450d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:06.375870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcba12-8880-4298-b1ab-99b74bb509c5 tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:06.375870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcba12-8880-4298-b1ab-99b74bb509c5 tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:06.375870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efcba12-8880-4298-b1ab-99b74bb509c5 tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:06.375870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efcba12-8880-4298-b1ab-99b74bb509c5 tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:23:06.375870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efcba12-8880-4298-b1ab-99b74bb509c5 tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:06.376345 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efcba12-8880-4298-b1ab-99b74bb509c5 tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:06.416297 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 871/1747] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:23:06.417270 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efcba12-8880-4298-b1ab-99b74bb509c5 tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:06.420225 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 877/1748] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:06.430921 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ee2eb-72d3-48b3-a2d1-549920358099 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:06.544907 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:06.616154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ee2eb-72d3-48b3-a2d1-549920358099 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:06.628971 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8f938-ce80-4f1a-a9b8-377bedb350a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:06.630478 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8f938-ce80-4f1a-a9b8-377bedb350a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:06.630679 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8f938-ce80-4f1a-a9b8-377bedb350a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:06.632298 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8f938-ce80-4f1a-a9b8-377bedb350a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:06.633840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8f938-ce80-4f1a-a9b8-377bedb350a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:06.645266 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba8f938-ce80-4f1a-a9b8-377bedb350a2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:06.645375 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efcba12-8880-4298-b1ab-99b74bb509c5 tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:06.656905 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18107011-8eeb-41f5-856e-eb4c3910c828 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:06.657597 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18107011-8eeb-41f5-856e-eb4c3910c828 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:06.657801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18107011-8eeb-41f5-856e-eb4c3910c828 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:06.658150 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18107011-8eeb-41f5-856e-eb4c3910c828 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:06.849287 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 878/1749] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:23:06 2022] POST /identity/v3/projects => generated 373 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:06.857065 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8f938-ce80-4f1a-a9b8-377bedb350a2 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:06.885379 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18107011-8eeb-41f5-856e-eb4c3910c828 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:06.887210 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18107011-8eeb-41f5-856e-eb4c3910c828 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:06.920632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 872/1750] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:06 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:23:06.930185 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18107011-8eeb-41f5-856e-eb4c3910c828 service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:06.976218 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18107011-8eeb-41f5-856e-eb4c3910c828 service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:07.120725 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:07.194812 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8f938-ce80-4f1a-a9b8-377bedb350a2 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:07.217652 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa829a8-f85f-4636-b498-3667477f03b2 tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7ea0033566a417f9d7c21843acc4ef5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '16591812380a4beeac1f2266b7d4450d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:07.221012 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa829a8-f85f-4636-b498-3667477f03b2 tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:07.221444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa829a8-f85f-4636-b498-3667477f03b2 tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:07.223503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa829a8-f85f-4636-b498-3667477f03b2 tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] PATH_INFO: `/v3/projects/71c3e9bc987f40bbbfcbbc55bb8c5507` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:07.230770 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa829a8-f85f-4636-b498-3667477f03b2 tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] RBAC: Authorizing `identity:delete_project(project_id=71c3e9bc987f40bbbfcbbc55bb8c5507)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:07.237993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa829a8-f85f-4636-b498-3667477f03b2 tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:07.282173 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69984155-9cc4-4df5-8e46-21adb83b2f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:07.284863 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69984155-9cc4-4df5-8e46-21adb83b2f0d admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:07.288267 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69984155-9cc4-4df5-8e46-21adb83b2f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:07.290059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69984155-9cc4-4df5-8e46-21adb83b2f0d admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:07.295430 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69984155-9cc4-4df5-8e46-21adb83b2f0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:07.304945 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69984155-9cc4-4df5-8e46-21adb83b2f0d admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:07.432866 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 873/1751] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:23:06 2022] POST /identity/v3/users => generated 293 bytes in 512 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:07.437064 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc1480-9d7a-4886-b3f8-25490ea1af3d None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:07.437064 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc1480-9d7a-4886-b3f8-25490ea1af3d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:07.437064 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc1480-9d7a-4886-b3f8-25490ea1af3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:07.488915 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-dfa829a8-f85f-4636-b498-3667477f03b2 tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71c3e9bc987f40bbbfcbbc55bb8c5507', 'request_id': 'req-dfa829a8-f85f-4636-b498-3667477f03b2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:07.508056 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-dfa829a8-f85f-4636-b498-3667477f03b2 tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71c3e9bc987f40bbbfcbbc55bb8c5507', 'request_id': 'req-dfa829a8-f85f-4636-b498-3667477f03b2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:07.535260 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-2adc1480-9d7a-4886-b3f8-25490ea1af3d None None] MFA Rules not processed for user `c9aebd6c7ef24f42949918c99a72722d`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:07.541051 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-2adc1480-9d7a-4886-b3f8-25490ea1af3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:07.541297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-dfa829a8-f85f-4636-b498-3667477f03b2 tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71c3e9bc987f40bbbfcbbc55bb8c5507', 'request_id': 'req-dfa829a8-f85f-4636-b498-3667477f03b2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:07.679173 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 874/1752] 10.222.0.75 () {58 vars in 1015 bytes} [Tue Sep 6 21:23:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:07.679173 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc1480-9d7a-4886-b3f8-25490ea1af3d None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:07.701840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-dfa829a8-f85f-4636-b498-3667477f03b2 tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] The token cache is being invalidate because project 71c3e9bc987f40bbbfcbbc55bb8c5507 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:23:07.702147 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-dfa829a8-f85f-4636-b498-3667477f03b2 tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:07.704859 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-dfa829a8-f85f-4636-b498-3667477f03b2 tempest-VolumeQuotaClassesTest-320772953 tempest-VolumeQuotaClassesTest-320772953-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:07.713344 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 879/1753] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:23:06 2022] DELETE /identity/v3/projects/71c3e9bc987f40bbbfcbbc55bb8c5507 => generated 0 bytes in 860 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:07.714986 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7036c10-34a9-412d-a668-94a5b809a8e2 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:07.715231 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7036c10-34a9-412d-a668-94a5b809a8e2 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:07.715559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7036c10-34a9-412d-a668-94a5b809a8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:07.747592 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a7036c10-34a9-412d-a668-94a5b809a8e2 None None] MFA Rules not processed for user `7ad886fd7cd445a18918965391eade77`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:07.750677 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a7036c10-34a9-412d-a668-94a5b809a8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:07.814071 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc1480-9d7a-4886-b3f8-25490ea1af3d None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:07.828887 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfd98f-b48f-46fa-bc6a-d818c9034203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:07.830214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfd98f-b48f-46fa-bc6a-d818c9034203 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:07.830529 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfd98f-b48f-46fa-bc6a-d818c9034203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:07.830781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dfd98f-b48f-46fa-bc6a-d818c9034203 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:07.832491 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfd98f-b48f-46fa-bc6a-d818c9034203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:07.845901 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dfd98f-b48f-46fa-bc6a-d818c9034203 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:07.859766 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 875/1754] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:07.865299 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfd98f-b48f-46fa-bc6a-d818c9034203 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:07.867395 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-33dfd98f-b48f-46fa-bc6a-d818c9034203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:07.890187 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dfd98f-b48f-46fa-bc6a-d818c9034203 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:07.897370 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8fbc6-7780-462f-a4cd-c8b510eac4bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:07.900971 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8fbc6-7780-462f-a4cd-c8b510eac4bd service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:07.900971 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8fbc6-7780-462f-a4cd-c8b510eac4bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:07.903007 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd8fbc6-7780-462f-a4cd-c8b510eac4bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:07.933023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7fd8fbc6-7780-462f-a4cd-c8b510eac4bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:07.955544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 880/1755] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:07.956429 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7036c10-34a9-412d-a668-94a5b809a8e2 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:07.973724 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a7036c10-34a9-412d-a668-94a5b809a8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:08.006028 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8fbc6-7780-462f-a4cd-c8b510eac4bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:08.009574 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd8fbc6-7780-462f-a4cd-c8b510eac4bd service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:08.023490 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 876/1756] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:23:08.043885 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7036c10-34a9-412d-a668-94a5b809a8e2 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:08.073503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa036a9-56a5-4a53-b73c-8841cc100394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:08.078601 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa036a9-56a5-4a53-b73c-8841cc100394 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:08.078933 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa036a9-56a5-4a53-b73c-8841cc100394 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:08.080492 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa036a9-56a5-4a53-b73c-8841cc100394 admin admin] PATH_INFO: `/v3/projects/9ba40177a485449784d08026261e9258/users/441fa4964cdd474a8fe12b56e6266afa/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:08.133836 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa036a9-56a5-4a53-b73c-8841cc100394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ba40177a485449784d08026261e9258, user_id=441fa4964cdd474a8fe12b56e6266afa, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:08.142945 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa036a9-56a5-4a53-b73c-8841cc100394 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:08.281651 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:08.291445 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 881/1757] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:07 2022] PUT /identity/v3/projects/9ba40177a485449784d08026261e9258/users/441fa4964cdd474a8fe12b56e6266afa/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:08.292180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8fbc6-7780-462f-a4cd-c8b510eac4bd service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:08.321223 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd8fbc6-7780-462f-a4cd-c8b510eac4bd service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:08.524665 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40338d9-2e91-4827-a4e0-be4945914fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:08.526146 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40338d9-2e91-4827-a4e0-be4945914fb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:08.526146 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40338d9-2e91-4827-a4e0-be4945914fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:08.526146 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40338d9-2e91-4827-a4e0-be4945914fb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:08.529122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40338d9-2e91-4827-a4e0-be4945914fb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:08.543160 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40338d9-2e91-4827-a4e0-be4945914fb9 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:08.581517 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 877/1758] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:08.582552 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa036a9-56a5-4a53-b73c-8841cc100394 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:08.606037 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa036a9-56a5-4a53-b73c-8841cc100394 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:08.618050 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e982603e-79a7-40c7-b5d8-a96ac23413f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:08.618872 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982603e-79a7-40c7-b5d8-a96ac23413f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:08.619320 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982603e-79a7-40c7-b5d8-a96ac23413f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:08.619876 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e982603e-79a7-40c7-b5d8-a96ac23413f6 admin admin] PATH_INFO: `/v3/projects/9ba40177a485449784d08026261e9258/users/441fa4964cdd474a8fe12b56e6266afa/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:08.636019 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982603e-79a7-40c7-b5d8-a96ac23413f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ba40177a485449784d08026261e9258, user_id=441fa4964cdd474a8fe12b56e6266afa, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:08.639165 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e982603e-79a7-40c7-b5d8-a96ac23413f6 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:08.655082 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 882/1759] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:08 2022] PUT /identity/v3/projects/9ba40177a485449784d08026261e9258/users/441fa4964cdd474a8fe12b56e6266afa/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:08.667941 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:08.760953 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40338d9-2e91-4827-a4e0-be4945914fb9 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:08.762784 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d40338d9-2e91-4827-a4e0-be4945914fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:08.777539 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40338d9-2e91-4827-a4e0-be4945914fb9 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:08.906409 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b7cf0-6e1b-4c16-a200-9128e9d3aa05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:08.907144 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b7cf0-6e1b-4c16-a200-9128e9d3aa05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:08.907432 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b7cf0-6e1b-4c16-a200-9128e9d3aa05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:08.907710 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72b7cf0-6e1b-4c16-a200-9128e9d3aa05 admin admin] PATH_INFO: `/v3/users/c8ac70617454428bb8426aafd4ef92e4` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:08.909785 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b7cf0-6e1b-4c16-a200-9128e9d3aa05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8ac70617454428bb8426aafd4ef92e4)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:08.911778 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72b7cf0-6e1b-4c16-a200-9128e9d3aa05 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:09.211628 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b72b7cf0-6e1b-4c16-a200-9128e9d3aa05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8ac70617454428bb8426aafd4ef92e4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:09.309028 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b72b7cf0-6e1b-4c16-a200-9128e9d3aa05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8ac70617454428bb8426aafd4ef92e4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:09.327500 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b72b7cf0-6e1b-4c16-a200-9128e9d3aa05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8ac70617454428bb8426aafd4ef92e4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:09.328278 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b72b7cf0-6e1b-4c16-a200-9128e9d3aa05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8ac70617454428bb8426aafd4ef92e4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:09.337799 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b72b7cf0-6e1b-4c16-a200-9128e9d3aa05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8ac70617454428bb8426aafd4ef92e4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:09.345675 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 878/1760] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:23:08 2022] DELETE /identity/v3/users/c8ac70617454428bb8426aafd4ef92e4 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:09.351079 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e3523-7876-4054-8bb5-6bd3f02cd021 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:09.352208 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e3523-7876-4054-8bb5-6bd3f02cd021 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:09.352731 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e3523-7876-4054-8bb5-6bd3f02cd021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:09.402669 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ee6e3523-7876-4054-8bb5-6bd3f02cd021 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:09.404502 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ee6e3523-7876-4054-8bb5-6bd3f02cd021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:09.487450 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 883/1761] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:09.507630 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b7cf0-6e1b-4c16-a200-9128e9d3aa05 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:09.509718 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b72b7cf0-6e1b-4c16-a200-9128e9d3aa05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:09.640588 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72b7cf0-6e1b-4c16-a200-9128e9d3aa05 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:09.648425 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df761d2-3d8d-4f0b-8c27-2e1fbba0effd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:09.649565 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df761d2-3d8d-4f0b-8c27-2e1fbba0effd service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:09.650139 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df761d2-3d8d-4f0b-8c27-2e1fbba0effd service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:09.650866 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df761d2-3d8d-4f0b-8c27-2e1fbba0effd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:09.673794 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df761d2-3d8d-4f0b-8c27-2e1fbba0effd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:09.687048 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df761d2-3d8d-4f0b-8c27-2e1fbba0effd service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:09.712497 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 879/1762] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:23:10.005709 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:10.411180 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:11.464793 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e3523-7876-4054-8bb5-6bd3f02cd021 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:11.464793 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ee6e3523-7876-4054-8bb5-6bd3f02cd021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:11.481941 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e3523-7876-4054-8bb5-6bd3f02cd021 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:11.499146 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc6f78-76c0-444b-98b2-6568f8a7cdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:11.500864 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc6f78-76c0-444b-98b2-6568f8a7cdcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:11.501154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc6f78-76c0-444b-98b2-6568f8a7cdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:11.501957 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc6f78-76c0-444b-98b2-6568f8a7cdcd admin admin] PATH_INFO: `/v3/projects/ce77b87859a2461689feb95f3b091a1d` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:11.506196 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc6f78-76c0-444b-98b2-6568f8a7cdcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce77b87859a2461689feb95f3b091a1d)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:11.508387 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc6f78-76c0-444b-98b2-6568f8a7cdcd admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:11.639749 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:11.653196 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff884f58-3631-43a8-8150-77afec08e87f None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:11.653559 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff884f58-3631-43a8-8150-77afec08e87f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:11.653844 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff884f58-3631-43a8-8150-77afec08e87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:11.691886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-08dc6f78-76c0-444b-98b2-6568f8a7cdcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce77b87859a2461689feb95f3b091a1d', 'request_id': 'req-08dc6f78-76c0-444b-98b2-6568f8a7cdcd'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:11.707419 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-08dc6f78-76c0-444b-98b2-6568f8a7cdcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce77b87859a2461689feb95f3b091a1d', 'request_id': 'req-08dc6f78-76c0-444b-98b2-6568f8a7cdcd'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:11.708562 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-ff884f58-3631-43a8-8150-77afec08e87f None None] MFA Rules not processed for user `441fa4964cdd474a8fe12b56e6266afa`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:11.710143 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ff884f58-3631-43a8-8150-77afec08e87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:11.719164 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-08dc6f78-76c0-444b-98b2-6568f8a7cdcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce77b87859a2461689feb95f3b091a1d', 'request_id': 'req-08dc6f78-76c0-444b-98b2-6568f8a7cdcd'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:11.771822 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-08dc6f78-76c0-444b-98b2-6568f8a7cdcd admin admin] The token cache is being invalidate because project ce77b87859a2461689feb95f3b091a1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:23:11.795562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-08dc6f78-76c0-444b-98b2-6568f8a7cdcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:11.795562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-08dc6f78-76c0-444b-98b2-6568f8a7cdcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:11.795562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 884/1763] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:23:11 2022] DELETE /identity/v3/projects/ce77b87859a2461689feb95f3b091a1d => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:23:11.795562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc6f78-76c0-444b-98b2-6568f8a7cdcd admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:11.795562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-08dc6f78-76c0-444b-98b2-6568f8a7cdcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:11.863599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 880/1764] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:11 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:23:11.877176 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7b57d-bc9e-406b-a926-98bec9dacb03 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:11.877458 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7b57d-bc9e-406b-a926-98bec9dacb03 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:11.877913 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7b57d-bc9e-406b-a926-98bec9dacb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:11.914766 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-57b7b57d-bc9e-406b-a926-98bec9dacb03 None None] MFA Rules not processed for user `caa6c1fb5b354a409bc8f1a69dc2e718`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:11.916488 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-57b7b57d-bc9e-406b-a926-98bec9dacb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:11.956419 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc6f78-76c0-444b-98b2-6568f8a7cdcd admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:11.981027 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea444b80-f846-42c6-a915-0034fc4c8c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:11.989874 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea444b80-f846-42c6-a915-0034fc4c8c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:11.991429 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea444b80-f846-42c6-a915-0034fc4c8c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:11.992845 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea444b80-f846-42c6-a915-0034fc4c8c5c admin admin] PATH_INFO: `/v3/users/f7ea0033566a417f9d7c21843acc4ef5` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:11.995262 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea444b80-f846-42c6-a915-0034fc4c8c5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7ea0033566a417f9d7c21843acc4ef5)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:12.002361 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea444b80-f846-42c6-a915-0034fc4c8c5c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:12.072699 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 881/1765] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:11 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:23:12.251293 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ea444b80-f846-42c6-a915-0034fc4c8c5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7ea0033566a417f9d7c21843acc4ef5'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:12.336115 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ea444b80-f846-42c6-a915-0034fc4c8c5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7ea0033566a417f9d7c21843acc4ef5'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:12.354483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ea444b80-f846-42c6-a915-0034fc4c8c5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7ea0033566a417f9d7c21843acc4ef5'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:12.355240 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ea444b80-f846-42c6-a915-0034fc4c8c5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7ea0033566a417f9d7c21843acc4ef5'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:12.369126 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ea444b80-f846-42c6-a915-0034fc4c8c5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7ea0033566a417f9d7c21843acc4ef5'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:12.376024 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 885/1766] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:23:11 2022] DELETE /identity/v3/users/f7ea0033566a417f9d7c21843acc4ef5 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:13.198991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7b57d-bc9e-406b-a926-98bec9dacb03 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:13.204776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-57b7b57d-bc9e-406b-a926-98bec9dacb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:13.434413 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7b57d-bc9e-406b-a926-98bec9dacb03 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:13.445936 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:13.581411 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edca6d-b188-41e8-b036-16bae4afcdda None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:13.582463 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edca6d-b188-41e8-b036-16bae4afcdda None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:13.583068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91edca6d-b188-41e8-b036-16bae4afcdda None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:13.584938 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 886/1767] 10.222.0.81 () {54 vars in 921 bytes} [Tue Sep 6 21:23:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:23:13.602591 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bf6586-6f88-4bca-8937-c7674522d9d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:13.603321 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf6586-6f88-4bca-8937-c7674522d9d7 service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:13.604161 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf6586-6f88-4bca-8937-c7674522d9d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:13.604161 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bf6586-6f88-4bca-8937-c7674522d9d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:13.607494 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a4bf6586-6f88-4bca-8937-c7674522d9d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:13.637310 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17eca0a-d3e3-4755-8771-1895901968f8 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:13.639533 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17eca0a-d3e3-4755-8771-1895901968f8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:13.639533 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17eca0a-d3e3-4755-8771-1895901968f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:13.668602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-b17eca0a-d3e3-4755-8771-1895901968f8 None None] MFA Rules not processed for user `4441d8fea57f401a96fb8cbd2b501059`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:13.668602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b17eca0a-d3e3-4755-8771-1895901968f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:13.684313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 887/1768] 10.222.0.81 () {58 vars in 1018 bytes} [Tue Sep 6 21:23:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:13.760562 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf6586-6f88-4bca-8937-c7674522d9d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:13.762003 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bf6586-6f88-4bca-8937-c7674522d9d7 service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:13.818122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 882/1769] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:23:13.883684 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17eca0a-d3e3-4755-8771-1895901968f8 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:13.885263 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b17eca0a-d3e3-4755-8771-1895901968f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:13.978847 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:14.061305 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17eca0a-d3e3-4755-8771-1895901968f8 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:14.076761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06d2d25-32e4-49ac-af37-15a0bd8e575d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:14.077927 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d2d25-32e4-49ac-af37-15a0bd8e575d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:14.078935 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d2d25-32e4-49ac-af37-15a0bd8e575d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:14.079447 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06d2d25-32e4-49ac-af37-15a0bd8e575d admin admin] PATH_INFO: `/v3/projects/16591812380a4beeac1f2266b7d4450d` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:14.081997 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d2d25-32e4-49ac-af37-15a0bd8e575d admin admin] RBAC: Authorizing `identity:delete_project(project_id=16591812380a4beeac1f2266b7d4450d)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:14.084302 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06d2d25-32e4-49ac-af37-15a0bd8e575d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:14.148317 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:14.261783 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f06d2d25-32e4-49ac-af37-15a0bd8e575d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16591812380a4beeac1f2266b7d4450d', 'request_id': 'req-f06d2d25-32e4-49ac-af37-15a0bd8e575d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:14.281592 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f06d2d25-32e4-49ac-af37-15a0bd8e575d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16591812380a4beeac1f2266b7d4450d', 'request_id': 'req-f06d2d25-32e4-49ac-af37-15a0bd8e575d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:14.306790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f06d2d25-32e4-49ac-af37-15a0bd8e575d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16591812380a4beeac1f2266b7d4450d', 'request_id': 'req-f06d2d25-32e4-49ac-af37-15a0bd8e575d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:14.416533 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f06d2d25-32e4-49ac-af37-15a0bd8e575d admin admin] The token cache is being invalidate because project 16591812380a4beeac1f2266b7d4450d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:23:14.416830 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f06d2d25-32e4-49ac-af37-15a0bd8e575d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:14.417524 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f06d2d25-32e4-49ac-af37-15a0bd8e575d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:14.421163 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 888/1770] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:23:13 2022] DELETE /identity/v3/projects/16591812380a4beeac1f2266b7d4450d => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:14.427324 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dac404-1abb-463b-bb19-7862853d27ef None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:14.428413 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dac404-1abb-463b-bb19-7862853d27ef None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:14.428863 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dac404-1abb-463b-bb19-7862853d27ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:14.503470 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-a6dac404-1abb-463b-bb19-7862853d27ef None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:14.504767 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a6dac404-1abb-463b-bb19-7862853d27ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:14.659826 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 883/1771] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:14.668152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f67c6-cfe5-492b-8efd-24c7d94bf628 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:14.669359 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f67c6-cfe5-492b-8efd-24c7d94bf628 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:14.669801 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f67c6-cfe5-492b-8efd-24c7d94bf628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:14.712319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d16f67c6-cfe5-492b-8efd-24c7d94bf628 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:14.720599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d16f67c6-cfe5-492b-8efd-24c7d94bf628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:14.733906 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 889/1772] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:14.739043 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dac404-1abb-463b-bb19-7862853d27ef None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:14.758866 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dac404-1abb-463b-bb19-7862853d27ef None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:14.765755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ab8fa-918f-475f-8fb3-d59b6bf1eae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:14.767933 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ab8fa-918f-475f-8fb3-d59b6bf1eae2 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:14.768443 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ab8fa-918f-475f-8fb3-d59b6bf1eae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:14.768890 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ab8fa-918f-475f-8fb3-d59b6bf1eae2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:14.769750 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ab8fa-918f-475f-8fb3-d59b6bf1eae2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:23:14.770214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ab8fa-918f-475f-8fb3-d59b6bf1eae2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:14.772753 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ab8fa-918f-475f-8fb3-d59b6bf1eae2 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:14.789143 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 884/1773] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:23:14.793450 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f67c6-cfe5-492b-8efd-24c7d94bf628 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:14.814903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f67c6-cfe5-492b-8efd-24c7d94bf628 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:14.823050 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545aeb7d-7186-49b5-b839-381b4dfb0c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:14.824599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545aeb7d-7186-49b5-b839-381b4dfb0c81 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:14.825125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545aeb7d-7186-49b5-b839-381b4dfb0c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:14.826443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545aeb7d-7186-49b5-b839-381b4dfb0c81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:14.827512 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545aeb7d-7186-49b5-b839-381b4dfb0c81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:14.831071 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545aeb7d-7186-49b5-b839-381b4dfb0c81 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:14.962356 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 890/1774] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:23:14 2022] POST /identity/v3/projects => generated 381 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:14.966482 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ab8fa-918f-475f-8fb3-d59b6bf1eae2 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:14.977363 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ab8fa-918f-475f-8fb3-d59b6bf1eae2 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:15.186022 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84058fe0-18c2-46f4-b151-0f93672f277b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:15.187151 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84058fe0-18c2-46f4-b151-0f93672f277b admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:15.187739 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84058fe0-18c2-46f4-b151-0f93672f277b admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:15.188214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84058fe0-18c2-46f4-b151-0f93672f277b admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:15.189138 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84058fe0-18c2-46f4-b151-0f93672f277b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:15.191615 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84058fe0-18c2-46f4-b151-0f93672f277b admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:15.349408 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545aeb7d-7186-49b5-b839-381b4dfb0c81 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:15.366648 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-545aeb7d-7186-49b5-b839-381b4dfb0c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:15.476988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545aeb7d-7186-49b5-b839-381b4dfb0c81 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:15.501527 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe987e-35b5-4835-99a5-c7e1f14e8d43 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:15.510954 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe987e-35b5-4835-99a5-c7e1f14e8d43 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:15.516220 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe987e-35b5-4835-99a5-c7e1f14e8d43 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:15.516220 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe987e-35b5-4835-99a5-c7e1f14e8d43 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:15.520518 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5bfe987e-35b5-4835-99a5-c7e1f14e8d43 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:15.535138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe987e-35b5-4835-99a5-c7e1f14e8d43 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:15.537133 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe987e-35b5-4835-99a5-c7e1f14e8d43 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:15.542997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 885/1775] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:23:14 2022] POST /identity/v3/users => generated 291 bytes in 577 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:15.549126 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84058fe0-18c2-46f4-b151-0f93672f277b admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:15.567196 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 891/1776] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:23:15.589368 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84058fe0-18c2-46f4-b151-0f93672f277b admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:15.612560 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc846783-7f6f-431e-9b53-01846c374cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:15.615923 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc846783-7f6f-431e-9b53-01846c374cfa admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:15.615923 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc846783-7f6f-431e-9b53-01846c374cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:15.615923 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc846783-7f6f-431e-9b53-01846c374cfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:15.615923 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc846783-7f6f-431e-9b53-01846c374cfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:15.625580 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc846783-7f6f-431e-9b53-01846c374cfa admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:15.666177 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 886/1777] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:15.670679 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe987e-35b5-4835-99a5-c7e1f14e8d43 service nova] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:15.688903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe987e-35b5-4835-99a5-c7e1f14e8d43 service nova] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:15.693382 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96bcd2-e55a-4b2f-b1ca-aca9a0a294f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:15.694355 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96bcd2-e55a-4b2f-b1ca-aca9a0a294f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:15.695037 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96bcd2-e55a-4b2f-b1ca-aca9a0a294f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:15.695470 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96bcd2-e55a-4b2f-b1ca-aca9a0a294f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:15.696529 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96bcd2-e55a-4b2f-b1ca-aca9a0a294f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:15.698528 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96bcd2-e55a-4b2f-b1ca-aca9a0a294f9 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:15.711862 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 892/1778] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:15.716633 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc846783-7f6f-431e-9b53-01846c374cfa admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:15.730711 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc846783-7f6f-431e-9b53-01846c374cfa admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:15.739357 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9acd1a-afaf-4cbc-b899-b538014d60a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:15.740966 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9acd1a-afaf-4cbc-b899-b538014d60a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:15.741410 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9acd1a-afaf-4cbc-b899-b538014d60a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:15.742399 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9acd1a-afaf-4cbc-b899-b538014d60a3 admin admin] PATH_INFO: `/v3/projects/70f9df1a2187423aa89537fde2e23921/users/c8ed416d764f415a9adecc226cd3639d/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:15.789660 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9acd1a-afaf-4cbc-b899-b538014d60a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f9df1a2187423aa89537fde2e23921, user_id=c8ed416d764f415a9adecc226cd3639d, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:15.797885 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9acd1a-afaf-4cbc-b899-b538014d60a3 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:15.932309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 887/1779] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:15 2022] PUT /identity/v3/projects/70f9df1a2187423aa89537fde2e23921/users/c8ed416d764f415a9adecc226cd3639d/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:15.945546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed4186-25f4-4714-8dcc-de5a0fee6c51 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:15.945835 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed4186-25f4-4714-8dcc-de5a0fee6c51 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:15.946121 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed4186-25f4-4714-8dcc-de5a0fee6c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:16.021735 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-c8ed4186-25f4-4714-8dcc-de5a0fee6c51 None None] MFA Rules not processed for user `c8ed416d764f415a9adecc226cd3639d`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:16.025040 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c8ed4186-25f4-4714-8dcc-de5a0fee6c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:16.202369 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 893/1780] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:16.207497 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9acd1a-afaf-4cbc-b899-b538014d60a3 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:16.318593 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9acd1a-afaf-4cbc-b899-b538014d60a3 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:16.339373 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380bbce-e934-4219-963e-d8aac108fdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:16.340072 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380bbce-e934-4219-963e-d8aac108fdcd admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:16.340372 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380bbce-e934-4219-963e-d8aac108fdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:16.340650 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380bbce-e934-4219-963e-d8aac108fdcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:16.341282 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380bbce-e934-4219-963e-d8aac108fdcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:16.343539 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0380bbce-e934-4219-963e-d8aac108fdcd admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:16.496158 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 888/1781] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:23:16 2022] POST /identity/v3/projects => generated 379 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:16.497827 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed4186-25f4-4714-8dcc-de5a0fee6c51 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:16.514542 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed4186-25f4-4714-8dcc-de5a0fee6c51 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:16.588432 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d81f8a-addf-4b11-b1bb-9b81a2626b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:16.593303 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d81f8a-addf-4b11-b1bb-9b81a2626b05 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:16.593303 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d81f8a-addf-4b11-b1bb-9b81a2626b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:16.593303 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d81f8a-addf-4b11-b1bb-9b81a2626b05 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:16.593303 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d81f8a-addf-4b11-b1bb-9b81a2626b05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:16.593303 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d81f8a-addf-4b11-b1bb-9b81a2626b05 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:16.612226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:16.699722 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 894/1782] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:23:16 2022] POST /identity/v3/users => generated 296 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:16.704495 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380bbce-e934-4219-963e-d8aac108fdcd admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:16.719656 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380bbce-e934-4219-963e-d8aac108fdcd admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:16.726790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4edf7-ff77-446d-9633-a9c7576bd6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:16.727418 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4edf7-ff77-446d-9633-a9c7576bd6e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:16.727722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4edf7-ff77-446d-9633-a9c7576bd6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:16.727993 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd4edf7-ff77-446d-9633-a9c7576bd6e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:16.728885 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd4edf7-ff77-446d-9633-a9c7576bd6e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:16.738796 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd4edf7-ff77-446d-9633-a9c7576bd6e1 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:16.753547 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 889/1783] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:23:16.755820 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d81f8a-addf-4b11-b1bb-9b81a2626b05 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:16.766275 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d81f8a-addf-4b11-b1bb-9b81a2626b05 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:16.772372 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1328f-83cf-4379-b937-b51c5a5fef38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:16.773176 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1328f-83cf-4379-b937-b51c5a5fef38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:16.773527 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1328f-83cf-4379-b937-b51c5a5fef38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:16.773849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1328f-83cf-4379-b937-b51c5a5fef38 admin admin] PATH_INFO: `/v3/projects/180f61777a7e4f6aa2c4dd19ae1e8a96/users/ccefb095b78e400fa4c38744c11e4652/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:16.792545 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1328f-83cf-4379-b937-b51c5a5fef38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=180f61777a7e4f6aa2c4dd19ae1e8a96, user_id=ccefb095b78e400fa4c38744c11e4652, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:16.795687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1328f-83cf-4379-b937-b51c5a5fef38 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:16.900834 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 895/1784] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:16 2022] PUT /identity/v3/projects/180f61777a7e4f6aa2c4dd19ae1e8a96/users/ccefb095b78e400fa4c38744c11e4652/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:23:16.905643 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4edf7-ff77-446d-9633-a9c7576bd6e1 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:16.922497 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd4edf7-ff77-446d-9633-a9c7576bd6e1 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:17.002769 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:17.025759 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc832f4f-24f9-4749-8744-59322acbbec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:17.026522 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc832f4f-24f9-4749-8744-59322acbbec0 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:17.027003 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc832f4f-24f9-4749-8744-59322acbbec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:17.027371 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc832f4f-24f9-4749-8744-59322acbbec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:17.028488 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc832f4f-24f9-4749-8744-59322acbbec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:17.030658 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc832f4f-24f9-4749-8744-59322acbbec0 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:17.047619 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 890/1785] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:17.048948 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1328f-83cf-4379-b937-b51c5a5fef38 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:17.063429 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1328f-83cf-4379-b937-b51c5a5fef38 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:17.070918 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6684cdc-a14f-4af8-a21d-20ae6c392b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:17.072167 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6684cdc-a14f-4af8-a21d-20ae6c392b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:17.072848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6684cdc-a14f-4af8-a21d-20ae6c392b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:17.073344 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6684cdc-a14f-4af8-a21d-20ae6c392b53 admin admin] PATH_INFO: `/v3/projects/180f61777a7e4f6aa2c4dd19ae1e8a96/users/ccefb095b78e400fa4c38744c11e4652/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:17.075867 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6684cdc-a14f-4af8-a21d-20ae6c392b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=180f61777a7e4f6aa2c4dd19ae1e8a96, user_id=ccefb095b78e400fa4c38744c11e4652, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:17.098868 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6684cdc-a14f-4af8-a21d-20ae6c392b53 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:17.140397 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 896/1786] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:17 2022] PUT /identity/v3/projects/180f61777a7e4f6aa2c4dd19ae1e8a96/users/ccefb095b78e400fa4c38744c11e4652/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:17.147736 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f128b3-c77f-4648-a5a8-ad7b23fa6c28 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:17.147925 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f128b3-c77f-4648-a5a8-ad7b23fa6c28 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:17.148247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f128b3-c77f-4648-a5a8-ad7b23fa6c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:17.183926 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c2f128b3-c77f-4648-a5a8-ad7b23fa6c28 None None] MFA Rules not processed for user `ccefb095b78e400fa4c38744c11e4652`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:17.185196 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c2f128b3-c77f-4648-a5a8-ad7b23fa6c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:17.257959 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 891/1787] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:17.274486 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6684cdc-a14f-4af8-a21d-20ae6c392b53 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:17.276710 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d6684cdc-a14f-4af8-a21d-20ae6c392b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:17.384973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6684cdc-a14f-4af8-a21d-20ae6c392b53 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:17.388921 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e5f399-49b3-411d-80a5-968b773e874b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:17.389571 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5f399-49b3-411d-80a5-968b773e874b service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:17.390043 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5f399-49b3-411d-80a5-968b773e874b service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:17.390321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e5f399-49b3-411d-80a5-968b773e874b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:17.407149 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5f399-49b3-411d-80a5-968b773e874b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:17.407149 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e5f399-49b3-411d-80a5-968b773e874b service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:17.427819 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 897/1788] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:17 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:23:17.715171 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:18.154255 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f128b3-c77f-4648-a5a8-ad7b23fa6c28 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:18.262782 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f128b3-c77f-4648-a5a8-ad7b23fa6c28 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:18.269660 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff54668-e044-478d-bbc7-4be4ba2d4a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:18.270326 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff54668-e044-478d-bbc7-4be4ba2d4a7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:18.270608 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff54668-e044-478d-bbc7-4be4ba2d4a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:18.270883 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff54668-e044-478d-bbc7-4be4ba2d4a7d admin admin] PATH_INFO: `/v3/users/c8ed416d764f415a9adecc226cd3639d` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:18.272269 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff54668-e044-478d-bbc7-4be4ba2d4a7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8ed416d764f415a9adecc226cd3639d)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:18.274189 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff54668-e044-478d-bbc7-4be4ba2d4a7d admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:18.393235 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf6fb9-00e4-43b6-b513-95d285548617 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:18.393769 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf6fb9-00e4-43b6-b513-95d285548617 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:18.393769 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcf6fb9-00e4-43b6-b513-95d285548617 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:18.395369 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 898/1789] 10.222.0.81 () {54 vars in 921 bytes} [Tue Sep 6 21:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:23:18.402904 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159937b3-e033-4f87-80de-0999e50a5430 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:18.409824 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159937b3-e033-4f87-80de-0999e50a5430 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:18.409824 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159937b3-e033-4f87-80de-0999e50a5430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:18.435087 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-159937b3-e033-4f87-80de-0999e50a5430 None None] MFA Rules not processed for user `4441d8fea57f401a96fb8cbd2b501059`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:18.435087 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-159937b3-e033-4f87-80de-0999e50a5430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:18.505531 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 899/1790] 10.222.0.81 () {58 vars in 1018 bytes} [Tue Sep 6 21:23:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:18.534196 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1ff54668-e044-478d-bbc7-4be4ba2d4a7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8ed416d764f415a9adecc226cd3639d'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:18.626146 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159937b3-e033-4f87-80de-0999e50a5430 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:18.627330 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-159937b3-e033-4f87-80de-0999e50a5430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:18.636720 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1ff54668-e044-478d-bbc7-4be4ba2d4a7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8ed416d764f415a9adecc226cd3639d'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:18.656175 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159937b3-e033-4f87-80de-0999e50a5430 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:18.661336 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1ff54668-e044-478d-bbc7-4be4ba2d4a7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8ed416d764f415a9adecc226cd3639d'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:18.664462 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1ff54668-e044-478d-bbc7-4be4ba2d4a7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8ed416d764f415a9adecc226cd3639d'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:18.664838 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528970a-3b71-41f0-9ea9-1f3b6a73f3f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:18.664838 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528970a-3b71-41f0-9ea9-1f3b6a73f3f7 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:18.665156 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528970a-3b71-41f0-9ea9-1f3b6a73f3f7 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:18.665386 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528970a-3b71-41f0-9ea9-1f3b6a73f3f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:18.667908 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4528970a-3b71-41f0-9ea9-1f3b6a73f3f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:18.684702 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528970a-3b71-41f0-9ea9-1f3b6a73f3f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:18.686824 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1ff54668-e044-478d-bbc7-4be4ba2d4a7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8ed416d764f415a9adecc226cd3639d'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:18.687508 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528970a-3b71-41f0-9ea9-1f3b6a73f3f7 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:18.699390 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 892/1791] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:23:18 2022] DELETE /identity/v3/users/c8ed416d764f415a9adecc226cd3639d => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:18.701801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c63e5-20a7-4f0f-a8b2-e32ea24c433a None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:18.701970 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 900/1792] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:23:18.702386 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c63e5-20a7-4f0f-a8b2-e32ea24c433a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:18.702761 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c63e5-20a7-4f0f-a8b2-e32ea24c433a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:18.727286 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c41c63e5-20a7-4f0f-a8b2-e32ea24c433a None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:18.728611 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c41c63e5-20a7-4f0f-a8b2-e32ea24c433a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:18.736460 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:18.804239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 893/1793] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:23:18.814598 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528970a-3b71-41f0-9ea9-1f3b6a73f3f7 service nova] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:18.816001 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4528970a-3b71-41f0-9ea9-1f3b6a73f3f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:18.828005 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:18.874613 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528970a-3b71-41f0-9ea9-1f3b6a73f3f7 service nova] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:18.927205 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477adbe0-d7e0-4bcb-b4d0-bf381284da65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:18.928185 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477adbe0-d7e0-4bcb-b4d0-bf381284da65 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:18.928431 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477adbe0-d7e0-4bcb-b4d0-bf381284da65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:18.928713 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477adbe0-d7e0-4bcb-b4d0-bf381284da65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:18.938793 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477adbe0-d7e0-4bcb-b4d0-bf381284da65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:18.940281 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477adbe0-d7e0-4bcb-b4d0-bf381284da65 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:18.949649 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 901/1794] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:23:19.525884 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:20.094764 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c63e5-20a7-4f0f-a8b2-e32ea24c433a None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:20.094764 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c41c63e5-20a7-4f0f-a8b2-e32ea24c433a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:20.107657 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c63e5-20a7-4f0f-a8b2-e32ea24c433a None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:20.113822 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec46dc3-b9fb-49db-8c62-d68d8c48178d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:20.114492 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec46dc3-b9fb-49db-8c62-d68d8c48178d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:20.114757 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec46dc3-b9fb-49db-8c62-d68d8c48178d admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:20.115206 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec46dc3-b9fb-49db-8c62-d68d8c48178d admin admin] PATH_INFO: `/v3/projects/70f9df1a2187423aa89537fde2e23921` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:20.117152 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec46dc3-b9fb-49db-8c62-d68d8c48178d admin admin] RBAC: Authorizing `identity:delete_project(project_id=70f9df1a2187423aa89537fde2e23921)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:20.120867 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec46dc3-b9fb-49db-8c62-d68d8c48178d admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:20.143003 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:20.290715 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0ec46dc3-b9fb-49db-8c62-d68d8c48178d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70f9df1a2187423aa89537fde2e23921', 'request_id': 'req-0ec46dc3-b9fb-49db-8c62-d68d8c48178d'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:20.415932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0ec46dc3-b9fb-49db-8c62-d68d8c48178d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70f9df1a2187423aa89537fde2e23921', 'request_id': 'req-0ec46dc3-b9fb-49db-8c62-d68d8c48178d'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:20.423859 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0ec46dc3-b9fb-49db-8c62-d68d8c48178d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70f9df1a2187423aa89537fde2e23921', 'request_id': 'req-0ec46dc3-b9fb-49db-8c62-d68d8c48178d'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:20.437252 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0ec46dc3-b9fb-49db-8c62-d68d8c48178d admin admin] The token cache is being invalidate because project 70f9df1a2187423aa89537fde2e23921 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:23:20.437676 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0ec46dc3-b9fb-49db-8c62-d68d8c48178d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:20.438509 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0ec46dc3-b9fb-49db-8c62-d68d8c48178d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:20.443697 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 894/1795] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:23:20 2022] DELETE /identity/v3/projects/70f9df1a2187423aa89537fde2e23921 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:20.444665 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477adbe0-d7e0-4bcb-b4d0-bf381284da65 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:20.464166 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477adbe0-d7e0-4bcb-b4d0-bf381284da65 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:20.521768 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3ffc3-7a24-4e6b-9806-ac48a7d4d1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:20.522418 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3ffc3-7a24-4e6b-9806-ac48a7d4d1fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:20.522756 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3ffc3-7a24-4e6b-9806-ac48a7d4d1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:20.522999 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3ffc3-7a24-4e6b-9806-ac48a7d4d1fa admin admin] PATH_INFO: `/v3/users/ccefb095b78e400fa4c38744c11e4652` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:20.524173 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3ffc3-7a24-4e6b-9806-ac48a7d4d1fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccefb095b78e400fa4c38744c11e4652)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:20.526100 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3ffc3-7a24-4e6b-9806-ac48a7d4d1fa admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:20.814569 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f2d3ffc3-7a24-4e6b-9806-ac48a7d4d1fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccefb095b78e400fa4c38744c11e4652'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:20.889983 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f2d3ffc3-7a24-4e6b-9806-ac48a7d4d1fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccefb095b78e400fa4c38744c11e4652'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:20.912028 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f2d3ffc3-7a24-4e6b-9806-ac48a7d4d1fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccefb095b78e400fa4c38744c11e4652'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:20.913101 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f2d3ffc3-7a24-4e6b-9806-ac48a7d4d1fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccefb095b78e400fa4c38744c11e4652'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:20.923376 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f2d3ffc3-7a24-4e6b-9806-ac48a7d4d1fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccefb095b78e400fa4c38744c11e4652'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:20.932875 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 902/1796] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:23:20 2022] DELETE /identity/v3/users/ccefb095b78e400fa4c38744c11e4652 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:23:21.574211 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec46dc3-b9fb-49db-8c62-d68d8c48178d admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:21.576222 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-0ec46dc3-b9fb-49db-8c62-d68d8c48178d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:21.598145 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec46dc3-b9fb-49db-8c62-d68d8c48178d admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:21.684770 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b0536-693b-4eaa-b23c-567df977a44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:21.692334 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b0536-693b-4eaa-b23c-567df977a44b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:21.693039 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b0536-693b-4eaa-b23c-567df977a44b admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:21.695813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b0536-693b-4eaa-b23c-567df977a44b admin admin] PATH_INFO: `/v3/projects/180f61777a7e4f6aa2c4dd19ae1e8a96` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:21.695813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b0536-693b-4eaa-b23c-567df977a44b admin admin] RBAC: Authorizing `identity:delete_project(project_id=180f61777a7e4f6aa2c4dd19ae1e8a96)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:21.697875 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b0536-693b-4eaa-b23c-567df977a44b admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:21.843968 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e22b0536-693b-4eaa-b23c-567df977a44b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '180f61777a7e4f6aa2c4dd19ae1e8a96', 'request_id': 'req-e22b0536-693b-4eaa-b23c-567df977a44b'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:21.938149 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e22b0536-693b-4eaa-b23c-567df977a44b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '180f61777a7e4f6aa2c4dd19ae1e8a96', 'request_id': 'req-e22b0536-693b-4eaa-b23c-567df977a44b'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:21.945289 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e22b0536-693b-4eaa-b23c-567df977a44b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '180f61777a7e4f6aa2c4dd19ae1e8a96', 'request_id': 'req-e22b0536-693b-4eaa-b23c-567df977a44b'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:21.974393 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e22b0536-693b-4eaa-b23c-567df977a44b admin admin] The token cache is being invalidate because project 180f61777a7e4f6aa2c4dd19ae1e8a96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:23:21.974869 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e22b0536-693b-4eaa-b23c-567df977a44b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:21.975526 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e22b0536-693b-4eaa-b23c-567df977a44b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:21.977055 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 895/1797] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:23:21 2022] DELETE /identity/v3/projects/180f61777a7e4f6aa2c4dd19ae1e8a96 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:21.982042 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4dc53-fd68-4b4f-b6ba-2dfa48937e7e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:21.982522 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4dc53-fd68-4b4f-b6ba-2dfa48937e7e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:21.982720 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4dc53-fd68-4b4f-b6ba-2dfa48937e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:22.006707 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-90f4dc53-fd68-4b4f-b6ba-2dfa48937e7e None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:22.007931 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-90f4dc53-fd68-4b4f-b6ba-2dfa48937e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:22.074992 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:22.138839 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 903/1798] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:23:22.150556 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99760d8b-7c5a-4ced-82b5-487f0487c107 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:22.150838 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99760d8b-7c5a-4ced-82b5-487f0487c107 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:22.151307 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99760d8b-7c5a-4ced-82b5-487f0487c107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:22.192249 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-99760d8b-7c5a-4ced-82b5-487f0487c107 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:22.195612 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-99760d8b-7c5a-4ced-82b5-487f0487c107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:22.220404 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 896/1799] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:22.224409 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4dc53-fd68-4b4f-b6ba-2dfa48937e7e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:22.239552 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4dc53-fd68-4b4f-b6ba-2dfa48937e7e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:22.268693 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de7547-b1cf-4d16-b9c8-e08bbf1d4e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:22.269400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de7547-b1cf-4d16-b9c8-e08bbf1d4e34 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:22.269718 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de7547-b1cf-4d16-b9c8-e08bbf1d4e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:22.270005 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de7547-b1cf-4d16-b9c8-e08bbf1d4e34 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:22.270657 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de7547-b1cf-4d16-b9c8-e08bbf1d4e34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:23:22.270946 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de7547-b1cf-4d16-b9c8-e08bbf1d4e34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:22.273336 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de7547-b1cf-4d16-b9c8-e08bbf1d4e34 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:22.301270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 904/1800] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:23:22.304839 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99760d8b-7c5a-4ced-82b5-487f0487c107 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:22.329919 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99760d8b-7c5a-4ced-82b5-487f0487c107 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:22.339399 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a2113-60ea-46c7-b060-45dff7ea1935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:22.341220 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a2113-60ea-46c7-b060-45dff7ea1935 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:22.341692 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a2113-60ea-46c7-b060-45dff7ea1935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:22.343517 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a2113-60ea-46c7-b060-45dff7ea1935 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:22.345784 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a2113-60ea-46c7-b060-45dff7ea1935 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:22.350909 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19a2113-60ea-46c7-b060-45dff7ea1935 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:22.510198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 897/1801] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:23:22 2022] POST /identity/v3/projects => generated 375 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:22.514362 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de7547-b1cf-4d16-b9c8-e08bbf1d4e34 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:22.526656 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de7547-b1cf-4d16-b9c8-e08bbf1d4e34 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:22.596985 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ae5b1-6f3c-41ee-8e89-f52c6d0bcb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:22.598488 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ae5b1-6f3c-41ee-8e89-f52c6d0bcb77 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:22.598954 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ae5b1-6f3c-41ee-8e89-f52c6d0bcb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:22.599406 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0ae5b1-6f3c-41ee-8e89-f52c6d0bcb77 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:22.600307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ae5b1-6f3c-41ee-8e89-f52c6d0bcb77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:22.602680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0ae5b1-6f3c-41ee-8e89-f52c6d0bcb77 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:22.696407 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 905/1802] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:23:22 2022] POST /identity/v3/users => generated 288 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:22.697648 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a2113-60ea-46c7-b060-45dff7ea1935 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:22.704784 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:22.709483 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19a2113-60ea-46c7-b060-45dff7ea1935 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:22.716832 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354fff19-3b79-4697-93b4-1cf8726d948f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:22.722701 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fff19-3b79-4697-93b4-1cf8726d948f admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:22.722701 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fff19-3b79-4697-93b4-1cf8726d948f admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:22.722701 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354fff19-3b79-4697-93b4-1cf8726d948f admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:22.722701 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354fff19-3b79-4697-93b4-1cf8726d948f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:22.722701 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354fff19-3b79-4697-93b4-1cf8726d948f admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:22.731918 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 898/1803] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:22.737250 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ae5b1-6f3c-41ee-8e89-f52c6d0bcb77 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:22.748295 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0ae5b1-6f3c-41ee-8e89-f52c6d0bcb77 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:22.753288 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34856dd5-73a2-4d12-a1b0-f73eb5b3407f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:22.753905 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34856dd5-73a2-4d12-a1b0-f73eb5b3407f admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:22.754264 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34856dd5-73a2-4d12-a1b0-f73eb5b3407f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:22.754472 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34856dd5-73a2-4d12-a1b0-f73eb5b3407f admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:22.755509 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34856dd5-73a2-4d12-a1b0-f73eb5b3407f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:22.756904 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34856dd5-73a2-4d12-a1b0-f73eb5b3407f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:22.771579 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 906/1804] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:22.772917 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354fff19-3b79-4697-93b4-1cf8726d948f admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:22.785764 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354fff19-3b79-4697-93b4-1cf8726d948f admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:22.792079 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e00219-c0be-4b00-9b83-258fce1745ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:22.793064 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e00219-c0be-4b00-9b83-258fce1745ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:22.793547 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e00219-c0be-4b00-9b83-258fce1745ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:22.793825 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e00219-c0be-4b00-9b83-258fce1745ba admin admin] PATH_INFO: `/v3/projects/e28248f02db3457093a92cdfa50f44a7/users/d84b014c2b8e4065a3ec0a0684eb003e/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:22.812465 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e00219-c0be-4b00-9b83-258fce1745ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=e28248f02db3457093a92cdfa50f44a7, user_id=d84b014c2b8e4065a3ec0a0684eb003e, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:22.815796 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e00219-c0be-4b00-9b83-258fce1745ba admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:22.905105 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 899/1805] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:22 2022] PUT /identity/v3/projects/e28248f02db3457093a92cdfa50f44a7/users/d84b014c2b8e4065a3ec0a0684eb003e/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:22.919950 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf292a-2a26-4a18-a0df-5f989cdae08b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:22.920329 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf292a-2a26-4a18-a0df-5f989cdae08b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:22.920663 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf292a-2a26-4a18-a0df-5f989cdae08b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:22.978532 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-dbbf292a-2a26-4a18-a0df-5f989cdae08b None None] MFA Rules not processed for user `d84b014c2b8e4065a3ec0a0684eb003e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:22.980607 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-dbbf292a-2a26-4a18-a0df-5f989cdae08b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:23.093591 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 907/1806] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:23.098293 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e00219-c0be-4b00-9b83-258fce1745ba admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:23.178317 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e00219-c0be-4b00-9b83-258fce1745ba admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:23.184998 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e5630-83fb-45fa-b979-a9fd387d44b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:23.186009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e5630-83fb-45fa-b979-a9fd387d44b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:23.186368 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e5630-83fb-45fa-b979-a9fd387d44b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:23.186712 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e5630-83fb-45fa-b979-a9fd387d44b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:23.187431 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e5630-83fb-45fa-b979-a9fd387d44b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:23.190301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e5630-83fb-45fa-b979-a9fd387d44b1 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:23.284323 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 900/1807] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:23:23 2022] POST /identity/v3/projects => generated 375 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:23.287385 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf292a-2a26-4a18-a0df-5f989cdae08b None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:23.303889 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf292a-2a26-4a18-a0df-5f989cdae08b None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:23.403241 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943b3dc-c024-4330-a11f-2644dc834ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:23.403896 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943b3dc-c024-4330-a11f-2644dc834ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:23.404214 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943b3dc-c024-4330-a11f-2644dc834ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:23.405123 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e943b3dc-c024-4330-a11f-2644dc834ad9 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:23.405805 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943b3dc-c024-4330-a11f-2644dc834ad9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:23.408770 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e943b3dc-c024-4330-a11f-2644dc834ad9 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:23.510992 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 908/1808] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:23:23 2022] POST /identity/v3/users => generated 288 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:23.512334 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e5630-83fb-45fa-b979-a9fd387d44b1 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:23.523238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e5630-83fb-45fa-b979-a9fd387d44b1 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:23.545205 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b797e0a-e313-4f03-aa1b-3eba1e2b66bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:23.545205 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b797e0a-e313-4f03-aa1b-3eba1e2b66bf admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:23.545205 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b797e0a-e313-4f03-aa1b-3eba1e2b66bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:23.545205 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b797e0a-e313-4f03-aa1b-3eba1e2b66bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:23.545511 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b797e0a-e313-4f03-aa1b-3eba1e2b66bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:23.546900 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b797e0a-e313-4f03-aa1b-3eba1e2b66bf admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:23.559472 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 901/1809] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:23.563566 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943b3dc-c024-4330-a11f-2644dc834ad9 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:23.578498 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e943b3dc-c024-4330-a11f-2644dc834ad9 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:23.584959 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d25cc-8e35-4b6c-a677-3d066b028ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:23.585684 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d25cc-8e35-4b6c-a677-3d066b028ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:23.586144 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d25cc-8e35-4b6c-a677-3d066b028ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:23.586430 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d25cc-8e35-4b6c-a677-3d066b028ba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:23.587321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d25cc-8e35-4b6c-a677-3d066b028ba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:23.589132 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d25cc-8e35-4b6c-a677-3d066b028ba7 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:23.603702 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 909/1810] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:23:23.605070 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b797e0a-e313-4f03-aa1b-3eba1e2b66bf admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:23.615826 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b797e0a-e313-4f03-aa1b-3eba1e2b66bf admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:23.620472 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696698c0-c8a0-4ca8-9101-a02f0b4a81f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:23.621136 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696698c0-c8a0-4ca8-9101-a02f0b4a81f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:23.621419 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696698c0-c8a0-4ca8-9101-a02f0b4a81f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:23.621699 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696698c0-c8a0-4ca8-9101-a02f0b4a81f3 admin admin] PATH_INFO: `/v3/projects/8e2e404ebc21421f87e2afbc18c58e03/users/9f4da114bc6e4524b9628ead6cdbd073/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:23.638773 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696698c0-c8a0-4ca8-9101-a02f0b4a81f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e2e404ebc21421f87e2afbc18c58e03, user_id=9f4da114bc6e4524b9628ead6cdbd073, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:23.641840 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696698c0-c8a0-4ca8-9101-a02f0b4a81f3 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:23.710087 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 902/1811] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:23 2022] PUT /identity/v3/projects/8e2e404ebc21421f87e2afbc18c58e03/users/9f4da114bc6e4524b9628ead6cdbd073/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:23.722567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dd1fe-29a7-466a-b58c-ea8bb640b614 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:23.722859 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dd1fe-29a7-466a-b58c-ea8bb640b614 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:23.723136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97dd1fe-29a7-466a-b58c-ea8bb640b614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:23.763171 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-e97dd1fe-29a7-466a-b58c-ea8bb640b614 None None] MFA Rules not processed for user `9f4da114bc6e4524b9628ead6cdbd073`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:23.777058 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e97dd1fe-29a7-466a-b58c-ea8bb640b614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:23.887490 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 910/1812] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:23.892882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696698c0-c8a0-4ca8-9101-a02f0b4a81f3 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:23.973289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:24.028083 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696698c0-c8a0-4ca8-9101-a02f0b4a81f3 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:24.033852 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c1feb-1c1e-4e18-b109-b6a98b1a2787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:24.035167 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c1feb-1c1e-4e18-b109-b6a98b1a2787 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:24.035644 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c1feb-1c1e-4e18-b109-b6a98b1a2787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:24.036154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c1feb-1c1e-4e18-b109-b6a98b1a2787 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:24.037239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c1feb-1c1e-4e18-b109-b6a98b1a2787 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:24.040067 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195c1feb-1c1e-4e18-b109-b6a98b1a2787 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:24.146309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 903/1813] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:23:23 2022] POST /identity/v3/projects => generated 377 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:24.150378 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97dd1fe-29a7-466a-b58c-ea8bb640b614 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:24.167110 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97dd1fe-29a7-466a-b58c-ea8bb640b614 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:24.257643 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46eebe-6404-4692-aa16-40262a1b4ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:24.258267 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46eebe-6404-4692-aa16-40262a1b4ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:24.258550 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46eebe-6404-4692-aa16-40262a1b4ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:24.258827 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff46eebe-6404-4692-aa16-40262a1b4ee3 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:24.259498 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46eebe-6404-4692-aa16-40262a1b4ee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:24.261520 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff46eebe-6404-4692-aa16-40262a1b4ee3 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:24.365121 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 911/1814] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:23:24 2022] POST /identity/v3/users => generated 295 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:24.366581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c1feb-1c1e-4e18-b109-b6a98b1a2787 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:24.375709 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:24.380463 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c1feb-1c1e-4e18-b109-b6a98b1a2787 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:24.389033 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec095f81-a11c-4546-893e-097f64ff8fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:24.389762 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec095f81-a11c-4546-893e-097f64ff8fbc admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:24.395188 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec095f81-a11c-4546-893e-097f64ff8fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:24.395188 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec095f81-a11c-4546-893e-097f64ff8fbc admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:24.395188 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec095f81-a11c-4546-893e-097f64ff8fbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:24.395188 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec095f81-a11c-4546-893e-097f64ff8fbc admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:24.411020 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 904/1815] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:23:24.422658 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46eebe-6404-4692-aa16-40262a1b4ee3 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:24.443961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff46eebe-6404-4692-aa16-40262a1b4ee3 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:24.448911 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098071c-1d7f-42b8-946f-113eb776dbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:24.449805 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098071c-1d7f-42b8-946f-113eb776dbee admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:24.450227 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098071c-1d7f-42b8-946f-113eb776dbee admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:24.450949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098071c-1d7f-42b8-946f-113eb776dbee admin admin] PATH_INFO: `/v3/projects/ea44df6f91a047d2bfb304d7b434c3d6/users/f3768620a9a34c1e9a0cbd6ebaa9a012/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:24.488742 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098071c-1d7f-42b8-946f-113eb776dbee admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea44df6f91a047d2bfb304d7b434c3d6, user_id=f3768620a9a34c1e9a0cbd6ebaa9a012, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:24.492229 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098071c-1d7f-42b8-946f-113eb776dbee admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:24.613593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 912/1816] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:24 2022] PUT /identity/v3/projects/ea44df6f91a047d2bfb304d7b434c3d6/users/f3768620a9a34c1e9a0cbd6ebaa9a012/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:24.617331 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec095f81-a11c-4546-893e-097f64ff8fbc admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:24.629979 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec095f81-a11c-4546-893e-097f64ff8fbc admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:24.633637 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc55046-dcc6-44cb-a27f-6cf757d57ac5 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:24.633921 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc55046-dcc6-44cb-a27f-6cf757d57ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:24.634192 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc55046-dcc6-44cb-a27f-6cf757d57ac5 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:24.635765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 913/1817] 10.222.0.81 () {54 vars in 921 bytes} [Tue Sep 6 21:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:23:24.652080 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf412b-8d85-4260-981a-6a9f0cd64472 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:24.652080 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf412b-8d85-4260-981a-6a9f0cd64472 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:24.652371 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bf412b-8d85-4260-981a-6a9f0cd64472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:24.710424 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f3bf412b-8d85-4260-981a-6a9f0cd64472 None None] MFA Rules not processed for user `4441d8fea57f401a96fb8cbd2b501059`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:24.710424 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f3bf412b-8d85-4260-981a-6a9f0cd64472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:24.795475 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b28fd-2087-4808-90fd-119a83cb019e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:24.797591 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b28fd-2087-4808-90fd-119a83cb019e admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:24.797591 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b28fd-2087-4808-90fd-119a83cb019e admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:24.797591 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7b28fd-2087-4808-90fd-119a83cb019e admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:24.798062 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b28fd-2087-4808-90fd-119a83cb019e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:24.799680 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7b28fd-2087-4808-90fd-119a83cb019e admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:24.822897 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 905/1818] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:24.836358 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b28fd-2087-4808-90fd-119a83cb019e admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:24.865738 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7b28fd-2087-4808-90fd-119a83cb019e admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:24.879530 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96263dfa-aed9-45b4-b29a-77925d4abf57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:24.880485 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96263dfa-aed9-45b4-b29a-77925d4abf57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:24.882925 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96263dfa-aed9-45b4-b29a-77925d4abf57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:24.883361 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96263dfa-aed9-45b4-b29a-77925d4abf57 admin admin] PATH_INFO: `/v3/projects/ea44df6f91a047d2bfb304d7b434c3d6/users/f3768620a9a34c1e9a0cbd6ebaa9a012/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:24.887586 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96263dfa-aed9-45b4-b29a-77925d4abf57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea44df6f91a047d2bfb304d7b434c3d6, user_id=f3768620a9a34c1e9a0cbd6ebaa9a012, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:24.892712 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96263dfa-aed9-45b4-b29a-77925d4abf57 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:24.894602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 914/1819] 10.222.0.81 () {58 vars in 1018 bytes} [Tue Sep 6 21:23:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:24.913120 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 906/1820] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:24 2022] PUT /identity/v3/projects/ea44df6f91a047d2bfb304d7b434c3d6/users/f3768620a9a34c1e9a0cbd6ebaa9a012/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:24.924602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2064a-11d8-47c6-a24b-151abef0d896 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:24.924965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2064a-11d8-47c6-a24b-151abef0d896 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:24.925249 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2064a-11d8-47c6-a24b-151abef0d896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:24.976359 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-4bf2064a-11d8-47c6-a24b-151abef0d896 None None] MFA Rules not processed for user `f3768620a9a34c1e9a0cbd6ebaa9a012`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:24.977667 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4bf2064a-11d8-47c6-a24b-151abef0d896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:25.064511 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 915/1821] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:25.077057 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96263dfa-aed9-45b4-b29a-77925d4abf57 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:25.079746 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-96263dfa-aed9-45b4-b29a-77925d4abf57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:25.156834 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2064a-11d8-47c6-a24b-151abef0d896 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:25.159733 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4bf2064a-11d8-47c6-a24b-151abef0d896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:25.167851 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96263dfa-aed9-45b4-b29a-77925d4abf57 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:25.172900 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d04a9-49ca-4b90-b3f9-e32b14a130cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:25.173720 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d04a9-49ca-4b90-b3f9-e32b14a130cb service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:25.174251 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d04a9-49ca-4b90-b3f9-e32b14a130cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:25.174677 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d04a9-49ca-4b90-b3f9-e32b14a130cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:25.274953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2064a-11d8-47c6-a24b-151abef0d896 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:25.278681 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d04a9-49ca-4b90-b3f9-e32b14a130cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:25.281612 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37365253-0ce7-4732-880d-67226be7865e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:25.282247 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37365253-0ce7-4732-880d-67226be7865e service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:25.282534 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37365253-0ce7-4732-880d-67226be7865e service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:25.282811 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37365253-0ce7-4732-880d-67226be7865e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:25.282909 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d04a9-49ca-4b90-b3f9-e32b14a130cb service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:25.295392 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37365253-0ce7-4732-880d-67226be7865e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:25.297869 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37365253-0ce7-4732-880d-67226be7865e service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:25.298946 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 907/1822] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:23:25.324494 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 916/1823] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:23:25.331562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:27.636829 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d04a9-49ca-4b90-b3f9-e32b14a130cb service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:27.639795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f03d04a9-49ca-4b90-b3f9-e32b14a130cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:27.653977 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d04a9-49ca-4b90-b3f9-e32b14a130cb service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:27.658962 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e0b8b-00ef-43ea-90c7-935e4a6888b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:27.659589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e0b8b-00ef-43ea-90c7-935e4a6888b7 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:27.659881 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e0b8b-00ef-43ea-90c7-935e4a6888b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:27.660210 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e0b8b-00ef-43ea-90c7-935e4a6888b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:27.713587 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:27.753283 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e0b8b-00ef-43ea-90c7-935e4a6888b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:27.755302 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e0b8b-00ef-43ea-90c7-935e4a6888b7 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:27.772146 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 908/1824] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:23:29.383577 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37365253-0ce7-4732-880d-67226be7865e service nova] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:29.394770 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37365253-0ce7-4732-880d-67226be7865e service nova] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:29.399565 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7fed51-5c96-4ea9-ab20-90dff47985ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:29.400414 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fed51-5c96-4ea9-ab20-90dff47985ed service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:29.400854 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fed51-5c96-4ea9-ab20-90dff47985ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:29.401323 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7fed51-5c96-4ea9-ab20-90dff47985ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:29.411936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:29.414354 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7fed51-5c96-4ea9-ab20-90dff47985ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:29.416225 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7fed51-5c96-4ea9-ab20-90dff47985ed service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:29.429994 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 917/1825] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:23:29.603980 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e0b8b-00ef-43ea-90c7-935e4a6888b7 service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:29.605767 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-837e0b8b-00ef-43ea-90c7-935e4a6888b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:29.687228 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e0b8b-00ef-43ea-90c7-935e4a6888b7 service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:29.693691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26eaabc-7151-41c6-bb7d-e0a5faf2b60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:29.694415 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26eaabc-7151-41c6-bb7d-e0a5faf2b60b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:29.694651 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26eaabc-7151-41c6-bb7d-e0a5faf2b60b admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:29.694931 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26eaabc-7151-41c6-bb7d-e0a5faf2b60b admin admin] PATH_INFO: `/v3/users/6684bc9d889842738b578345bcd260f9` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:29.696139 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26eaabc-7151-41c6-bb7d-e0a5faf2b60b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6684bc9d889842738b578345bcd260f9)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:29.698069 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26eaabc-7151-41c6-bb7d-e0a5faf2b60b admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:29.935179 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b26eaabc-7151-41c6-bb7d-e0a5faf2b60b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6684bc9d889842738b578345bcd260f9'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:29.987083 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b26eaabc-7151-41c6-bb7d-e0a5faf2b60b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6684bc9d889842738b578345bcd260f9'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:30.000510 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b26eaabc-7151-41c6-bb7d-e0a5faf2b60b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6684bc9d889842738b578345bcd260f9'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:30.001241 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b26eaabc-7151-41c6-bb7d-e0a5faf2b60b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6684bc9d889842738b578345bcd260f9'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:30.008158 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b26eaabc-7151-41c6-bb7d-e0a5faf2b60b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6684bc9d889842738b578345bcd260f9'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:30.018238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 909/1826] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:23:29 2022] DELETE /identity/v3/users/6684bc9d889842738b578345bcd260f9 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:30.020045 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a251b-8fc6-4a15-a8fe-60c40a019961 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:30.020352 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a251b-8fc6-4a15-a8fe-60c40a019961 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:30.020626 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a251b-8fc6-4a15-a8fe-60c40a019961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:30.039427 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-955a251b-8fc6-4a15-a8fe-60c40a019961 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:30.040655 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-955a251b-8fc6-4a15-a8fe-60c40a019961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:30.100390 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 918/1827] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:23:30.111321 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26eaabc-7151-41c6-bb7d-e0a5faf2b60b admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:30.112758 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b26eaabc-7151-41c6-bb7d-e0a5faf2b60b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:30.175627 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:30.175627 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26eaabc-7151-41c6-bb7d-e0a5faf2b60b admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:30.180554 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb787c5b-8070-4fe5-a77f-2ca38c32bab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:30.181521 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb787c5b-8070-4fe5-a77f-2ca38c32bab6 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:30.182164 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb787c5b-8070-4fe5-a77f-2ca38c32bab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:30.182338 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb787c5b-8070-4fe5-a77f-2ca38c32bab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:30.196296 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb787c5b-8070-4fe5-a77f-2ca38c32bab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:30.199032 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb787c5b-8070-4fe5-a77f-2ca38c32bab6 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:30.217510 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 910/1828] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:23:30.752730 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a251b-8fc6-4a15-a8fe-60c40a019961 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:30.757366 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-955a251b-8fc6-4a15-a8fe-60c40a019961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:30.772810 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a251b-8fc6-4a15-a8fe-60c40a019961 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:30.789386 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f2abb-9ca2-4734-ae45-98b1620a0ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:30.790069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f2abb-9ca2-4734-ae45-98b1620a0ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:30.790354 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f2abb-9ca2-4734-ae45-98b1620a0ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:30.790634 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f2abb-9ca2-4734-ae45-98b1620a0ba3 admin admin] PATH_INFO: `/v3/projects/72f1b0f194b54b349a8478a763cc5d76` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:30.797768 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f2abb-9ca2-4734-ae45-98b1620a0ba3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72f1b0f194b54b349a8478a763cc5d76)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:30.801529 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f2abb-9ca2-4734-ae45-98b1620a0ba3 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:30.947441 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9c0f2abb-9ca2-4734-ae45-98b1620a0ba3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72f1b0f194b54b349a8478a763cc5d76', 'request_id': 'req-9c0f2abb-9ca2-4734-ae45-98b1620a0ba3'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:30.967941 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9c0f2abb-9ca2-4734-ae45-98b1620a0ba3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72f1b0f194b54b349a8478a763cc5d76', 'request_id': 'req-9c0f2abb-9ca2-4734-ae45-98b1620a0ba3'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:30.983255 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9c0f2abb-9ca2-4734-ae45-98b1620a0ba3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72f1b0f194b54b349a8478a763cc5d76', 'request_id': 'req-9c0f2abb-9ca2-4734-ae45-98b1620a0ba3'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:31.067306 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9c0f2abb-9ca2-4734-ae45-98b1620a0ba3 admin admin] The token cache is being invalidate because project 72f1b0f194b54b349a8478a763cc5d76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:23:31.067601 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9c0f2abb-9ca2-4734-ae45-98b1620a0ba3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:31.068302 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9c0f2abb-9ca2-4734-ae45-98b1620a0ba3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:31.069926 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 919/1829] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:23:30 2022] DELETE /identity/v3/projects/72f1b0f194b54b349a8478a763cc5d76 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:31.073867 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb787c5b-8070-4fe5-a77f-2ca38c32bab6 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:31.085411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb787c5b-8070-4fe5-a77f-2ca38c32bab6 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:31.208740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54550797-92a8-422d-9ada-63c6050a667e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:31.209756 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54550797-92a8-422d-9ada-63c6050a667e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:31.210182 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54550797-92a8-422d-9ada-63c6050a667e admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:31.210608 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54550797-92a8-422d-9ada-63c6050a667e admin admin] PATH_INFO: `/v3/users/67dfbafd7b124bb98d23a087ab79bf97` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:31.211997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54550797-92a8-422d-9ada-63c6050a667e admin admin] RBAC: Authorizing `identity:delete_user(user_id=67dfbafd7b124bb98d23a087ab79bf97)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:31.216125 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54550797-92a8-422d-9ada-63c6050a667e admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:31.354431 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f2abb-9ca2-4734-ae45-98b1620a0ba3 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:31.356294 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9c0f2abb-9ca2-4734-ae45-98b1620a0ba3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:31.371864 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f2abb-9ca2-4734-ae45-98b1620a0ba3 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:31.380265 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917da417-92cc-4597-bfed-068370ab4c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:31.380928 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917da417-92cc-4597-bfed-068370ab4c1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:31.381211 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917da417-92cc-4597-bfed-068370ab4c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:31.381488 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917da417-92cc-4597-bfed-068370ab4c1f admin admin] PATH_INFO: `/v3/users/f5835f0d03e84cdc92bad4375ba01d91` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:31.382644 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917da417-92cc-4597-bfed-068370ab4c1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5835f0d03e84cdc92bad4375ba01d91)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:31.384642 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917da417-92cc-4597-bfed-068370ab4c1f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:31.447614 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-54550797-92a8-422d-9ada-63c6050a667e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67dfbafd7b124bb98d23a087ab79bf97'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:31.514606 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-54550797-92a8-422d-9ada-63c6050a667e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67dfbafd7b124bb98d23a087ab79bf97'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:31.535853 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-54550797-92a8-422d-9ada-63c6050a667e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67dfbafd7b124bb98d23a087ab79bf97'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:31.536761 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-54550797-92a8-422d-9ada-63c6050a667e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67dfbafd7b124bb98d23a087ab79bf97'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:31.561536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-54550797-92a8-422d-9ada-63c6050a667e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67dfbafd7b124bb98d23a087ab79bf97'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:31.568114 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 911/1830] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:23:31 2022] DELETE /identity/v3/users/67dfbafd7b124bb98d23a087ab79bf97 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:31.665947 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-917da417-92cc-4597-bfed-068370ab4c1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5835f0d03e84cdc92bad4375ba01d91'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:31.758703 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-917da417-92cc-4597-bfed-068370ab4c1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5835f0d03e84cdc92bad4375ba01d91'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:31.775076 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-917da417-92cc-4597-bfed-068370ab4c1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5835f0d03e84cdc92bad4375ba01d91'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:31.776907 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-917da417-92cc-4597-bfed-068370ab4c1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5835f0d03e84cdc92bad4375ba01d91'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:31.779624 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:31.785058 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-917da417-92cc-4597-bfed-068370ab4c1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5835f0d03e84cdc92bad4375ba01d91'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:31.791745 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 920/1831] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:23:31 2022] DELETE /identity/v3/users/f5835f0d03e84cdc92bad4375ba01d91 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:31.797121 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a678b3-d0ed-4507-953e-b8ccf7614ae1 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:31.797418 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a678b3-d0ed-4507-953e-b8ccf7614ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:31.797693 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a678b3-d0ed-4507-953e-b8ccf7614ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:31.825879 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-e4a678b3-d0ed-4507-953e-b8ccf7614ae1 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:31.827101 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e4a678b3-d0ed-4507-953e-b8ccf7614ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:31.889153 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 912/1832] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:31.899650 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917da417-92cc-4597-bfed-068370ab4c1f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:31.901087 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-917da417-92cc-4597-bfed-068370ab4c1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:31.959266 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917da417-92cc-4597-bfed-068370ab4c1f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:31.962862 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4791dc0-963f-4cc6-8f4f-423d6127ebd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:31.963470 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4791dc0-963f-4cc6-8f4f-423d6127ebd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:31.963761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4791dc0-963f-4cc6-8f4f-423d6127ebd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:31.964029 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4791dc0-963f-4cc6-8f4f-423d6127ebd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:31.973028 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4791dc0-963f-4cc6-8f4f-423d6127ebd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:31.974444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4791dc0-963f-4cc6-8f4f-423d6127ebd0 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:31.983933 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 921/1833] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:23:32.007054 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a678b3-d0ed-4507-953e-b8ccf7614ae1 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:32.008944 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e4a678b3-d0ed-4507-953e-b8ccf7614ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:32.021468 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a678b3-d0ed-4507-953e-b8ccf7614ae1 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:32.028151 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1e0ba-7b9d-4390-849e-69248cac5c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:32.028905 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1e0ba-7b9d-4390-849e-69248cac5c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:32.029185 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1e0ba-7b9d-4390-849e-69248cac5c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:32.029880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1e0ba-7b9d-4390-849e-69248cac5c43 admin admin] PATH_INFO: `/v3/projects/9f32c2bb28234f7a801978e7d5621ca2` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:32.030756 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1e0ba-7b9d-4390-849e-69248cac5c43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f32c2bb28234f7a801978e7d5621ca2)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:32.032901 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1e0ba-7b9d-4390-849e-69248cac5c43 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:32.040401 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:32.144515 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-42a1e0ba-7b9d-4390-849e-69248cac5c43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f32c2bb28234f7a801978e7d5621ca2', 'request_id': 'req-42a1e0ba-7b9d-4390-849e-69248cac5c43'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:32.287959 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-42a1e0ba-7b9d-4390-849e-69248cac5c43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f32c2bb28234f7a801978e7d5621ca2', 'request_id': 'req-42a1e0ba-7b9d-4390-849e-69248cac5c43'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:32.299668 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-42a1e0ba-7b9d-4390-849e-69248cac5c43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f32c2bb28234f7a801978e7d5621ca2', 'request_id': 'req-42a1e0ba-7b9d-4390-849e-69248cac5c43'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:32.314608 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-42a1e0ba-7b9d-4390-849e-69248cac5c43 admin admin] The token cache is being invalidate because project 9f32c2bb28234f7a801978e7d5621ca2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:23:32.314909 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-42a1e0ba-7b9d-4390-849e-69248cac5c43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:32.315652 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-42a1e0ba-7b9d-4390-849e-69248cac5c43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:32.317749 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 913/1834] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:23:32 2022] DELETE /identity/v3/projects/9f32c2bb28234f7a801978e7d5621ca2 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:32.327568 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30ba56-ad9f-4fd9-ac82-78f8adad6775 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:32.327890 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30ba56-ad9f-4fd9-ac82-78f8adad6775 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:32.328222 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30ba56-ad9f-4fd9-ac82-78f8adad6775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:32.348640 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-0b30ba56-ad9f-4fd9-ac82-78f8adad6775 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:32.349845 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0b30ba56-ad9f-4fd9-ac82-78f8adad6775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:32.425201 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 922/1835] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:32.432923 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72208d-6f7a-4446-a63d-e09584008520 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:32.433569 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72208d-6f7a-4446-a63d-e09584008520 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:32.433569 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce72208d-6f7a-4446-a63d-e09584008520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:32.457104 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-ce72208d-6f7a-4446-a63d-e09584008520 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:32.458479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ce72208d-6f7a-4446-a63d-e09584008520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:32.468484 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 914/1836] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:32.472460 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30ba56-ad9f-4fd9-ac82-78f8adad6775 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:32.483485 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30ba56-ad9f-4fd9-ac82-78f8adad6775 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:32.489471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16e028-818d-469c-8ff6-358822f7683b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:32.490116 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16e028-818d-469c-8ff6-358822f7683b admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:32.490402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16e028-818d-469c-8ff6-358822f7683b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:32.491727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b16e028-818d-469c-8ff6-358822f7683b admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:32.492254 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16e028-818d-469c-8ff6-358822f7683b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:23:32.492592 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16e028-818d-469c-8ff6-358822f7683b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:32.494463 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b16e028-818d-469c-8ff6-358822f7683b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:32.514402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 923/1837] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:23:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:23:32.523947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72208d-6f7a-4446-a63d-e09584008520 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:32.538543 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce72208d-6f7a-4446-a63d-e09584008520 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:32.547633 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16e028-818d-469c-8ff6-358822f7683b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:32.553740 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0b16e028-818d-469c-8ff6-358822f7683b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:32.581774 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f0780-eae5-4bba-a1e0-18a9dc591798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:32.582426 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f0780-eae5-4bba-a1e0-18a9dc591798 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:32.582706 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f0780-eae5-4bba-a1e0-18a9dc591798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:32.586819 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f0780-eae5-4bba-a1e0-18a9dc591798 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:32.589570 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b16e028-818d-469c-8ff6-358822f7683b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:32.603403 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f0780-eae5-4bba-a1e0-18a9dc591798 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:32.604808 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ede1c-ed08-43c4-9f09-98fc78640817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:32.605427 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f0780-eae5-4bba-a1e0-18a9dc591798 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:32.605877 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ede1c-ed08-43c4-9f09-98fc78640817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:32.606813 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ede1c-ed08-43c4-9f09-98fc78640817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:32.607294 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1ede1c-ed08-43c4-9f09-98fc78640817 admin admin] PATH_INFO: `/v3/projects/7f074237bbd947f686615e2d05c7a30d` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:32.610056 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ede1c-ed08-43c4-9f09-98fc78640817 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f074237bbd947f686615e2d05c7a30d)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:32.613048 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1ede1c-ed08-43c4-9f09-98fc78640817 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:32.751556 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ed1ede1c-ed08-43c4-9f09-98fc78640817 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f074237bbd947f686615e2d05c7a30d', 'request_id': 'req-ed1ede1c-ed08-43c4-9f09-98fc78640817'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:32.758786 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ed1ede1c-ed08-43c4-9f09-98fc78640817 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f074237bbd947f686615e2d05c7a30d', 'request_id': 'req-ed1ede1c-ed08-43c4-9f09-98fc78640817'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:32.768064 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ed1ede1c-ed08-43c4-9f09-98fc78640817 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f074237bbd947f686615e2d05c7a30d', 'request_id': 'req-ed1ede1c-ed08-43c4-9f09-98fc78640817'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:32.780134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 915/1838] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:23:32 2022] POST /identity/v3/projects => generated 387 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:32.782880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f0780-eae5-4bba-a1e0-18a9dc591798 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:32.874641 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f0780-eae5-4bba-a1e0-18a9dc591798 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:32.881539 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5dcb5-f294-4b5f-a3f7-a96509a270ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:32.882235 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5dcb5-f294-4b5f-a3f7-a96509a270ff admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:32.882999 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5dcb5-f294-4b5f-a3f7-a96509a270ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:32.883161 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c5dcb5-f294-4b5f-a3f7-a96509a270ff admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:32.884071 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5dcb5-f294-4b5f-a3f7-a96509a270ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:32.886565 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c5dcb5-f294-4b5f-a3f7-a96509a270ff admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:32.902046 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ed1ede1c-ed08-43c4-9f09-98fc78640817 admin admin] The token cache is being invalidate because project 7f074237bbd947f686615e2d05c7a30d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:23:32.902358 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ed1ede1c-ed08-43c4-9f09-98fc78640817 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:32.905093 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ed1ede1c-ed08-43c4-9f09-98fc78640817 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:32.912912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 924/1839] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:23:32 2022] DELETE /identity/v3/projects/7f074237bbd947f686615e2d05c7a30d => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:23:32.917293 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ede1c-ed08-43c4-9f09-98fc78640817 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:32.922931 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ed1ede1c-ed08-43c4-9f09-98fc78640817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:33.021058 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 916/1840] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:23:32 2022] POST /identity/v3/users => generated 294 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:23:33.025257 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5dcb5-f294-4b5f-a3f7-a96509a270ff admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:33.026950 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f2c5dcb5-f294-4b5f-a3f7-a96509a270ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:33.045372 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c5dcb5-f294-4b5f-a3f7-a96509a270ff admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:33.045541 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1ede1c-ed08-43c4-9f09-98fc78640817 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:33.051016 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5181a-0d9d-44cf-aed8-01aabbfa9833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:33.051645 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5181a-0d9d-44cf-aed8-01aabbfa9833 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:33.051930 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5181a-0d9d-44cf-aed8-01aabbfa9833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:33.052035 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4af2b4-242c-4bfb-b0dd-e2c61b4fcba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:33.052251 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5181a-0d9d-44cf-aed8-01aabbfa9833 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:33.052787 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4af2b4-242c-4bfb-b0dd-e2c61b4fcba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:33.052906 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5181a-0d9d-44cf-aed8-01aabbfa9833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:33.053073 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4af2b4-242c-4bfb-b0dd-e2c61b4fcba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:33.053343 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4af2b4-242c-4bfb-b0dd-e2c61b4fcba6 admin admin] PATH_INFO: `/v3/users/02ac1ac1698e453eafa11247bf0c35c3` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:33.054630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4af2b4-242c-4bfb-b0dd-e2c61b4fcba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02ac1ac1698e453eafa11247bf0c35c3)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:33.055444 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5181a-0d9d-44cf-aed8-01aabbfa9833 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:33.057715 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4af2b4-242c-4bfb-b0dd-e2c61b4fcba6 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:33.095896 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 917/1841] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:23:33.099797 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5181a-0d9d-44cf-aed8-01aabbfa9833 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:33.115476 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5181a-0d9d-44cf-aed8-01aabbfa9833 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:33.125972 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366531fe-1854-40bc-b5e1-c4fede5f58cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:33.126805 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366531fe-1854-40bc-b5e1-c4fede5f58cf admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:33.127287 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366531fe-1854-40bc-b5e1-c4fede5f58cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:33.130692 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366531fe-1854-40bc-b5e1-c4fede5f58cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:33.130692 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366531fe-1854-40bc-b5e1-c4fede5f58cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:33.130692 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366531fe-1854-40bc-b5e1-c4fede5f58cf admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:33.143065 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 918/1842] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:23:33.148705 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366531fe-1854-40bc-b5e1-c4fede5f58cf admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:33.159643 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366531fe-1854-40bc-b5e1-c4fede5f58cf admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:33.164757 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab84363-6461-4a6a-a50c-d551b091cc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:33.165429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab84363-6461-4a6a-a50c-d551b091cc38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:33.165711 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab84363-6461-4a6a-a50c-d551b091cc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:33.166070 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab84363-6461-4a6a-a50c-d551b091cc38 admin admin] PATH_INFO: `/v3/projects/e220d84cf84c4c65856bf3750ac1fb46/users/148eb8e735d642a0bccf4253686f9250/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:33.188703 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab84363-6461-4a6a-a50c-d551b091cc38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e220d84cf84c4c65856bf3750ac1fb46, user_id=148eb8e735d642a0bccf4253686f9250, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:33.191563 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab84363-6461-4a6a-a50c-d551b091cc38 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:33.279075 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 919/1843] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:33 2022] PUT /identity/v3/projects/e220d84cf84c4c65856bf3750ac1fb46/users/148eb8e735d642a0bccf4253686f9250/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:23:33.290498 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaac13b-7209-4fdf-9b54-43f36edb3126 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:33.290857 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaac13b-7209-4fdf-9b54-43f36edb3126 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:33.294933 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaac13b-7209-4fdf-9b54-43f36edb3126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:33.316346 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-1a4af2b4-242c-4bfb-b0dd-e2c61b4fcba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02ac1ac1698e453eafa11247bf0c35c3'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:33.352634 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-beaac13b-7209-4fdf-9b54-43f36edb3126 None None] MFA Rules not processed for user `148eb8e735d642a0bccf4253686f9250`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:33.353853 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-beaac13b-7209-4fdf-9b54-43f36edb3126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:33.420415 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-1a4af2b4-242c-4bfb-b0dd-e2c61b4fcba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02ac1ac1698e453eafa11247bf0c35c3'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:33.467976 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 920/1844] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:33 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:33.471292 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-1a4af2b4-242c-4bfb-b0dd-e2c61b4fcba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02ac1ac1698e453eafa11247bf0c35c3'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:33.473432 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-1a4af2b4-242c-4bfb-b0dd-e2c61b4fcba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02ac1ac1698e453eafa11247bf0c35c3'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:33.473512 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaac13b-7209-4fdf-9b54-43f36edb3126 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:33.485302 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-1a4af2b4-242c-4bfb-b0dd-e2c61b4fcba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02ac1ac1698e453eafa11247bf0c35c3'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:33.496322 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 925/1845] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:23:32 2022] DELETE /identity/v3/users/02ac1ac1698e453eafa11247bf0c35c3 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:33.552677 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaac13b-7209-4fdf-9b54-43f36edb3126 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:33.636291 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604fa7e-da1d-4aed-9f08-0c87f4a12bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:33.636959 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604fa7e-da1d-4aed-9f08-0c87f4a12bbb admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:33.637510 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604fa7e-da1d-4aed-9f08-0c87f4a12bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:33.637792 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9604fa7e-da1d-4aed-9f08-0c87f4a12bbb admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:33.638581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9604fa7e-da1d-4aed-9f08-0c87f4a12bbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:33.640858 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9604fa7e-da1d-4aed-9f08-0c87f4a12bbb admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:33.714822 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 921/1846] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:23:33 2022] POST /identity/v3/projects => generated 387 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:33.718840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4af2b4-242c-4bfb-b0dd-e2c61b4fcba6 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:33.720397 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1a4af2b4-242c-4bfb-b0dd-e2c61b4fcba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:33.736235 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4af2b4-242c-4bfb-b0dd-e2c61b4fcba6 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:33.824680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc374a-f781-489a-b9b2-97d4f7d1f87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:33.824680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc374a-f781-489a-b9b2-97d4f7d1f87c admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:33.824680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc374a-f781-489a-b9b2-97d4f7d1f87c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:33.824680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc374a-f781-489a-b9b2-97d4f7d1f87c admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:33.825444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc374a-f781-489a-b9b2-97d4f7d1f87c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:33.825444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc374a-f781-489a-b9b2-97d4f7d1f87c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:33.947186 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 926/1847] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:23:33 2022] POST /identity/v3/users => generated 294 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:33.948523 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604fa7e-da1d-4aed-9f08-0c87f4a12bbb admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:33.959840 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9604fa7e-da1d-4aed-9f08-0c87f4a12bbb admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:33.964992 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91f29a-9a81-48e2-9989-b87785715f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:33.969122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91f29a-9a81-48e2-9989-b87785715f15 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:33.969122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91f29a-9a81-48e2-9989-b87785715f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:33.969122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91f29a-9a81-48e2-9989-b87785715f15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:33.969122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91f29a-9a81-48e2-9989-b87785715f15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:33.969122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c91f29a-9a81-48e2-9989-b87785715f15 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:33.981446 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 922/1848] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:23:33.986384 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc374a-f781-489a-b9b2-97d4f7d1f87c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:33.998177 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc374a-f781-489a-b9b2-97d4f7d1f87c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:34.002348 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:34.005668 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ada44-0503-46e6-aa02-89004660cb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:34.006472 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ada44-0503-46e6-aa02-89004660cb28 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:34.007093 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ada44-0503-46e6-aa02-89004660cb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:34.007093 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ada44-0503-46e6-aa02-89004660cb28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:34.010242 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ada44-0503-46e6-aa02-89004660cb28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:34.010242 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51ada44-0503-46e6-aa02-89004660cb28 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:34.020727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 927/1849] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:34.024750 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91f29a-9a81-48e2-9989-b87785715f15 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:34.036516 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91f29a-9a81-48e2-9989-b87785715f15 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:34.045669 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a21673-6a27-41c9-bac4-a2dd4cb684d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:34.048609 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a21673-6a27-41c9-bac4-a2dd4cb684d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:34.049077 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a21673-6a27-41c9-bac4-a2dd4cb684d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:34.049546 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a21673-6a27-41c9-bac4-a2dd4cb684d8 admin admin] PATH_INFO: `/v3/projects/e47898912ea04705b579921fbf106279/users/7040513984e840ea8525f438eeaed6fd/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:34.068306 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a21673-6a27-41c9-bac4-a2dd4cb684d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e47898912ea04705b579921fbf106279, user_id=7040513984e840ea8525f438eeaed6fd, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:34.071678 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a21673-6a27-41c9-bac4-a2dd4cb684d8 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:34.171033 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 923/1850] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:34 2022] PUT /identity/v3/projects/e47898912ea04705b579921fbf106279/users/7040513984e840ea8525f438eeaed6fd/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:34.183149 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cd121-f57e-4b0e-a0ad-ae8c41fd3f2d None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:34.183442 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cd121-f57e-4b0e-a0ad-ae8c41fd3f2d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:34.183750 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74cd121-f57e-4b0e-a0ad-ae8c41fd3f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:34.217352 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-b74cd121-f57e-4b0e-a0ad-ae8c41fd3f2d None None] MFA Rules not processed for user `7040513984e840ea8525f438eeaed6fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:34.219135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b74cd121-f57e-4b0e-a0ad-ae8c41fd3f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:34.280172 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:34.293298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a21673-6a27-41c9-bac4-a2dd4cb684d8 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:34.296583 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-76a21673-6a27-41c9-bac4-a2dd4cb684d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:34.303541 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 928/1851] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:34 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:34.308881 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cd121-f57e-4b0e-a0ad-ae8c41fd3f2d None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:34.388061 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74cd121-f57e-4b0e-a0ad-ae8c41fd3f2d None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:34.407339 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66edc46c-e141-4f08-8f14-2e624d97c1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:34.408455 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edc46c-e141-4f08-8f14-2e624d97c1f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:34.408771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edc46c-e141-4f08-8f14-2e624d97c1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:34.409056 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66edc46c-e141-4f08-8f14-2e624d97c1f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:34.409884 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66edc46c-e141-4f08-8f14-2e624d97c1f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:34.411844 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66edc46c-e141-4f08-8f14-2e624d97c1f5 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:34.445539 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a21673-6a27-41c9-bac4-a2dd4cb684d8 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:34.449290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0863b6f-83cb-4a5e-803c-3ddb9f144b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:34.450230 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0863b6f-83cb-4a5e-803c-3ddb9f144b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:34.450574 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0863b6f-83cb-4a5e-803c-3ddb9f144b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:34.451641 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0863b6f-83cb-4a5e-803c-3ddb9f144b1d admin admin] PATH_INFO: `/v3/projects/821a0e017541443787d89638b99da3a7` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:34.452664 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0863b6f-83cb-4a5e-803c-3ddb9f144b1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=821a0e017541443787d89638b99da3a7)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:34.454757 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0863b6f-83cb-4a5e-803c-3ddb9f144b1d admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:34.506090 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 929/1852] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:23:34 2022] POST /identity/v3/projects => generated 387 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:34.507212 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66edc46c-e141-4f08-8f14-2e624d97c1f5 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:34.570524 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f0863b6f-83cb-4a5e-803c-3ddb9f144b1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '821a0e017541443787d89638b99da3a7', 'request_id': 'req-f0863b6f-83cb-4a5e-803c-3ddb9f144b1d'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:34.619012 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66edc46c-e141-4f08-8f14-2e624d97c1f5 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:34.678893 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f0863b6f-83cb-4a5e-803c-3ddb9f144b1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '821a0e017541443787d89638b99da3a7', 'request_id': 'req-f0863b6f-83cb-4a5e-803c-3ddb9f144b1d'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:34.687156 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f0863b6f-83cb-4a5e-803c-3ddb9f144b1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '821a0e017541443787d89638b99da3a7', 'request_id': 'req-f0863b6f-83cb-4a5e-803c-3ddb9f144b1d'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:34.699975 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f0863b6f-83cb-4a5e-803c-3ddb9f144b1d admin admin] The token cache is being invalidate because project 821a0e017541443787d89638b99da3a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:23:34.700398 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f0863b6f-83cb-4a5e-803c-3ddb9f144b1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:34.700970 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f0863b6f-83cb-4a5e-803c-3ddb9f144b1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:34.702117 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6951edb-2fed-4fc6-9bb3-29a84ce7055d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:34.702643 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 924/1853] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:23:34 2022] DELETE /identity/v3/projects/821a0e017541443787d89638b99da3a7 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:34.703677 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0863b6f-83cb-4a5e-803c-3ddb9f144b1d admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:34.704178 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6951edb-2fed-4fc6-9bb3-29a84ce7055d admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:34.704506 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6951edb-2fed-4fc6-9bb3-29a84ce7055d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:34.704782 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6951edb-2fed-4fc6-9bb3-29a84ce7055d admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:34.705516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6951edb-2fed-4fc6-9bb3-29a84ce7055d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:34.707426 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6951edb-2fed-4fc6-9bb3-29a84ce7055d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:34.709393 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f0863b6f-83cb-4a5e-803c-3ddb9f144b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:34.725786 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0863b6f-83cb-4a5e-803c-3ddb9f144b1d admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:34.730816 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81539f5b-7c7c-469c-ab7a-1daeb51a06a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:34.731408 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81539f5b-7c7c-469c-ab7a-1daeb51a06a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:34.731695 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81539f5b-7c7c-469c-ab7a-1daeb51a06a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:34.732000 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81539f5b-7c7c-469c-ab7a-1daeb51a06a7 admin admin] PATH_INFO: `/v3/users/d84b014c2b8e4065a3ec0a0684eb003e` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:34.733346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81539f5b-7c7c-469c-ab7a-1daeb51a06a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d84b014c2b8e4065a3ec0a0684eb003e)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:34.735887 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81539f5b-7c7c-469c-ab7a-1daeb51a06a7 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:34.802997 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 930/1854] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:23:34 2022] POST /identity/v3/users => generated 300 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:34.804828 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2e916-fd42-4c95-8ce3-0ed21b051adf None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:34.805274 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2e916-fd42-4c95-8ce3-0ed21b051adf None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:34.805558 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2e916-fd42-4c95-8ce3-0ed21b051adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:34.829966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-37d2e916-fd42-4c95-8ce3-0ed21b051adf None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:34.831411 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-37d2e916-fd42-4c95-8ce3-0ed21b051adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:34.841742 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 931/1855] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:34.842379 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2e916-fd42-4c95-8ce3-0ed21b051adf None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:34.844465 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-37d2e916-fd42-4c95-8ce3-0ed21b051adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:34.856999 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2e916-fd42-4c95-8ce3-0ed21b051adf None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:34.863621 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c6a885-635c-44f5-a05d-8e59d7c1a598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:34.864369 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6a885-635c-44f5-a05d-8e59d7c1a598 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:34.865200 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6a885-635c-44f5-a05d-8e59d7c1a598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:34.865481 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c6a885-635c-44f5-a05d-8e59d7c1a598 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:34.868752 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6a885-635c-44f5-a05d-8e59d7c1a598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:34.870420 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c6a885-635c-44f5-a05d-8e59d7c1a598 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:34.883136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 932/1856] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:34.884942 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad40993-758a-4ba8-9136-40a66f08d3dc None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:34.885442 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad40993-758a-4ba8-9136-40a66f08d3dc None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:34.885931 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad40993-758a-4ba8-9136-40a66f08d3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:34.908064 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-fad40993-758a-4ba8-9136-40a66f08d3dc None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:34.910013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fad40993-758a-4ba8-9136-40a66f08d3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:34.930755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-81539f5b-7c7c-469c-ab7a-1daeb51a06a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd84b014c2b8e4065a3ec0a0684eb003e'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:34.948404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 933/1857] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:34.948404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad40993-758a-4ba8-9136-40a66f08d3dc None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:34.960225 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad40993-758a-4ba8-9136-40a66f08d3dc None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:34.965003 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4f22b6-22a6-4fc5-9e61-d37e3738f89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:34.965745 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f22b6-22a6-4fc5-9e61-d37e3738f89a admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:34.966034 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f22b6-22a6-4fc5-9e61-d37e3738f89a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:34.966312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4f22b6-22a6-4fc5-9e61-d37e3738f89a admin admin] PATH_INFO: `/v3/projects/f41db46cca18421c9656a5263bcf2155/users/e9af745fee03460080113b1f397fd610/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:34.981732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f22b6-22a6-4fc5-9e61-d37e3738f89a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f41db46cca18421c9656a5263bcf2155, user_id=e9af745fee03460080113b1f397fd610, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:34.984382 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4f22b6-22a6-4fc5-9e61-d37e3738f89a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:35.026604 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-81539f5b-7c7c-469c-ab7a-1daeb51a06a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd84b014c2b8e4065a3ec0a0684eb003e'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:35.039648 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-81539f5b-7c7c-469c-ab7a-1daeb51a06a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd84b014c2b8e4065a3ec0a0684eb003e'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:35.040349 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-81539f5b-7c7c-469c-ab7a-1daeb51a06a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd84b014c2b8e4065a3ec0a0684eb003e'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:35.047669 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-81539f5b-7c7c-469c-ab7a-1daeb51a06a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd84b014c2b8e4065a3ec0a0684eb003e'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:35.053804 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 925/1858] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:23:34 2022] DELETE /identity/v3/users/d84b014c2b8e4065a3ec0a0684eb003e => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:35.056781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81539f5b-7c7c-469c-ab7a-1daeb51a06a7 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:35.058468 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-81539f5b-7c7c-469c-ab7a-1daeb51a06a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:35.098486 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 934/1859] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:34 2022] PUT /identity/v3/projects/f41db46cca18421c9656a5263bcf2155/users/e9af745fee03460080113b1f397fd610/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:35.099913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dec41e-51bd-4198-8219-32e345442648 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:35.100247 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dec41e-51bd-4198-8219-32e345442648 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:35.100527 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dec41e-51bd-4198-8219-32e345442648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:35.120443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a8dec41e-51bd-4198-8219-32e345442648 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:35.121824 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a8dec41e-51bd-4198-8219-32e345442648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:35.131102 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81539f5b-7c7c-469c-ab7a-1daeb51a06a7 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:35.197535 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0e164-50ab-4e91-a984-18780498fbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:35.198233 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0e164-50ab-4e91-a984-18780498fbf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:35.198547 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0e164-50ab-4e91-a984-18780498fbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:35.198913 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d0e164-50ab-4e91-a984-18780498fbf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:35.199642 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0e164-50ab-4e91-a984-18780498fbf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:23:35.200009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0e164-50ab-4e91-a984-18780498fbf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:35.202003 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d0e164-50ab-4e91-a984-18780498fbf1 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:35.216089 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 926/1860] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:23:35.217089 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0e164-50ab-4e91-a984-18780498fbf1 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:35.219328 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-61d0e164-50ab-4e91-a984-18780498fbf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:35.227801 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 935/1861] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:35.228711 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dec41e-51bd-4198-8219-32e345442648 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:35.245532 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d0e164-50ab-4e91-a984-18780498fbf1 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:35.249408 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dec41e-51bd-4198-8219-32e345442648 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:35.251565 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e776935-674d-4ff2-9fe7-19c9321444e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:35.252472 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e776935-674d-4ff2-9fe7-19c9321444e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:35.252757 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e776935-674d-4ff2-9fe7-19c9321444e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:35.253037 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e776935-674d-4ff2-9fe7-19c9321444e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:35.253717 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e776935-674d-4ff2-9fe7-19c9321444e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:35.257302 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e776935-674d-4ff2-9fe7-19c9321444e7 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:35.269403 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7948d-ab39-4b54-8d30-af92a6af1ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:35.269963 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7948d-ab39-4b54-8d30-af92a6af1ffe admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:35.270242 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7948d-ab39-4b54-8d30-af92a6af1ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:35.270512 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7948d-ab39-4b54-8d30-af92a6af1ffe admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:35.271863 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e7948d-ab39-4b54-8d30-af92a6af1ffe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:35.273794 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e7948d-ab39-4b54-8d30-af92a6af1ffe admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:35.274102 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 927/1862] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:35.274970 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e776935-674d-4ff2-9fe7-19c9321444e7 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:35.276922 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-2e776935-674d-4ff2-9fe7-19c9321444e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:35.348654 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:35.352402 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e776935-674d-4ff2-9fe7-19c9321444e7 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:35.357010 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532000a-c725-430e-a14c-e0a444152ada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:35.357227 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532000a-c725-430e-a14c-e0a444152ada service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:35.357572 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532000a-c725-430e-a14c-e0a444152ada service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:35.361254 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532000a-c725-430e-a14c-e0a444152ada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:35.368136 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532000a-c725-430e-a14c-e0a444152ada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:35.369870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7532000a-c725-430e-a14c-e0a444152ada service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:35.385152 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 928/1863] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:23:35.390001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532000a-c725-430e-a14c-e0a444152ada service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:35.399660 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 936/1864] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:23:35 2022] POST /identity/v3/projects => generated 365 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:35.405730 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7948d-ab39-4b54-8d30-af92a6af1ffe admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:35.412775 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532000a-c725-430e-a14c-e0a444152ada service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:35.515293 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc76ace-917b-48cf-9653-6d64ea1eeb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:35.516528 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc76ace-917b-48cf-9653-6d64ea1eeb1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:35.516812 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc76ace-917b-48cf-9653-6d64ea1eeb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:35.517091 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc76ace-917b-48cf-9653-6d64ea1eeb1c admin admin] PATH_INFO: `/v3/projects/f41db46cca18421c9656a5263bcf2155/users/e9af745fee03460080113b1f397fd610/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:35.519283 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc76ace-917b-48cf-9653-6d64ea1eeb1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f41db46cca18421c9656a5263bcf2155, user_id=e9af745fee03460080113b1f397fd610, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:35.520588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7948d-ab39-4b54-8d30-af92a6af1ffe admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:35.522011 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc76ace-917b-48cf-9653-6d64ea1eeb1c admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:35.529035 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271bf70-84fc-42ff-9b7a-951e14a4acda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:35.530312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271bf70-84fc-42ff-9b7a-951e14a4acda admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:35.530612 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271bf70-84fc-42ff-9b7a-951e14a4acda admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:35.530942 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271bf70-84fc-42ff-9b7a-951e14a4acda admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:35.532814 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0271bf70-84fc-42ff-9b7a-951e14a4acda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:35.535598 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0271bf70-84fc-42ff-9b7a-951e14a4acda admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:35.536329 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:35.536919 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 929/1865] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:35 2022] PUT /identity/v3/projects/f41db46cca18421c9656a5263bcf2155/users/e9af745fee03460080113b1f397fd610/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:35.548466 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef49fd-721c-4ba1-a138-b3dfa6deb773 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:35.548836 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef49fd-721c-4ba1-a138-b3dfa6deb773 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:35.549317 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef49fd-721c-4ba1-a138-b3dfa6deb773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:35.585753 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-b2ef49fd-721c-4ba1-a138-b3dfa6deb773 None None] MFA Rules not processed for user `e9af745fee03460080113b1f397fd610`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:35.587485 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b2ef49fd-721c-4ba1-a138-b3dfa6deb773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:35.639793 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 937/1866] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:23:35 2022] POST /identity/v3/users => generated 283 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:35.643947 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271bf70-84fc-42ff-9b7a-951e14a4acda admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:35.659592 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271bf70-84fc-42ff-9b7a-951e14a4acda admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:35.760804 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 930/1867] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:35 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:35.770478 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82873b1-88f3-4e43-b828-5287b631b20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:35.771820 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82873b1-88f3-4e43-b828-5287b631b20b admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:35.772469 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82873b1-88f3-4e43-b828-5287b631b20b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:35.772758 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82873b1-88f3-4e43-b828-5287b631b20b admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:35.775422 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82873b1-88f3-4e43-b828-5287b631b20b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:35.785252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82873b1-88f3-4e43-b828-5287b631b20b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:35.788699 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef49fd-721c-4ba1-a138-b3dfa6deb773 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:35.790166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b2ef49fd-721c-4ba1-a138-b3dfa6deb773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:35.813839 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 938/1868] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:35.820541 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82873b1-88f3-4e43-b828-5287b631b20b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:35.844897 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82873b1-88f3-4e43-b828-5287b631b20b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:35.856289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1827e3-3fc6-4cf8-b050-788bc73562d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:35.856977 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1827e3-3fc6-4cf8-b050-788bc73562d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:35.857261 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1827e3-3fc6-4cf8-b050-788bc73562d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:35.857536 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1827e3-3fc6-4cf8-b050-788bc73562d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:35.858187 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1827e3-3fc6-4cf8-b050-788bc73562d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:35.861265 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1827e3-3fc6-4cf8-b050-788bc73562d8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:35.873127 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef49fd-721c-4ba1-a138-b3dfa6deb773 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:35.877283 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7ab5a-8d2e-4266-9661-f3ac49312359 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:35.877958 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7ab5a-8d2e-4266-9661-f3ac49312359 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:35.878188 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7ab5a-8d2e-4266-9661-f3ac49312359 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:35.878468 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7ab5a-8d2e-4266-9661-f3ac49312359 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:35.889348 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7ab5a-8d2e-4266-9661-f3ac49312359 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:35.891371 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7ab5a-8d2e-4266-9661-f3ac49312359 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:35.904655 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 931/1869] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:35 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:23:35.912012 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 939/1870] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:35.920493 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7ab5a-8d2e-4266-9661-f3ac49312359 service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:35.948454 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7ab5a-8d2e-4266-9661-f3ac49312359 service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:35.962071 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128bc36-b8db-44e2-aa73-1d38506ddcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:35.962819 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128bc36-b8db-44e2-aa73-1d38506ddcc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:35.966016 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128bc36-b8db-44e2-aa73-1d38506ddcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:35.966016 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128bc36-b8db-44e2-aa73-1d38506ddcc3 admin admin] PATH_INFO: `/v3/projects/b19c0a7d394e4200b33e702f4ec439e8/users/5db0fb10d67f497f8c7b85476b186451/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:35.967637 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1827e3-3fc6-4cf8-b050-788bc73562d8 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:35.970251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7c1827e3-3fc6-4cf8-b050-788bc73562d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:35.988545 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:35.992268 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128bc36-b8db-44e2-aa73-1d38506ddcc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b19c0a7d394e4200b33e702f4ec439e8, user_id=5db0fb10d67f497f8c7b85476b186451, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:35.998539 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128bc36-b8db-44e2-aa73-1d38506ddcc3 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:36.006048 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1827e3-3fc6-4cf8-b050-788bc73562d8 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:36.019013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2d695-4c6f-49a3-8acc-707902eaa1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:36.019914 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2d695-4c6f-49a3-8acc-707902eaa1f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:36.020173 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2d695-4c6f-49a3-8acc-707902eaa1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:36.020455 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f2d695-4c6f-49a3-8acc-707902eaa1f0 admin admin] PATH_INFO: `/v3/projects/e28248f02db3457093a92cdfa50f44a7` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:36.021859 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f2d695-4c6f-49a3-8acc-707902eaa1f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e28248f02db3457093a92cdfa50f44a7)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:36.027434 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f2d695-4c6f-49a3-8acc-707902eaa1f0 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:36.112140 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 932/1871] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:35 2022] PUT /identity/v3/projects/b19c0a7d394e4200b33e702f4ec439e8/users/5db0fb10d67f497f8c7b85476b186451/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:36.114228 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752bbed-34e4-4b9a-8065-16d2ac85ada1 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:36.114510 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752bbed-34e4-4b9a-8065-16d2ac85ada1 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:36.114792 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752bbed-34e4-4b9a-8065-16d2ac85ada1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:36.153800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-4752bbed-34e4-4b9a-8065-16d2ac85ada1 None None] MFA Rules not processed for user `5db0fb10d67f497f8c7b85476b186451`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:36.155169 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4752bbed-34e4-4b9a-8065-16d2ac85ada1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:36.172392 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:36.186931 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-91f2d695-4c6f-49a3-8acc-707902eaa1f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e28248f02db3457093a92cdfa50f44a7', 'request_id': 'req-91f2d695-4c6f-49a3-8acc-707902eaa1f0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:36.193374 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-91f2d695-4c6f-49a3-8acc-707902eaa1f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e28248f02db3457093a92cdfa50f44a7', 'request_id': 'req-91f2d695-4c6f-49a3-8acc-707902eaa1f0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:36.201961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-91f2d695-4c6f-49a3-8acc-707902eaa1f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e28248f02db3457093a92cdfa50f44a7', 'request_id': 'req-91f2d695-4c6f-49a3-8acc-707902eaa1f0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:36.274554 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-91f2d695-4c6f-49a3-8acc-707902eaa1f0 admin admin] The token cache is being invalidate because project e28248f02db3457093a92cdfa50f44a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:23:36.274554 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-91f2d695-4c6f-49a3-8acc-707902eaa1f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:36.274554 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-91f2d695-4c6f-49a3-8acc-707902eaa1f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:36.274554 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 940/1872] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:23:35 2022] DELETE /identity/v3/projects/e28248f02db3457093a92cdfa50f44a7 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:23:36.276337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2d695-4c6f-49a3-8acc-707902eaa1f0 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:36.277934 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-91f2d695-4c6f-49a3-8acc-707902eaa1f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:36.361101 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 933/1873] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:36.364956 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752bbed-34e4-4b9a-8065-16d2ac85ada1 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:36.370679 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4752bbed-34e4-4b9a-8065-16d2ac85ada1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:36.492569 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f2d695-4c6f-49a3-8acc-707902eaa1f0 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:36.512722 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ecf9e8-baaf-432c-afb8-c66f07ec05f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:36.513960 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ecf9e8-baaf-432c-afb8-c66f07ec05f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:36.513960 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ecf9e8-baaf-432c-afb8-c66f07ec05f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:36.514136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ecf9e8-baaf-432c-afb8-c66f07ec05f6 admin admin] PATH_INFO: `/v3/users/9f4da114bc6e4524b9628ead6cdbd073` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:36.515555 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ecf9e8-baaf-432c-afb8-c66f07ec05f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f4da114bc6e4524b9628ead6cdbd073)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:36.517748 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ecf9e8-baaf-432c-afb8-c66f07ec05f6 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:36.555683 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752bbed-34e4-4b9a-8065-16d2ac85ada1 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:36.561764 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7dda0-7087-4836-8f1a-d682f0ffa5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:36.562995 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7dda0-7087-4836-8f1a-d682f0ffa5e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:36.563279 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7dda0-7087-4836-8f1a-d682f0ffa5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:36.563740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d7dda0-7087-4836-8f1a-d682f0ffa5e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:36.564426 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7dda0-7087-4836-8f1a-d682f0ffa5e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:36.567165 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d7dda0-7087-4836-8f1a-d682f0ffa5e8 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:36.732504 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 934/1874] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:23:36 2022] POST /identity/v3/projects => generated 365 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:36.893567 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7dda0-7087-4836-8f1a-d682f0ffa5e8 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:36.951118 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-14ecf9e8-baaf-432c-afb8-c66f07ec05f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f4da114bc6e4524b9628ead6cdbd073'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:37.004944 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d7dda0-7087-4836-8f1a-d682f0ffa5e8 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:37.010615 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff6cc5-702a-43f9-8ad6-76c89e3a6c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:37.011249 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff6cc5-702a-43f9-8ad6-76c89e3a6c35 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:37.011534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff6cc5-702a-43f9-8ad6-76c89e3a6c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:37.011816 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff6cc5-702a-43f9-8ad6-76c89e3a6c35 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:37.012512 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff6cc5-702a-43f9-8ad6-76c89e3a6c35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:37.014884 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff6cc5-702a-43f9-8ad6-76c89e3a6c35 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:37.488819 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-14ecf9e8-baaf-432c-afb8-c66f07ec05f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f4da114bc6e4524b9628ead6cdbd073'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:37.509372 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-14ecf9e8-baaf-432c-afb8-c66f07ec05f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f4da114bc6e4524b9628ead6cdbd073'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:37.510203 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-14ecf9e8-baaf-432c-afb8-c66f07ec05f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f4da114bc6e4524b9628ead6cdbd073'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:37.521074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-14ecf9e8-baaf-432c-afb8-c66f07ec05f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f4da114bc6e4524b9628ead6cdbd073'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:37.537468 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 935/1875] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:23:36 2022] POST /identity/v3/users => generated 289 bytes in 649 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:23:37.541523 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff6cc5-702a-43f9-8ad6-76c89e3a6c35 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:37.545259 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b3ff6cc5-702a-43f9-8ad6-76c89e3a6c35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:37.558118 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 941/1876] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:23:36 2022] DELETE /identity/v3/users/9f4da114bc6e4524b9628ead6cdbd073 => generated 0 bytes in 1278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:37.568690 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff6cc5-702a-43f9-8ad6-76c89e3a6c35 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:37.649714 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed5982-a941-4603-9cba-223df7df4691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:37.650402 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed5982-a941-4603-9cba-223df7df4691 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:37.650827 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed5982-a941-4603-9cba-223df7df4691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:37.651766 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed5982-a941-4603-9cba-223df7df4691 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:37.652493 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed5982-a941-4603-9cba-223df7df4691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:37.654502 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed5982-a941-4603-9cba-223df7df4691 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:37.666866 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 936/1877] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:37.672615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ecf9e8-baaf-432c-afb8-c66f07ec05f6 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:37.687692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ecf9e8-baaf-432c-afb8-c66f07ec05f6 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:37.691399 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d5d38-59f3-4985-b4e1-2e05b2bb69c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:37.692210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d5d38-59f3-4985-b4e1-2e05b2bb69c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:37.692561 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d5d38-59f3-4985-b4e1-2e05b2bb69c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:37.692922 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d5d38-59f3-4985-b4e1-2e05b2bb69c1 admin admin] PATH_INFO: `/v3/projects/c38f8305c567432fb5e6d4aa3e2569c7/users/ce4260cb568143d2a429f6720adb2781/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:37.710287 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d5d38-59f3-4985-b4e1-2e05b2bb69c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c38f8305c567432fb5e6d4aa3e2569c7, user_id=ce4260cb568143d2a429f6720adb2781, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:37.714005 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d5d38-59f3-4985-b4e1-2e05b2bb69c1 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:37.821182 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 942/1878] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:37 2022] PUT /identity/v3/projects/c38f8305c567432fb5e6d4aa3e2569c7/users/ce4260cb568143d2a429f6720adb2781/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:37.825428 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed5982-a941-4603-9cba-223df7df4691 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:37.837085 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed5982-a941-4603-9cba-223df7df4691 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:37.878327 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:37.937151 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cedcd8-82b5-43f8-a724-83943f46c1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:37.938169 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cedcd8-82b5-43f8-a724-83943f46c1ed admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:37.938666 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cedcd8-82b5-43f8-a724-83943f46c1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:37.940022 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cedcd8-82b5-43f8-a724-83943f46c1ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:37.940975 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cedcd8-82b5-43f8-a724-83943f46c1ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:37.944624 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cedcd8-82b5-43f8-a724-83943f46c1ed admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:37.961263 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 937/1879] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:37.962712 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d5d38-59f3-4985-b4e1-2e05b2bb69c1 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:37.976805 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d5d38-59f3-4985-b4e1-2e05b2bb69c1 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:37.983977 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56641c8a-0244-4110-a2b7-becd138ce3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:37.986931 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56641c8a-0244-4110-a2b7-becd138ce3bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:37.986931 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56641c8a-0244-4110-a2b7-becd138ce3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:37.986931 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56641c8a-0244-4110-a2b7-becd138ce3bc admin admin] PATH_INFO: `/v3/projects/c38f8305c567432fb5e6d4aa3e2569c7/users/ce4260cb568143d2a429f6720adb2781/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:38.019511 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56641c8a-0244-4110-a2b7-becd138ce3bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c38f8305c567432fb5e6d4aa3e2569c7, user_id=ce4260cb568143d2a429f6720adb2781, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:38.022678 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56641c8a-0244-4110-a2b7-becd138ce3bc admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:38.052188 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 943/1880] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:37 2022] PUT /identity/v3/projects/c38f8305c567432fb5e6d4aa3e2569c7/users/ce4260cb568143d2a429f6720adb2781/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:38.054192 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2e3c8-4352-499a-b85d-85d1e64097ba None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:38.054674 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2e3c8-4352-499a-b85d-85d1e64097ba None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:38.054803 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2e3c8-4352-499a-b85d-85d1e64097ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:38.103920 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-69d2e3c8-4352-499a-b85d-85d1e64097ba None None] MFA Rules not processed for user `ce4260cb568143d2a429f6720adb2781`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:38.105538 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-69d2e3c8-4352-499a-b85d-85d1e64097ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:38.166954 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:38.208612 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 938/1881] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:38 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:38.331913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56641c8a-0244-4110-a2b7-becd138ce3bc admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:38.334489 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-56641c8a-0244-4110-a2b7-becd138ce3bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:38.418223 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56641c8a-0244-4110-a2b7-becd138ce3bc admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:38.423045 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b0c71-1a9b-490b-830d-d24ac15ce435 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:38.424016 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b0c71-1a9b-490b-830d-d24ac15ce435 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:38.424335 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b0c71-1a9b-490b-830d-d24ac15ce435 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:38.424610 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b0c71-1a9b-490b-830d-d24ac15ce435 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:38.435332 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b0c71-1a9b-490b-830d-d24ac15ce435 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:38.436952 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b0c71-1a9b-490b-830d-d24ac15ce435 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:38.450101 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 944/1882] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:38 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:23:38.452132 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2e3c8-4352-499a-b85d-85d1e64097ba None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:38.454697 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-69d2e3c8-4352-499a-b85d-85d1e64097ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:38.559591 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d2e3c8-4352-499a-b85d-85d1e64097ba None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:38.565346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bdaaa-cdc7-4165-87ad-8a5dd98aedb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:38.566000 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bdaaa-cdc7-4165-87ad-8a5dd98aedb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:38.566404 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bdaaa-cdc7-4165-87ad-8a5dd98aedb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:38.566678 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bdaaa-cdc7-4165-87ad-8a5dd98aedb6 admin admin] PATH_INFO: `/v3/projects/8e2e404ebc21421f87e2afbc18c58e03` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:38.568080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3bdaaa-cdc7-4165-87ad-8a5dd98aedb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e2e404ebc21421f87e2afbc18c58e03)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:38.570083 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3bdaaa-cdc7-4165-87ad-8a5dd98aedb6 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:38.580993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b0c71-1a9b-490b-830d-d24ac15ce435 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:38.582680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fe9b0c71-1a9b-490b-830d-d24ac15ce435 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:38.595403 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b0c71-1a9b-490b-830d-d24ac15ce435 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:38.599863 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701e206-f959-47c4-838c-551f1ab57429 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:38.601197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701e206-f959-47c4-838c-551f1ab57429 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:38.601197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701e206-f959-47c4-838c-551f1ab57429 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:38.601388 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701e206-f959-47c4-838c-551f1ab57429 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:38.603408 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7701e206-f959-47c4-838c-551f1ab57429 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:38.673946 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701e206-f959-47c4-838c-551f1ab57429 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:38.675473 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701e206-f959-47c4-838c-551f1ab57429 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:38.681361 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-fd3bdaaa-cdc7-4165-87ad-8a5dd98aedb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e2e404ebc21421f87e2afbc18c58e03', 'request_id': 'req-fd3bdaaa-cdc7-4165-87ad-8a5dd98aedb6'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:38.695918 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 945/1883] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:38 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:23:38.714834 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701e206-f959-47c4-838c-551f1ab57429 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:38.723550 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701e206-f959-47c4-838c-551f1ab57429 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:38.746823 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-fd3bdaaa-cdc7-4165-87ad-8a5dd98aedb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e2e404ebc21421f87e2afbc18c58e03', 'request_id': 'req-fd3bdaaa-cdc7-4165-87ad-8a5dd98aedb6'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:38.755790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-fd3bdaaa-cdc7-4165-87ad-8a5dd98aedb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e2e404ebc21421f87e2afbc18c58e03', 'request_id': 'req-fd3bdaaa-cdc7-4165-87ad-8a5dd98aedb6'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:38.770879 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:38.775074 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-fd3bdaaa-cdc7-4165-87ad-8a5dd98aedb6 admin admin] The token cache is being invalidate because project 8e2e404ebc21421f87e2afbc18c58e03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:23:38.775074 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-fd3bdaaa-cdc7-4165-87ad-8a5dd98aedb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:38.779674 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-fd3bdaaa-cdc7-4165-87ad-8a5dd98aedb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:38.782952 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 939/1884] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:23:38 2022] DELETE /identity/v3/projects/8e2e404ebc21421f87e2afbc18c58e03 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:38.786974 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bdaaa-cdc7-4165-87ad-8a5dd98aedb6 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:38.791262 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-fd3bdaaa-cdc7-4165-87ad-8a5dd98aedb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:38.796011 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db09d8c-c80c-404d-89a9-c5baff478d3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:38.798699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db09d8c-c80c-404d-89a9-c5baff478d3a service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:38.798699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db09d8c-c80c-404d-89a9-c5baff478d3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:38.798699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db09d8c-c80c-404d-89a9-c5baff478d3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:38.800063 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5db09d8c-c80c-404d-89a9-c5baff478d3a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:38.882269 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db09d8c-c80c-404d-89a9-c5baff478d3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:38.883553 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bdaaa-cdc7-4165-87ad-8a5dd98aedb6 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:38.883735 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db09d8c-c80c-404d-89a9-c5baff478d3a service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:38.888796 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646fcc7-de86-444b-bf58-718d370d2b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:38.889447 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646fcc7-de86-444b-bf58-718d370d2b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:38.889732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646fcc7-de86-444b-bf58-718d370d2b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:38.890008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646fcc7-de86-444b-bf58-718d370d2b35 admin admin] PATH_INFO: `/v3/users/f3768620a9a34c1e9a0cbd6ebaa9a012` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:38.891218 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646fcc7-de86-444b-bf58-718d370d2b35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3768620a9a34c1e9a0cbd6ebaa9a012)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:38.893219 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646fcc7-de86-444b-bf58-718d370d2b35 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:38.895385 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 946/1885] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:23:38.924408 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:39.083258 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-4646fcc7-de86-444b-bf58-718d370d2b35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3768620a9a34c1e9a0cbd6ebaa9a012'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:39.164673 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-4646fcc7-de86-444b-bf58-718d370d2b35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3768620a9a34c1e9a0cbd6ebaa9a012'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:39.199957 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-4646fcc7-de86-444b-bf58-718d370d2b35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3768620a9a34c1e9a0cbd6ebaa9a012'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:39.200733 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-4646fcc7-de86-444b-bf58-718d370d2b35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3768620a9a34c1e9a0cbd6ebaa9a012'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:39.212732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-4646fcc7-de86-444b-bf58-718d370d2b35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3768620a9a34c1e9a0cbd6ebaa9a012'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:39.228346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 940/1886] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:23:38 2022] DELETE /identity/v3/users/f3768620a9a34c1e9a0cbd6ebaa9a012 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:39.774267 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db09d8c-c80c-404d-89a9-c5baff478d3a service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:39.786678 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db09d8c-c80c-404d-89a9-c5baff478d3a service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:39.880405 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf991e-cfae-4ef1-b8dc-8dd038c40193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:39.881221 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf991e-cfae-4ef1-b8dc-8dd038c40193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:39.881542 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf991e-cfae-4ef1-b8dc-8dd038c40193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:39.882062 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf991e-cfae-4ef1-b8dc-8dd038c40193 admin admin] PATH_INFO: `/v3/projects/ea44df6f91a047d2bfb304d7b434c3d6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:39.883324 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf991e-cfae-4ef1-b8dc-8dd038c40193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea44df6f91a047d2bfb304d7b434c3d6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:39.885481 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf991e-cfae-4ef1-b8dc-8dd038c40193 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:39.998759 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-7adf991e-cfae-4ef1-b8dc-8dd038c40193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea44df6f91a047d2bfb304d7b434c3d6', 'request_id': 'req-7adf991e-cfae-4ef1-b8dc-8dd038c40193'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:40.004328 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-7adf991e-cfae-4ef1-b8dc-8dd038c40193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea44df6f91a047d2bfb304d7b434c3d6', 'request_id': 'req-7adf991e-cfae-4ef1-b8dc-8dd038c40193'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:40.011704 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-7adf991e-cfae-4ef1-b8dc-8dd038c40193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea44df6f91a047d2bfb304d7b434c3d6', 'request_id': 'req-7adf991e-cfae-4ef1-b8dc-8dd038c40193'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:40.096148 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:40.101145 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-7adf991e-cfae-4ef1-b8dc-8dd038c40193 admin admin] The token cache is being invalidate because project ea44df6f91a047d2bfb304d7b434c3d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:23:40.101435 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-7adf991e-cfae-4ef1-b8dc-8dd038c40193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:40.102059 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-7adf991e-cfae-4ef1-b8dc-8dd038c40193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:40.103533 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 947/1887] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:23:39 2022] DELETE /identity/v3/projects/ea44df6f91a047d2bfb304d7b434c3d6 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:40.108469 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c459a8-4c83-4fc9-9fe2-c9bc6921bc75 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:40.108754 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c459a8-4c83-4fc9-9fe2-c9bc6921bc75 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:40.109589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c459a8-4c83-4fc9-9fe2-c9bc6921bc75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:40.128883 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-90c459a8-4c83-4fc9-9fe2-c9bc6921bc75 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:40.130082 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-90c459a8-4c83-4fc9-9fe2-c9bc6921bc75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:40.189702 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 941/1888] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:40.198568 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb562f-51a4-427c-b961-c72470867561 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:40.198855 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb562f-51a4-427c-b961-c72470867561 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:40.199156 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb562f-51a4-427c-b961-c72470867561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:40.219847 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-6cdb562f-51a4-427c-b961-c72470867561 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:40.221140 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6cdb562f-51a4-427c-b961-c72470867561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:40.229861 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 948/1889] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:40.234023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c459a8-4c83-4fc9-9fe2-c9bc6921bc75 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:40.243612 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c459a8-4c83-4fc9-9fe2-c9bc6921bc75 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:40.255496 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6219771-087e-46f3-a8e8-0b1ae5d2e39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:40.257412 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6219771-087e-46f3-a8e8-0b1ae5d2e39f admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:40.257412 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6219771-087e-46f3-a8e8-0b1ae5d2e39f admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:40.257412 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6219771-087e-46f3-a8e8-0b1ae5d2e39f admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:40.259865 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6219771-087e-46f3-a8e8-0b1ae5d2e39f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:23:40.260496 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6219771-087e-46f3-a8e8-0b1ae5d2e39f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:40.262264 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6219771-087e-46f3-a8e8-0b1ae5d2e39f admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:40.280376 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 942/1890] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:23:40.291581 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb562f-51a4-427c-b961-c72470867561 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:40.303710 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb562f-51a4-427c-b961-c72470867561 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:40.310606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508d2ab-f3e8-4cde-81d0-2d551308704f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:40.316664 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508d2ab-f3e8-4cde-81d0-2d551308704f admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:40.316664 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508d2ab-f3e8-4cde-81d0-2d551308704f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:40.316664 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1508d2ab-f3e8-4cde-81d0-2d551308704f admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:40.317942 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508d2ab-f3e8-4cde-81d0-2d551308704f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:40.320133 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1508d2ab-f3e8-4cde-81d0-2d551308704f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:40.431327 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6219771-087e-46f3-a8e8-0b1ae5d2e39f admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:40.433187 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c6219771-087e-46f3-a8e8-0b1ae5d2e39f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:40.447462 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 949/1891] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:23:40 2022] POST /identity/v3/projects => generated 367 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:40.451147 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508d2ab-f3e8-4cde-81d0-2d551308704f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:40.517665 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6219771-087e-46f3-a8e8-0b1ae5d2e39f admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:40.541306 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1508d2ab-f3e8-4cde-81d0-2d551308704f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:40.550942 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477c28d-7a72-499d-926e-55368cf742c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:40.550942 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477c28d-7a72-499d-926e-55368cf742c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:40.551125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477c28d-7a72-499d-926e-55368cf742c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:40.551539 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477c28d-7a72-499d-926e-55368cf742c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:40.552315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477c28d-7a72-499d-926e-55368cf742c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:40.556743 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477c28d-7a72-499d-926e-55368cf742c6 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:40.612945 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a9997-d45d-4835-8608-d9d2810b278c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:40.613570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a9997-d45d-4835-8608-d9d2810b278c service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:40.613848 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a9997-d45d-4835-8608-d9d2810b278c service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:40.614144 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a9997-d45d-4835-8608-d9d2810b278c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:40.616846 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-fa2a9997-d45d-4835-8608-d9d2810b278c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:40.679345 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 950/1892] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:23:40 2022] POST /identity/v3/users => generated 284 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:23:40.683307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477c28d-7a72-499d-926e-55368cf742c6 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:40.688795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a9997-d45d-4835-8608-d9d2810b278c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:40.690244 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a9997-d45d-4835-8608-d9d2810b278c service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:40.693975 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477c28d-7a72-499d-926e-55368cf742c6 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:40.702135 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 943/1893] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:23:40.713453 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f77a45-8a80-4937-b7e8-6aeb89fff8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:40.715344 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f77a45-8a80-4937-b7e8-6aeb89fff8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:40.715344 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f77a45-8a80-4937-b7e8-6aeb89fff8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:40.715344 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f77a45-8a80-4937-b7e8-6aeb89fff8e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:40.715344 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f77a45-8a80-4937-b7e8-6aeb89fff8e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:40.717629 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f77a45-8a80-4937-b7e8-6aeb89fff8e4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:40.732797 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 951/1894] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:23:40.733920 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a9997-d45d-4835-8608-d9d2810b278c service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:40.746610 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a9997-d45d-4835-8608-d9d2810b278c service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:40.751375 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8148c64-235e-44d8-87f0-665e6349fb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:40.752140 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8148c64-235e-44d8-87f0-665e6349fb7d admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:40.752436 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8148c64-235e-44d8-87f0-665e6349fb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:40.752717 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8148c64-235e-44d8-87f0-665e6349fb7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:40.753354 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8148c64-235e-44d8-87f0-665e6349fb7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:40.754954 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8148c64-235e-44d8-87f0-665e6349fb7d admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:40.765285 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 944/1895] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:23:40.772888 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f77a45-8a80-4937-b7e8-6aeb89fff8e4 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:40.779924 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f77a45-8a80-4937-b7e8-6aeb89fff8e4 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:40.785743 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693ace5-2acc-4e32-b55c-3557fd09de28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:40.786422 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693ace5-2acc-4e32-b55c-3557fd09de28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:40.786706 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693ace5-2acc-4e32-b55c-3557fd09de28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:40.786986 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693ace5-2acc-4e32-b55c-3557fd09de28 admin admin] PATH_INFO: `/v3/projects/6f6a33d31cb0434aa49c41eb8bb6daa7/users/3806e4b660df42458fdd4af1aadb66a2/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:40.803371 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693ace5-2acc-4e32-b55c-3557fd09de28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f6a33d31cb0434aa49c41eb8bb6daa7, user_id=3806e4b660df42458fdd4af1aadb66a2, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:40.806175 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693ace5-2acc-4e32-b55c-3557fd09de28 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:40.838622 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:40.902807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 952/1896] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:40 2022] PUT /identity/v3/projects/6f6a33d31cb0434aa49c41eb8bb6daa7/users/3806e4b660df42458fdd4af1aadb66a2/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:23:40.913782 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee71d2e-9454-4646-b2b8-fe76708a96df None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:40.915379 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee71d2e-9454-4646-b2b8-fe76708a96df None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:40.915379 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee71d2e-9454-4646-b2b8-fe76708a96df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:40.944145 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-7ee71d2e-9454-4646-b2b8-fe76708a96df None None] MFA Rules not processed for user `3806e4b660df42458fdd4af1aadb66a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:40.945407 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7ee71d2e-9454-4646-b2b8-fe76708a96df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:41.022970 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 945/1897] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:41.031178 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693ace5-2acc-4e32-b55c-3557fd09de28 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:41.033368 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8693ace5-2acc-4e32-b55c-3557fd09de28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:41.050765 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:41.103819 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693ace5-2acc-4e32-b55c-3557fd09de28 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:41.107565 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84c7e7c-03f7-42f0-8bf7-854ce7585525 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ba30d9c40641bf8abb580a219b5352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:41.110176 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c7e7c-03f7-42f0-8bf7-854ce7585525 service glance] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:41.110176 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c7e7c-03f7-42f0-8bf7-854ce7585525 service glance] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:41.110176 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84c7e7c-03f7-42f0-8bf7-854ce7585525 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:41.120621 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c7e7c-03f7-42f0-8bf7-854ce7585525 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:41.122015 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84c7e7c-03f7-42f0-8bf7-854ce7585525 service glance] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:41.132738 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 953/1898] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:23:41.433057 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:41.895883 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:42.227757 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:DELETE=7,keystone:SELECT=87,keystone:INSERT=6 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:42.438525 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:43.648151 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee71d2e-9454-4646-b2b8-fe76708a96df None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:43.656280 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7ee71d2e-9454-4646-b2b8-fe76708a96df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:43.721173 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee71d2e-9454-4646-b2b8-fe76708a96df None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:43.725758 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301615d-1f41-48f0-94c6-b1598ea0a083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:43.726395 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301615d-1f41-48f0-94c6-b1598ea0a083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:43.726673 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301615d-1f41-48f0-94c6-b1598ea0a083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:43.726946 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301615d-1f41-48f0-94c6-b1598ea0a083 admin admin] PATH_INFO: `/v3/users/5db0fb10d67f497f8c7b85476b186451` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:43.728195 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301615d-1f41-48f0-94c6-b1598ea0a083 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5db0fb10d67f497f8c7b85476b186451)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:43.730127 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d301615d-1f41-48f0-94c6-b1598ea0a083 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:43.898957 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d301615d-1f41-48f0-94c6-b1598ea0a083 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5db0fb10d67f497f8c7b85476b186451'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:43.969683 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d301615d-1f41-48f0-94c6-b1598ea0a083 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5db0fb10d67f497f8c7b85476b186451'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:43.995815 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d301615d-1f41-48f0-94c6-b1598ea0a083 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5db0fb10d67f497f8c7b85476b186451'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:43.996821 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d301615d-1f41-48f0-94c6-b1598ea0a083 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5db0fb10d67f497f8c7b85476b186451'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:44.004226 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:44.007647 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d301615d-1f41-48f0-94c6-b1598ea0a083 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5db0fb10d67f497f8c7b85476b186451'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:44.014242 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 946/1899] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:23:43 2022] DELETE /identity/v3/users/5db0fb10d67f497f8c7b85476b186451 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:44.019390 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb37e2-b5bc-4a55-8fe2-404efbda14e2 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:44.019941 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb37e2-b5bc-4a55-8fe2-404efbda14e2 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:44.019941 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb37e2-b5bc-4a55-8fe2-404efbda14e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:44.047374 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-82cb37e2-b5bc-4a55-8fe2-404efbda14e2 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:44.047374 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-82cb37e2-b5bc-4a55-8fe2-404efbda14e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:44.105796 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 954/1900] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:44.115651 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301615d-1f41-48f0-94c6-b1598ea0a083 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:44.117159 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d301615d-1f41-48f0-94c6-b1598ea0a083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:44.174087 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d301615d-1f41-48f0-94c6-b1598ea0a083 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:44.177710 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949806b-e70c-46e8-badd-3d2dd3e14bac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:44.178315 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949806b-e70c-46e8-badd-3d2dd3e14bac service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:44.178597 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949806b-e70c-46e8-badd-3d2dd3e14bac service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:44.178876 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949806b-e70c-46e8-badd-3d2dd3e14bac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:44.187639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949806b-e70c-46e8-badd-3d2dd3e14bac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:44.189696 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949806b-e70c-46e8-badd-3d2dd3e14bac service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:44.198908 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 947/1901] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:23:44.571153 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb37e2-b5bc-4a55-8fe2-404efbda14e2 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:44.572613 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-82cb37e2-b5bc-4a55-8fe2-404efbda14e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:44.629043 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb37e2-b5bc-4a55-8fe2-404efbda14e2 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:44.632765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804bf63-e509-477e-85ae-27c4d4146cff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:44.633374 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804bf63-e509-477e-85ae-27c4d4146cff service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:44.633659 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804bf63-e509-477e-85ae-27c4d4146cff service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:44.633942 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1804bf63-e509-477e-85ae-27c4d4146cff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:44.635687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1804bf63-e509-477e-85ae-27c4d4146cff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:44.639674 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949806b-e70c-46e8-badd-3d2dd3e14bac service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:44.642894 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d949806b-e70c-46e8-badd-3d2dd3e14bac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:44.655529 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949806b-e70c-46e8-badd-3d2dd3e14bac service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:44.662215 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d9285-4461-48f7-b922-84446187c90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:44.662863 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d9285-4461-48f7-b922-84446187c90a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:44.663143 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d9285-4461-48f7-b922-84446187c90a admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:44.663416 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d9285-4461-48f7-b922-84446187c90a admin admin] PATH_INFO: `/v3/projects/b19c0a7d394e4200b33e702f4ec439e8` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:44.664793 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d9285-4461-48f7-b922-84446187c90a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b19c0a7d394e4200b33e702f4ec439e8)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:44.666882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d9285-4461-48f7-b922-84446187c90a admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:44.706835 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804bf63-e509-477e-85ae-27c4d4146cff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:44.711534 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1804bf63-e509-477e-85ae-27c4d4146cff service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:44.738327 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 955/1902] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:44 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:23:44.783394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-815d9285-4461-48f7-b922-84446187c90a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b19c0a7d394e4200b33e702f4ec439e8', 'request_id': 'req-815d9285-4461-48f7-b922-84446187c90a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:44.855088 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-815d9285-4461-48f7-b922-84446187c90a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b19c0a7d394e4200b33e702f4ec439e8', 'request_id': 'req-815d9285-4461-48f7-b922-84446187c90a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:44.866977 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-815d9285-4461-48f7-b922-84446187c90a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b19c0a7d394e4200b33e702f4ec439e8', 'request_id': 'req-815d9285-4461-48f7-b922-84446187c90a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:44.879707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-815d9285-4461-48f7-b922-84446187c90a admin admin] The token cache is being invalidate because project b19c0a7d394e4200b33e702f4ec439e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:23:44.880009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-815d9285-4461-48f7-b922-84446187c90a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:44.880706 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-815d9285-4461-48f7-b922-84446187c90a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:44.882253 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 948/1903] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:23:44 2022] DELETE /identity/v3/projects/b19c0a7d394e4200b33e702f4ec439e8 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:23:44.892931 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804bf63-e509-477e-85ae-27c4d4146cff service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:44.904160 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1804bf63-e509-477e-85ae-27c4d4146cff service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:44.935987 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:44.963738 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e51ca1-674e-4b24-8b4d-86498bb60c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:44.964410 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e51ca1-674e-4b24-8b4d-86498bb60c37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:44.964695 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e51ca1-674e-4b24-8b4d-86498bb60c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:44.964969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e51ca1-674e-4b24-8b4d-86498bb60c37 admin admin] PATH_INFO: `/v3/users/ce4260cb568143d2a429f6720adb2781` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:44.966090 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e51ca1-674e-4b24-8b4d-86498bb60c37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce4260cb568143d2a429f6720adb2781)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:44.976440 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e51ca1-674e-4b24-8b4d-86498bb60c37 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:45.111181 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-38e51ca1-674e-4b24-8b4d-86498bb60c37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce4260cb568143d2a429f6720adb2781'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:45.175251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-38e51ca1-674e-4b24-8b4d-86498bb60c37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce4260cb568143d2a429f6720adb2781'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:45.189325 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-38e51ca1-674e-4b24-8b4d-86498bb60c37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce4260cb568143d2a429f6720adb2781'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:45.192488 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-38e51ca1-674e-4b24-8b4d-86498bb60c37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce4260cb568143d2a429f6720adb2781'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:45.197047 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-38e51ca1-674e-4b24-8b4d-86498bb60c37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce4260cb568143d2a429f6720adb2781'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:45.203280 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 956/1904] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:23:44 2022] DELETE /identity/v3/users/ce4260cb568143d2a429f6720adb2781 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:45.629182 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d9285-4461-48f7-b922-84446187c90a admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:45.630868 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-815d9285-4461-48f7-b922-84446187c90a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:45.654097 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d9285-4461-48f7-b922-84446187c90a admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:45.716053 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc3a304-8409-4954-9b63-57539ed12ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:45.716883 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3a304-8409-4954-9b63-57539ed12ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:45.717058 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3a304-8409-4954-9b63-57539ed12ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:45.717332 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3a304-8409-4954-9b63-57539ed12ae4 admin admin] PATH_INFO: `/v3/projects/c38f8305c567432fb5e6d4aa3e2569c7` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:45.718492 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc3a304-8409-4954-9b63-57539ed12ae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c38f8305c567432fb5e6d4aa3e2569c7)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:45.720965 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc3a304-8409-4954-9b63-57539ed12ae4 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:45.744759 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:45.850497 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8fc3a304-8409-4954-9b63-57539ed12ae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c38f8305c567432fb5e6d4aa3e2569c7', 'request_id': 'req-8fc3a304-8409-4954-9b63-57539ed12ae4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:45.941855 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8fc3a304-8409-4954-9b63-57539ed12ae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c38f8305c567432fb5e6d4aa3e2569c7', 'request_id': 'req-8fc3a304-8409-4954-9b63-57539ed12ae4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:45.950155 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8fc3a304-8409-4954-9b63-57539ed12ae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c38f8305c567432fb5e6d4aa3e2569c7', 'request_id': 'req-8fc3a304-8409-4954-9b63-57539ed12ae4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:45.961085 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8fc3a304-8409-4954-9b63-57539ed12ae4 admin admin] The token cache is being invalidate because project c38f8305c567432fb5e6d4aa3e2569c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:23:45.961462 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8fc3a304-8409-4954-9b63-57539ed12ae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:45.962252 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8fc3a304-8409-4954-9b63-57539ed12ae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:45.963803 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 949/1905] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:23:45 2022] DELETE /identity/v3/projects/c38f8305c567432fb5e6d4aa3e2569c7 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:45.968805 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a170f4-9b2f-4a05-8907-3913423641bd None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:45.973580 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a170f4-9b2f-4a05-8907-3913423641bd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:45.973580 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a170f4-9b2f-4a05-8907-3913423641bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:45.990109 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-42a170f4-9b2f-4a05-8907-3913423641bd None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:45.991419 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-42a170f4-9b2f-4a05-8907-3913423641bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:46.055561 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 957/1906] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:23:46.063332 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9c95e-dc6c-4a78-9577-6e06023d6cb2 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:46.063668 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9c95e-dc6c-4a78-9577-6e06023d6cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:46.063948 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9c95e-dc6c-4a78-9577-6e06023d6cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:46.091402 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-71d9c95e-dc6c-4a78-9577-6e06023d6cb2 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:46.092834 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-71d9c95e-dc6c-4a78-9577-6e06023d6cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:46.109169 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 950/1907] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:46.112724 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a170f4-9b2f-4a05-8907-3913423641bd None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:46.127258 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a170f4-9b2f-4a05-8907-3913423641bd None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:46.140149 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1636c-6bfb-40f6-a46f-f76805add932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:46.140149 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1636c-6bfb-40f6-a46f-f76805add932 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:46.140149 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1636c-6bfb-40f6-a46f-f76805add932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:46.140149 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf1636c-6bfb-40f6-a46f-f76805add932 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:46.143561 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf1636c-6bfb-40f6-a46f-f76805add932 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:23:46.143561 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf1636c-6bfb-40f6-a46f-f76805add932 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:46.143561 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf1636c-6bfb-40f6-a46f-f76805add932 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:46.167818 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 958/1908] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:23:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:23:46.168972 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9c95e-dc6c-4a78-9577-6e06023d6cb2 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:46.179977 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9c95e-dc6c-4a78-9577-6e06023d6cb2 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:46.186615 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc16c7a-afb3-4050-97ed-b937ec85fbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:46.192527 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc16c7a-afb3-4050-97ed-b937ec85fbd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:46.192527 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc16c7a-afb3-4050-97ed-b937ec85fbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:46.192527 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc16c7a-afb3-4050-97ed-b937ec85fbd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:46.192527 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc16c7a-afb3-4050-97ed-b937ec85fbd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:46.193505 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc16c7a-afb3-4050-97ed-b937ec85fbd4 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:46.282091 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 951/1909] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:23:46 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:46.286365 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1636c-6bfb-40f6-a46f-f76805add932 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:46.299103 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf1636c-6bfb-40f6-a46f-f76805add932 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:46.348266 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:46.366926 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f14b3a-cce1-455f-8c47-e4dce49cbfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:46.367614 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f14b3a-cce1-455f-8c47-e4dce49cbfc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:46.367897 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f14b3a-cce1-455f-8c47-e4dce49cbfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:46.368207 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f14b3a-cce1-455f-8c47-e4dce49cbfc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:46.368852 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f14b3a-cce1-455f-8c47-e4dce49cbfc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:46.370779 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f14b3a-cce1-455f-8c47-e4dce49cbfc4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:46.439466 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 959/1910] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:23:46 2022] POST /identity/v3/users => generated 291 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:23:46.443517 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc16c7a-afb3-4050-97ed-b937ec85fbd4 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:46.457763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc16c7a-afb3-4050-97ed-b937ec85fbd4 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:46.462752 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b942e0-3551-451f-8cfc-0752d0d85e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:46.463370 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b942e0-3551-451f-8cfc-0752d0d85e6b admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:46.463652 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b942e0-3551-451f-8cfc-0752d0d85e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:46.463929 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b942e0-3551-451f-8cfc-0752d0d85e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:46.463929 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b942e0-3551-451f-8cfc-0752d0d85e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:46.476384 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b942e0-3551-451f-8cfc-0752d0d85e6b admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:46.496306 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 952/1911] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:46.497280 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f14b3a-cce1-455f-8c47-e4dce49cbfc4 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:46.517707 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f14b3a-cce1-455f-8c47-e4dce49cbfc4 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:46.529073 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e24cf-3243-433f-892b-bfc60b8c9c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:46.529867 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e24cf-3243-433f-892b-bfc60b8c9c80 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:46.529984 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e24cf-3243-433f-892b-bfc60b8c9c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:46.530248 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e24cf-3243-433f-892b-bfc60b8c9c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:46.531080 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e24cf-3243-433f-892b-bfc60b8c9c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:46.532842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e24cf-3243-433f-892b-bfc60b8c9c80 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:46.549703 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 960/1912] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:23:46.555141 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b942e0-3551-451f-8cfc-0752d0d85e6b admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:46.566920 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b942e0-3551-451f-8cfc-0752d0d85e6b admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:46.571754 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6edf4-db97-44ce-853c-e87be2a2afd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:46.572469 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6edf4-db97-44ce-853c-e87be2a2afd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:46.572752 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6edf4-db97-44ce-853c-e87be2a2afd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:46.573032 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6edf4-db97-44ce-853c-e87be2a2afd0 admin admin] PATH_INFO: `/v3/projects/01b8fb6e51ac43e1b11ca6dcbd26f0b9/users/1d2e9471b6c041279a523722ae65cf54/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:46.588716 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6edf4-db97-44ce-853c-e87be2a2afd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01b8fb6e51ac43e1b11ca6dcbd26f0b9, user_id=1d2e9471b6c041279a523722ae65cf54, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:46.597700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6edf4-db97-44ce-853c-e87be2a2afd0 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:46.698385 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 953/1913] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:46 2022] PUT /identity/v3/projects/01b8fb6e51ac43e1b11ca6dcbd26f0b9/users/1d2e9471b6c041279a523722ae65cf54/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:46.713486 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37922595-d3b9-47c7-9597-fb716d55f518 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:46.713826 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37922595-d3b9-47c7-9597-fb716d55f518 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:46.714052 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37922595-d3b9-47c7-9597-fb716d55f518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:46.748065 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-37922595-d3b9-47c7-9597-fb716d55f518 None None] MFA Rules not processed for user `1d2e9471b6c041279a523722ae65cf54`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:46.752608 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-37922595-d3b9-47c7-9597-fb716d55f518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:46.816076 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 961/1914] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:46.820901 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6edf4-db97-44ce-853c-e87be2a2afd0 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:46.891617 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6edf4-db97-44ce-853c-e87be2a2afd0 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:46.896602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1bb78-ba14-4d7f-842a-7d2e653b4f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:46.897237 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1bb78-ba14-4d7f-842a-7d2e653b4f89 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:46.897523 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1bb78-ba14-4d7f-842a-7d2e653b4f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:46.897802 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1bb78-ba14-4d7f-842a-7d2e653b4f89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:46.898447 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1bb78-ba14-4d7f-842a-7d2e653b4f89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:46.900511 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1bb78-ba14-4d7f-842a-7d2e653b4f89 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:47.003246 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 954/1915] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:23:46 2022] POST /identity/v3/projects => generated 379 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:47.004413 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37922595-d3b9-47c7-9597-fb716d55f518 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:47.016240 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37922595-d3b9-47c7-9597-fb716d55f518 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:47.079255 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc07aa-43fe-4da7-9b56-81208d48c961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:47.080035 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc07aa-43fe-4da7-9b56-81208d48c961 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:47.080435 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc07aa-43fe-4da7-9b56-81208d48c961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:47.080611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc07aa-43fe-4da7-9b56-81208d48c961 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:47.081292 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc07aa-43fe-4da7-9b56-81208d48c961 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:47.083248 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc07aa-43fe-4da7-9b56-81208d48c961 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:47.158692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 962/1916] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:23:47 2022] POST /identity/v3/users => generated 296 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:23:47.162830 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1bb78-ba14-4d7f-842a-7d2e653b4f89 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:47.174132 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1bb78-ba14-4d7f-842a-7d2e653b4f89 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:47.179620 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e782a-7e52-49f9-980b-fcbef50445a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:47.180309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e782a-7e52-49f9-980b-fcbef50445a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:47.181234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e782a-7e52-49f9-980b-fcbef50445a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:47.181566 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54e782a-7e52-49f9-980b-fcbef50445a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:47.182209 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e782a-7e52-49f9-980b-fcbef50445a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:47.183831 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54e782a-7e52-49f9-980b-fcbef50445a0 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:47.198900 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 955/1917] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:47.200162 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc07aa-43fe-4da7-9b56-81208d48c961 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:47.211853 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc07aa-43fe-4da7-9b56-81208d48c961 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:47.217224 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391c515-e0fc-4188-ac47-e21d429f1b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:47.217895 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391c515-e0fc-4188-ac47-e21d429f1b04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:47.218181 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391c515-e0fc-4188-ac47-e21d429f1b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:47.218467 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391c515-e0fc-4188-ac47-e21d429f1b04 admin admin] PATH_INFO: `/v3/projects/922f28262f1f4989945ae1384cbaa137/users/1839b8d613e24b9791d428646385f3df/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:47.234686 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391c515-e0fc-4188-ac47-e21d429f1b04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=922f28262f1f4989945ae1384cbaa137, user_id=1839b8d613e24b9791d428646385f3df, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:47.237546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7391c515-e0fc-4188-ac47-e21d429f1b04 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:47.319325 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 963/1918] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:47 2022] PUT /identity/v3/projects/922f28262f1f4989945ae1384cbaa137/users/1839b8d613e24b9791d428646385f3df/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:47.323410 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e782a-7e52-49f9-980b-fcbef50445a0 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:47.333928 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54e782a-7e52-49f9-980b-fcbef50445a0 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:47.347534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:47.398490 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab1b9f5-dcc5-4fae-98d8-10b0c1ff7dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:47.399262 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1b9f5-dcc5-4fae-98d8-10b0c1ff7dde admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:47.399551 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1b9f5-dcc5-4fae-98d8-10b0c1ff7dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:47.399859 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab1b9f5-dcc5-4fae-98d8-10b0c1ff7dde admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:47.400557 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1b9f5-dcc5-4fae-98d8-10b0c1ff7dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:47.402210 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab1b9f5-dcc5-4fae-98d8-10b0c1ff7dde admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:47.412544 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 956/1919] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:47.421255 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391c515-e0fc-4188-ac47-e21d429f1b04 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:47.432056 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391c515-e0fc-4188-ac47-e21d429f1b04 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:47.436710 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afa977-d593-41b7-8a55-e2eec6378bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:47.437370 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afa977-d593-41b7-8a55-e2eec6378bb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:47.437667 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afa977-d593-41b7-8a55-e2eec6378bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:47.437923 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afa977-d593-41b7-8a55-e2eec6378bb9 admin admin] PATH_INFO: `/v3/projects/922f28262f1f4989945ae1384cbaa137/users/1839b8d613e24b9791d428646385f3df/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:47.440499 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65afa977-d593-41b7-8a55-e2eec6378bb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=922f28262f1f4989945ae1384cbaa137, user_id=1839b8d613e24b9791d428646385f3df, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:47.443158 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65afa977-d593-41b7-8a55-e2eec6378bb9 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:47.450756 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:47.455348 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 964/1920] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:47 2022] PUT /identity/v3/projects/922f28262f1f4989945ae1384cbaa137/users/1839b8d613e24b9791d428646385f3df/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:47.465602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fc5ae-3cfa-492b-b550-4193f097b908 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:47.465891 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fc5ae-3cfa-492b-b550-4193f097b908 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:47.466234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fc5ae-3cfa-492b-b550-4193f097b908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:47.497208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-6c6fc5ae-3cfa-492b-b550-4193f097b908 None None] MFA Rules not processed for user `1839b8d613e24b9791d428646385f3df`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:47.498525 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6c6fc5ae-3cfa-492b-b550-4193f097b908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:47.601395 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 957/1921] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:47.655759 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afa977-d593-41b7-8a55-e2eec6378bb9 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:47.656753 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-65afa977-d593-41b7-8a55-e2eec6378bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:47.787441 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afa977-d593-41b7-8a55-e2eec6378bb9 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:47.791923 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6d698-7436-451e-acb5-9f1bd51c51ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:47.792609 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6d698-7436-451e-acb5-9f1bd51c51ea service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:47.792902 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6d698-7436-451e-acb5-9f1bd51c51ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:47.793174 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f6d698-7436-451e-acb5-9f1bd51c51ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:47.806172 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6d698-7436-451e-acb5-9f1bd51c51ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:47.807685 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f6d698-7436-451e-acb5-9f1bd51c51ea service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:47.820176 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 965/1922] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:47 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:23:48.097059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6fc5ae-3cfa-492b-b550-4193f097b908 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:48.106739 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6fc5ae-3cfa-492b-b550-4193f097b908 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:48.110633 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbe5a4-1298-455f-b310-fe01af5198db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:48.111462 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbe5a4-1298-455f-b310-fe01af5198db service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:48.111750 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbe5a4-1298-455f-b310-fe01af5198db service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:48.112026 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbe5a4-1298-455f-b310-fe01af5198db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:48.178125 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbe5a4-1298-455f-b310-fe01af5198db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:48.179605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbe5a4-1298-455f-b310-fe01af5198db service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:48.193264 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 958/1923] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:23:48.991407 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6d698-7436-451e-acb5-9f1bd51c51ea service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:48.992978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-78f6d698-7436-451e-acb5-9f1bd51c51ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:49.085771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f6d698-7436-451e-acb5-9f1bd51c51ea service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:49.091235 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b960c-b1ec-47ad-8a16-f08af907f44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:49.092454 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b960c-b1ec-47ad-8a16-f08af907f44c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:49.092736 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b960c-b1ec-47ad-8a16-f08af907f44c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:49.093039 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b960c-b1ec-47ad-8a16-f08af907f44c admin admin] PATH_INFO: `/v3/users/148eb8e735d642a0bccf4253686f9250` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:49.094274 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b960c-b1ec-47ad-8a16-f08af907f44c admin admin] RBAC: Authorizing `identity:delete_user(user_id=148eb8e735d642a0bccf4253686f9250)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:49.096939 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b960c-b1ec-47ad-8a16-f08af907f44c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:49.280521 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c82b960c-b1ec-47ad-8a16-f08af907f44c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '148eb8e735d642a0bccf4253686f9250'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:49.346124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c82b960c-b1ec-47ad-8a16-f08af907f44c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '148eb8e735d642a0bccf4253686f9250'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:49.359318 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c82b960c-b1ec-47ad-8a16-f08af907f44c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '148eb8e735d642a0bccf4253686f9250'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:49.360010 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c82b960c-b1ec-47ad-8a16-f08af907f44c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '148eb8e735d642a0bccf4253686f9250'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:49.369223 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c82b960c-b1ec-47ad-8a16-f08af907f44c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '148eb8e735d642a0bccf4253686f9250'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:49.376866 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 966/1924] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:23:48 2022] DELETE /identity/v3/users/148eb8e735d642a0bccf4253686f9250 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:49.381530 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57c077-9e6b-4570-a20f-7f190f0c445f None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:49.382021 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57c077-9e6b-4570-a20f-7f190f0c445f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:49.382127 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae57c077-9e6b-4570-a20f-7f190f0c445f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:49.401573 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-ae57c077-9e6b-4570-a20f-7f190f0c445f None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:49.402755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ae57c077-9e6b-4570-a20f-7f190f0c445f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:49.435114 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:49.463770 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 959/1925] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:49.473534 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b960c-b1ec-47ad-8a16-f08af907f44c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:49.474954 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c82b960c-b1ec-47ad-8a16-f08af907f44c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:49.501628 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:49.535017 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b960c-b1ec-47ad-8a16-f08af907f44c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:49.539073 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce062aa6-d3e2-48e5-b1d2-4cfeca21096a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:49.539697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce062aa6-d3e2-48e5-b1d2-4cfeca21096a service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:49.539969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce062aa6-d3e2-48e5-b1d2-4cfeca21096a service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:49.540355 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce062aa6-d3e2-48e5-b1d2-4cfeca21096a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:49.550872 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce062aa6-d3e2-48e5-b1d2-4cfeca21096a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:49.552419 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce062aa6-d3e2-48e5-b1d2-4cfeca21096a service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:49.564581 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 967/1926] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:23:50.130984 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57c077-9e6b-4570-a20f-7f190f0c445f None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:50.133694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ae57c077-9e6b-4570-a20f-7f190f0c445f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:50.151074 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae57c077-9e6b-4570-a20f-7f190f0c445f None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:50.157956 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca8705-a890-44e0-bd6c-33cc4acb0b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:50.158640 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca8705-a890-44e0-bd6c-33cc4acb0b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:50.158930 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca8705-a890-44e0-bd6c-33cc4acb0b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:50.159225 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca8705-a890-44e0-bd6c-33cc4acb0b70 admin admin] PATH_INFO: `/v3/projects/e220d84cf84c4c65856bf3750ac1fb46` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:50.160460 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca8705-a890-44e0-bd6c-33cc4acb0b70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e220d84cf84c4c65856bf3750ac1fb46)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:50.162422 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca8705-a890-44e0-bd6c-33cc4acb0b70 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:50.252216 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-18ca8705-a890-44e0-bd6c-33cc4acb0b70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e220d84cf84c4c65856bf3750ac1fb46', 'request_id': 'req-18ca8705-a890-44e0-bd6c-33cc4acb0b70'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:50.323866 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-18ca8705-a890-44e0-bd6c-33cc4acb0b70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e220d84cf84c4c65856bf3750ac1fb46', 'request_id': 'req-18ca8705-a890-44e0-bd6c-33cc4acb0b70'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:50.330607 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-18ca8705-a890-44e0-bd6c-33cc4acb0b70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e220d84cf84c4c65856bf3750ac1fb46', 'request_id': 'req-18ca8705-a890-44e0-bd6c-33cc4acb0b70'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:50.343248 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-18ca8705-a890-44e0-bd6c-33cc4acb0b70 admin admin] The token cache is being invalidate because project e220d84cf84c4c65856bf3750ac1fb46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:23:50.343656 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-18ca8705-a890-44e0-bd6c-33cc4acb0b70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:50.344393 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-18ca8705-a890-44e0-bd6c-33cc4acb0b70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:50.347059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 960/1927] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:23:50 2022] DELETE /identity/v3/projects/e220d84cf84c4c65856bf3750ac1fb46 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:50.352501 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce062aa6-d3e2-48e5-b1d2-4cfeca21096a service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:50.363748 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce062aa6-d3e2-48e5-b1d2-4cfeca21096a service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:50.432481 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dac321-5cb6-4d21-9f12-c87369aadbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:50.433287 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dac321-5cb6-4d21-9f12-c87369aadbf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:50.433569 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dac321-5cb6-4d21-9f12-c87369aadbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:50.433992 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dac321-5cb6-4d21-9f12-c87369aadbf3 admin admin] PATH_INFO: `/v3/users/7040513984e840ea8525f438eeaed6fd` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:50.435126 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dac321-5cb6-4d21-9f12-c87369aadbf3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7040513984e840ea8525f438eeaed6fd)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:50.437068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dac321-5cb6-4d21-9f12-c87369aadbf3 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:50.687782 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-19dac321-5cb6-4d21-9f12-c87369aadbf3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7040513984e840ea8525f438eeaed6fd'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:50.780769 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-19dac321-5cb6-4d21-9f12-c87369aadbf3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7040513984e840ea8525f438eeaed6fd'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:50.799737 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-19dac321-5cb6-4d21-9f12-c87369aadbf3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7040513984e840ea8525f438eeaed6fd'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:50.800753 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-19dac321-5cb6-4d21-9f12-c87369aadbf3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7040513984e840ea8525f438eeaed6fd'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:50.810032 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-19dac321-5cb6-4d21-9f12-c87369aadbf3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7040513984e840ea8525f438eeaed6fd'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:50.828744 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 968/1928] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:23:50 2022] DELETE /identity/v3/users/7040513984e840ea8525f438eeaed6fd => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:23:51.325375 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca8705-a890-44e0-bd6c-33cc4acb0b70 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:51.326923 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-18ca8705-a890-44e0-bd6c-33cc4acb0b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:51.349396 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca8705-a890-44e0-bd6c-33cc4acb0b70 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:51.403232 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dac321-5cb6-4d21-9f12-c87369aadbf3 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:51.404881 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-19dac321-5cb6-4d21-9f12-c87369aadbf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:51.411868 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d8b5c-1acc-4800-9f64-c811f4113949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:51.412542 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d8b5c-1acc-4800-9f64-c811f4113949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:51.412871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d8b5c-1acc-4800-9f64-c811f4113949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:51.413154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184d8b5c-1acc-4800-9f64-c811f4113949 admin admin] PATH_INFO: `/v3/projects/e47898912ea04705b579921fbf106279` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:51.414314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d8b5c-1acc-4800-9f64-c811f4113949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e47898912ea04705b579921fbf106279)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:51.416403 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184d8b5c-1acc-4800-9f64-c811f4113949 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:51.453303 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:51.471964 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dac321-5cb6-4d21-9f12-c87369aadbf3 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:51.476756 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5ce8ef-9cb4-4363-b630-bfc0d098d824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:51.481504 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ce8ef-9cb4-4363-b630-bfc0d098d824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:51.481504 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ce8ef-9cb4-4363-b630-bfc0d098d824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:51.481504 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5ce8ef-9cb4-4363-b630-bfc0d098d824 admin admin] PATH_INFO: `/v3/users/1d2e9471b6c041279a523722ae65cf54` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:51.481504 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ce8ef-9cb4-4363-b630-bfc0d098d824 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d2e9471b6c041279a523722ae65cf54)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:51.481504 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5ce8ef-9cb4-4363-b630-bfc0d098d824 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:51.546827 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-184d8b5c-1acc-4800-9f64-c811f4113949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e47898912ea04705b579921fbf106279', 'request_id': 'req-184d8b5c-1acc-4800-9f64-c811f4113949'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:51.649526 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-184d8b5c-1acc-4800-9f64-c811f4113949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e47898912ea04705b579921fbf106279', 'request_id': 'req-184d8b5c-1acc-4800-9f64-c811f4113949'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:51.654749 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:51.656003 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-184d8b5c-1acc-4800-9f64-c811f4113949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e47898912ea04705b579921fbf106279', 'request_id': 'req-184d8b5c-1acc-4800-9f64-c811f4113949'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:51.667571 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-184d8b5c-1acc-4800-9f64-c811f4113949 admin admin] The token cache is being invalidate because project e47898912ea04705b579921fbf106279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:23:51.667781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-184d8b5c-1acc-4800-9f64-c811f4113949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:51.668479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-184d8b5c-1acc-4800-9f64-c811f4113949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:51.670291 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 961/1929] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:23:51 2022] DELETE /identity/v3/projects/e47898912ea04705b579921fbf106279 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:51.674180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d8b5c-1acc-4800-9f64-c811f4113949 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:51.675536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-184d8b5c-1acc-4800-9f64-c811f4113949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:51.697022 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-2a5ce8ef-9cb4-4363-b630-bfc0d098d824 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d2e9471b6c041279a523722ae65cf54'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:51.745775 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184d8b5c-1acc-4800-9f64-c811f4113949 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:51.751822 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b039c-48e3-42ee-bb85-1edcf10aee23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:51.752590 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b039c-48e3-42ee-bb85-1edcf10aee23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:51.753011 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b039c-48e3-42ee-bb85-1edcf10aee23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:51.753250 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-2a5ce8ef-9cb4-4363-b630-bfc0d098d824 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d2e9471b6c041279a523722ae65cf54'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:51.753910 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b039c-48e3-42ee-bb85-1edcf10aee23 admin admin] PATH_INFO: `/v3/users/e9af745fee03460080113b1f397fd610` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:51.755354 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b039c-48e3-42ee-bb85-1edcf10aee23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9af745fee03460080113b1f397fd610)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:51.757782 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b039c-48e3-42ee-bb85-1edcf10aee23 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:51.771721 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-2a5ce8ef-9cb4-4363-b630-bfc0d098d824 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d2e9471b6c041279a523722ae65cf54'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:51.772480 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-2a5ce8ef-9cb4-4363-b630-bfc0d098d824 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d2e9471b6c041279a523722ae65cf54'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:51.781120 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-2a5ce8ef-9cb4-4363-b630-bfc0d098d824 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d2e9471b6c041279a523722ae65cf54'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:51.787842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 969/1930] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:23:51 2022] DELETE /identity/v3/users/1d2e9471b6c041279a523722ae65cf54 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:23:51.793138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b6282-3912-4b58-9c09-6141bc69b3ce None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:51.793431 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b6282-3912-4b58-9c09-6141bc69b3ce None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:51.793711 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b6282-3912-4b58-9c09-6141bc69b3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:51.818321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-4c7b6282-3912-4b58-9c09-6141bc69b3ce None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:51.819534 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4c7b6282-3912-4b58-9c09-6141bc69b3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:51.878903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 970/1931] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:23:51.888882 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b6282-3912-4b58-9c09-6141bc69b3ce None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:51.890354 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4c7b6282-3912-4b58-9c09-6141bc69b3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:51.939628 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0c5b039c-48e3-42ee-bb85-1edcf10aee23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9af745fee03460080113b1f397fd610'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:51.956729 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b6282-3912-4b58-9c09-6141bc69b3ce None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:51.960337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9813d00-a012-44a6-a170-03c6ff0d1e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:51.960949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9813d00-a012-44a6-a170-03c6ff0d1e98 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:51.961265 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9813d00-a012-44a6-a170-03c6ff0d1e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:51.961655 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9813d00-a012-44a6-a170-03c6ff0d1e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:51.971305 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9813d00-a012-44a6-a170-03c6ff0d1e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:51.972615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9813d00-a012-44a6-a170-03c6ff0d1e98 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:51.982680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 971/1932] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:23:52.061537 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0c5b039c-48e3-42ee-bb85-1edcf10aee23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9af745fee03460080113b1f397fd610'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:52.080995 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0c5b039c-48e3-42ee-bb85-1edcf10aee23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9af745fee03460080113b1f397fd610'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:52.082118 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0c5b039c-48e3-42ee-bb85-1edcf10aee23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9af745fee03460080113b1f397fd610'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:52.090105 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0c5b039c-48e3-42ee-bb85-1edcf10aee23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9af745fee03460080113b1f397fd610'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:52.096789 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 962/1933] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:23:51 2022] DELETE /identity/v3/users/e9af745fee03460080113b1f397fd610 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:23:52.585719 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9813d00-a012-44a6-a170-03c6ff0d1e98 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:52.590364 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a9813d00-a012-44a6-a170-03c6ff0d1e98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:52.604004 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9813d00-a012-44a6-a170-03c6ff0d1e98 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:52.613801 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:52.672476 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061244a7-56ac-4d9d-9c99-9cdda77fd987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:52.673155 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061244a7-56ac-4d9d-9c99-9cdda77fd987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:52.673886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061244a7-56ac-4d9d-9c99-9cdda77fd987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:52.674170 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061244a7-56ac-4d9d-9c99-9cdda77fd987 admin admin] PATH_INFO: `/v3/projects/01b8fb6e51ac43e1b11ca6dcbd26f0b9` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:52.675335 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061244a7-56ac-4d9d-9c99-9cdda77fd987 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01b8fb6e51ac43e1b11ca6dcbd26f0b9)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:52.678153 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061244a7-56ac-4d9d-9c99-9cdda77fd987 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:52.777903 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b039c-48e3-42ee-bb85-1edcf10aee23 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:52.779494 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-0c5b039c-48e3-42ee-bb85-1edcf10aee23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:52.800639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b039c-48e3-42ee-bb85-1edcf10aee23 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:52.817924 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a7dc7-7921-4a89-b426-aa57eb274ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:52.818584 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a7dc7-7921-4a89-b426-aa57eb274ff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:52.818864 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a7dc7-7921-4a89-b426-aa57eb274ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:52.819135 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a7dc7-7921-4a89-b426-aa57eb274ff7 admin admin] PATH_INFO: `/v3/projects/f41db46cca18421c9656a5263bcf2155` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:52.820984 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a7dc7-7921-4a89-b426-aa57eb274ff7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f41db46cca18421c9656a5263bcf2155)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:52.822947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a7dc7-7921-4a89-b426-aa57eb274ff7 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:52.832681 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-061244a7-56ac-4d9d-9c99-9cdda77fd987 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01b8fb6e51ac43e1b11ca6dcbd26f0b9', 'request_id': 'req-061244a7-56ac-4d9d-9c99-9cdda77fd987'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:52.838605 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-061244a7-56ac-4d9d-9c99-9cdda77fd987 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01b8fb6e51ac43e1b11ca6dcbd26f0b9', 'request_id': 'req-061244a7-56ac-4d9d-9c99-9cdda77fd987'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:52.847176 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-061244a7-56ac-4d9d-9c99-9cdda77fd987 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01b8fb6e51ac43e1b11ca6dcbd26f0b9', 'request_id': 'req-061244a7-56ac-4d9d-9c99-9cdda77fd987'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:52.901072 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-061244a7-56ac-4d9d-9c99-9cdda77fd987 admin admin] The token cache is being invalidate because project 01b8fb6e51ac43e1b11ca6dcbd26f0b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:23:52.901402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-061244a7-56ac-4d9d-9c99-9cdda77fd987 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:52.902952 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-061244a7-56ac-4d9d-9c99-9cdda77fd987 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:52.903822 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 972/1934] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:23:52 2022] DELETE /identity/v3/projects/01b8fb6e51ac43e1b11ca6dcbd26f0b9 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:52.908416 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061244a7-56ac-4d9d-9c99-9cdda77fd987 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:52.909996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-061244a7-56ac-4d9d-9c99-9cdda77fd987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:52.933127 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8e6a7dc7-7921-4a89-b426-aa57eb274ff7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f41db46cca18421c9656a5263bcf2155', 'request_id': 'req-8e6a7dc7-7921-4a89-b426-aa57eb274ff7'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:52.986512 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8e6a7dc7-7921-4a89-b426-aa57eb274ff7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f41db46cca18421c9656a5263bcf2155', 'request_id': 'req-8e6a7dc7-7921-4a89-b426-aa57eb274ff7'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:52.989264 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061244a7-56ac-4d9d-9c99-9cdda77fd987 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:52.993284 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8e6a7dc7-7921-4a89-b426-aa57eb274ff7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f41db46cca18421c9656a5263bcf2155', 'request_id': 'req-8e6a7dc7-7921-4a89-b426-aa57eb274ff7'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:52.994532 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:53.010118 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8e6a7dc7-7921-4a89-b426-aa57eb274ff7 admin admin] The token cache is being invalidate because project f41db46cca18421c9656a5263bcf2155 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:23:53.010309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8e6a7dc7-7921-4a89-b426-aa57eb274ff7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:53.011100 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8e6a7dc7-7921-4a89-b426-aa57eb274ff7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:53.012716 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 963/1935] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:23:52 2022] DELETE /identity/v3/projects/f41db46cca18421c9656a5263bcf2155 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:53.019615 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045821a-96e0-4147-8b99-2c98f54b6cc4 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:53.019981 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045821a-96e0-4147-8b99-2c98f54b6cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:53.020361 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045821a-96e0-4147-8b99-2c98f54b6cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:53.040529 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-7045821a-96e0-4147-8b99-2c98f54b6cc4 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:53.041748 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7045821a-96e0-4147-8b99-2c98f54b6cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:53.059314 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8df42-4510-493e-aa8a-443c756b606a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:53.059557 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8df42-4510-493e-aa8a-443c756b606a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:53.060498 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8df42-4510-493e-aa8a-443c756b606a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:53.060498 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8df42-4510-493e-aa8a-443c756b606a admin admin] PATH_INFO: `/v3/users/1839b8d613e24b9791d428646385f3df` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:53.061417 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8df42-4510-493e-aa8a-443c756b606a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1839b8d613e24b9791d428646385f3df)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:53.064164 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c8df42-4510-493e-aa8a-443c756b606a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:53.104752 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 964/1936] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:53.114238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af485de6-3f54-4793-aec8-944609d9de72 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:53.114511 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af485de6-3f54-4793-aec8-944609d9de72 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:53.114792 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af485de6-3f54-4793-aec8-944609d9de72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:53.136525 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-af485de6-3f54-4793-aec8-944609d9de72 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:53.137752 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-af485de6-3f54-4793-aec8-944609d9de72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:53.151662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 965/1937] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:23:53.153392 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af485de6-3f54-4793-aec8-944609d9de72 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:53.166093 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af485de6-3f54-4793-aec8-944609d9de72 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:53.171261 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b9888-3cb8-4b79-902a-a7c2162eb614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:53.171944 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b9888-3cb8-4b79-902a-a7c2162eb614 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:53.172323 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b9888-3cb8-4b79-902a-a7c2162eb614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:53.172914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b9888-3cb8-4b79-902a-a7c2162eb614 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:53.173433 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b9888-3cb8-4b79-902a-a7c2162eb614 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:23:53.173733 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b9888-3cb8-4b79-902a-a7c2162eb614 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:53.176729 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b9888-3cb8-4b79-902a-a7c2162eb614 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:53.189023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 966/1938] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:23:53.199558 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b9888-3cb8-4b79-902a-a7c2162eb614 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:53.210225 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b9888-3cb8-4b79-902a-a7c2162eb614 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:53.215395 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e57ff-4d75-4dc5-950a-a24b5a823dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:53.216017 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e57ff-4d75-4dc5-950a-a24b5a823dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:53.217133 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e57ff-4d75-4dc5-950a-a24b5a823dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:53.217469 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e57ff-4d75-4dc5-950a-a24b5a823dc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:53.218155 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e57ff-4d75-4dc5-950a-a24b5a823dc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:53.220122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e57ff-4d75-4dc5-950a-a24b5a823dc0 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:53.260927 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c7c8df42-4510-493e-aa8a-443c756b606a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1839b8d613e24b9791d428646385f3df'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:53.331688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 967/1939] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:23:53 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:53.335405 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e57ff-4d75-4dc5-950a-a24b5a823dc0 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:53.362592 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:53.367464 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c7c8df42-4510-493e-aa8a-443c756b606a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1839b8d613e24b9791d428646385f3df'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:53.382652 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c7c8df42-4510-493e-aa8a-443c756b606a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1839b8d613e24b9791d428646385f3df'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:53.383468 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c7c8df42-4510-493e-aa8a-443c756b606a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1839b8d613e24b9791d428646385f3df'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:53.396975 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c7c8df42-4510-493e-aa8a-443c756b606a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1839b8d613e24b9791d428646385f3df'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:53.411350 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 973/1940] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:23:52 2022] DELETE /identity/v3/users/1839b8d613e24b9791d428646385f3df => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:23:53.438043 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e57ff-4d75-4dc5-950a-a24b5a823dc0 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:53.506988 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1efdba-53fb-4f18-ae3b-a02d24f8b6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:53.508942 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1efdba-53fb-4f18-ae3b-a02d24f8b6e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:53.509229 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1efdba-53fb-4f18-ae3b-a02d24f8b6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:53.509504 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1efdba-53fb-4f18-ae3b-a02d24f8b6e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:53.512388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1efdba-53fb-4f18-ae3b-a02d24f8b6e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:53.514311 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1efdba-53fb-4f18-ae3b-a02d24f8b6e2 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:53.605424 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 968/1941] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:23:53 2022] POST /identity/v3/users => generated 294 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:53.611577 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8df42-4510-493e-aa8a-443c756b606a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:53.613094 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c7c8df42-4510-493e-aa8a-443c756b606a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:53.631679 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8df42-4510-493e-aa8a-443c756b606a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:53.636951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70adcc55-d563-42c5-bce8-de767bbc9496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:53.637578 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adcc55-d563-42c5-bce8-de767bbc9496 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:53.637862 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adcc55-d563-42c5-bce8-de767bbc9496 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:53.638141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70adcc55-d563-42c5-bce8-de767bbc9496 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:53.638790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70adcc55-d563-42c5-bce8-de767bbc9496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:53.640462 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70adcc55-d563-42c5-bce8-de767bbc9496 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:53.686913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 974/1942] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:53.692340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1efdba-53fb-4f18-ae3b-a02d24f8b6e2 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:53.706530 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1efdba-53fb-4f18-ae3b-a02d24f8b6e2 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:53.711970 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39900b5d-c98c-48fb-8d8d-abce80b7e3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:53.712860 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39900b5d-c98c-48fb-8d8d-abce80b7e3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:53.713240 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39900b5d-c98c-48fb-8d8d-abce80b7e3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:53.713609 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39900b5d-c98c-48fb-8d8d-abce80b7e3f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:53.714357 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39900b5d-c98c-48fb-8d8d-abce80b7e3f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:53.716080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39900b5d-c98c-48fb-8d8d-abce80b7e3f2 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:53.726768 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:53.732026 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 969/1943] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:53.735758 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70adcc55-d563-42c5-bce8-de767bbc9496 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:53.750776 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70adcc55-d563-42c5-bce8-de767bbc9496 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:53.758091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f62870-6810-4a3a-85ec-f6a06234101b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:53.758091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f62870-6810-4a3a-85ec-f6a06234101b admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:53.758475 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f62870-6810-4a3a-85ec-f6a06234101b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:53.758855 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f62870-6810-4a3a-85ec-f6a06234101b admin admin] PATH_INFO: `/v3/projects/12f35afdade74fbeaf350fd1d1d84abe/users/4d20573a6a4849a9992eb365bf4f3ea2/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:53.789130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f62870-6810-4a3a-85ec-f6a06234101b admin admin] RBAC: Authorizing `identity:create_grant(project_id=12f35afdade74fbeaf350fd1d1d84abe, user_id=4d20573a6a4849a9992eb365bf4f3ea2, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:53.794696 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f62870-6810-4a3a-85ec-f6a06234101b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:53.893511 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39900b5d-c98c-48fb-8d8d-abce80b7e3f2 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:53.896243 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-39900b5d-c98c-48fb-8d8d-abce80b7e3f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:53.901055 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 975/1944] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:53 2022] PUT /identity/v3/projects/12f35afdade74fbeaf350fd1d1d84abe/users/4d20573a6a4849a9992eb365bf4f3ea2/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:53.924212 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6a949-b474-42fd-92de-b3148566f685 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:53.924212 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6a949-b474-42fd-92de-b3148566f685 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:53.924212 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6a949-b474-42fd-92de-b3148566f685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:53.935239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39900b5d-c98c-48fb-8d8d-abce80b7e3f2 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:53.962290 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-b9f6a949-b474-42fd-92de-b3148566f685 None None] MFA Rules not processed for user `4d20573a6a4849a9992eb365bf4f3ea2`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:53.963992 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b9f6a949-b474-42fd-92de-b3148566f685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:54.013599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19510327-0db0-45f1-81fb-7da6015b9ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:54.014790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19510327-0db0-45f1-81fb-7da6015b9ab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:54.015077 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19510327-0db0-45f1-81fb-7da6015b9ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:54.015353 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19510327-0db0-45f1-81fb-7da6015b9ab3 admin admin] PATH_INFO: `/v3/projects/922f28262f1f4989945ae1384cbaa137` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:54.017441 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19510327-0db0-45f1-81fb-7da6015b9ab3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=922f28262f1f4989945ae1384cbaa137)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:54.020704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19510327-0db0-45f1-81fb-7da6015b9ab3 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:54.076965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 976/1945] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:53 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:54.082397 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6a949-b474-42fd-92de-b3148566f685 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:54.093524 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6a949-b474-42fd-92de-b3148566f685 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:54.098875 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5cb85c-c186-4e55-a06e-ec69a02057bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:54.099302 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cb85c-c186-4e55-a06e-ec69a02057bb admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:54.099587 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cb85c-c186-4e55-a06e-ec69a02057bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:54.099851 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5cb85c-c186-4e55-a06e-ec69a02057bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:54.100574 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5cb85c-c186-4e55-a06e-ec69a02057bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:54.102476 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5cb85c-c186-4e55-a06e-ec69a02057bb admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:54.118805 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:54.152627 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-19510327-0db0-45f1-81fb-7da6015b9ab3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '922f28262f1f4989945ae1384cbaa137', 'request_id': 'req-19510327-0db0-45f1-81fb-7da6015b9ab3'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:54.195912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 977/1946] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:23:54 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:23:54.198710 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5cb85c-c186-4e55-a06e-ec69a02057bb admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:54.210662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-19510327-0db0-45f1-81fb-7da6015b9ab3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '922f28262f1f4989945ae1384cbaa137', 'request_id': 'req-19510327-0db0-45f1-81fb-7da6015b9ab3'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:54.222908 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-19510327-0db0-45f1-81fb-7da6015b9ab3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '922f28262f1f4989945ae1384cbaa137', 'request_id': 'req-19510327-0db0-45f1-81fb-7da6015b9ab3'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:54.241612 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-19510327-0db0-45f1-81fb-7da6015b9ab3 admin admin] The token cache is being invalidate because project 922f28262f1f4989945ae1384cbaa137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:23:54.241944 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-19510327-0db0-45f1-81fb-7da6015b9ab3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:54.244226 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-19510327-0db0-45f1-81fb-7da6015b9ab3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:54.248374 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 970/1947] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:23:53 2022] DELETE /identity/v3/projects/922f28262f1f4989945ae1384cbaa137 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:54.254321 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cbc41-8523-4c04-90ab-62950da98c17 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:54.254721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cbc41-8523-4c04-90ab-62950da98c17 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:54.255224 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cbc41-8523-4c04-90ab-62950da98c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:54.282933 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-ae1cbc41-8523-4c04-90ab-62950da98c17 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:54.284211 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ae1cbc41-8523-4c04-90ab-62950da98c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:54.292932 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5cb85c-c186-4e55-a06e-ec69a02057bb admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:54.295404 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 971/1948] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:54.298422 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de657f6-7a80-4c1c-9b04-0d84acbd6faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:54.306285 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de657f6-7a80-4c1c-9b04-0d84acbd6faf admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:54.306285 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de657f6-7a80-4c1c-9b04-0d84acbd6faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:54.306285 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de657f6-7a80-4c1c-9b04-0d84acbd6faf admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:54.306285 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de657f6-7a80-4c1c-9b04-0d84acbd6faf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:54.306285 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de657f6-7a80-4c1c-9b04-0d84acbd6faf admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:54.308297 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a6bfa-fc57-492d-bb09-8f1374f631ce None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:54.308680 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a6bfa-fc57-492d-bb09-8f1374f631ce None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:54.309089 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a6bfa-fc57-492d-bb09-8f1374f631ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:54.331806 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-cd2a6bfa-fc57-492d-bb09-8f1374f631ce None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:54.333407 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-cd2a6bfa-fc57-492d-bb09-8f1374f631ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:54.348783 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 972/1949] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:23:54.352840 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a6bfa-fc57-492d-bb09-8f1374f631ce None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:54.366167 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a6bfa-fc57-492d-bb09-8f1374f631ce None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:54.371381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af5689-bbb2-41e4-b782-73b0c6a45ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:54.372313 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af5689-bbb2-41e4-b782-73b0c6a45ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:54.372705 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af5689-bbb2-41e4-b782-73b0c6a45ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:54.373232 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af5689-bbb2-41e4-b782-73b0c6a45ab6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:54.373920 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af5689-bbb2-41e4-b782-73b0c6a45ab6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:23:54.374234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af5689-bbb2-41e4-b782-73b0c6a45ab6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:54.375961 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50af5689-bbb2-41e4-b782-73b0c6a45ab6 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:54.385666 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 978/1950] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:23:54 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:23:54.387055 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de657f6-7a80-4c1c-9b04-0d84acbd6faf admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:54.388854 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6de657f6-7a80-4c1c-9b04-0d84acbd6faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:54.399083 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 973/1951] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:23:54.400511 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af5689-bbb2-41e4-b782-73b0c6a45ab6 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:54.405232 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de657f6-7a80-4c1c-9b04-0d84acbd6faf admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:54.411568 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359fc304-79fc-473e-8646-aa0cc063f5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:54.412534 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fc304-79fc-473e-8646-aa0cc063f5db admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:54.413029 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fc304-79fc-473e-8646-aa0cc063f5db admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:54.413307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359fc304-79fc-473e-8646-aa0cc063f5db admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:54.413983 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359fc304-79fc-473e-8646-aa0cc063f5db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:54.415899 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359fc304-79fc-473e-8646-aa0cc063f5db admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:54.434492 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af5689-bbb2-41e4-b782-73b0c6a45ab6 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:54.442336 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 979/1952] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:54.444261 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ea465-3f90-4751-87a7-0e6ee0c8b302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:54.447315 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ea465-3f90-4751-87a7-0e6ee0c8b302 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:54.447315 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ea465-3f90-4751-87a7-0e6ee0c8b302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:54.447315 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ea465-3f90-4751-87a7-0e6ee0c8b302 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:54.447315 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ea465-3f90-4751-87a7-0e6ee0c8b302 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:54.449069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359fc304-79fc-473e-8646-aa0cc063f5db admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:54.456265 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ea465-3f90-4751-87a7-0e6ee0c8b302 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:54.468400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359fc304-79fc-473e-8646-aa0cc063f5db admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:54.481640 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d7b69-5dde-4ff3-a274-97b44b36e7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:54.482558 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d7b69-5dde-4ff3-a274-97b44b36e7ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:54.483339 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d7b69-5dde-4ff3-a274-97b44b36e7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:54.483339 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2d7b69-5dde-4ff3-a274-97b44b36e7ab admin admin] PATH_INFO: `/v3/projects/dc1520865d2b41b292abdf37eb3f294e/users/1c708c73ba1a443389e6c239cd75c101/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:54.503877 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d7b69-5dde-4ff3-a274-97b44b36e7ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc1520865d2b41b292abdf37eb3f294e, user_id=1c708c73ba1a443389e6c239cd75c101, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:54.506759 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2d7b69-5dde-4ff3-a274-97b44b36e7ab admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:54.585057 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 974/1953] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:23:54 2022] POST /identity/v3/projects => generated 407 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:23:54.589259 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ea465-3f90-4751-87a7-0e6ee0c8b302 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:54.605393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 980/1954] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:54 2022] PUT /identity/v3/projects/dc1520865d2b41b292abdf37eb3f294e/users/1c708c73ba1a443389e6c239cd75c101/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:54.608873 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d7b69-5dde-4ff3-a274-97b44b36e7ab admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:54.647045 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:54.691045 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ea465-3f90-4751-87a7-0e6ee0c8b302 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:54.725472 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2d7b69-5dde-4ff3-a274-97b44b36e7ab admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:54.732944 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706378b2-9b00-4992-86ad-7d272681d7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:54.733831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706378b2-9b00-4992-86ad-7d272681d7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:54.734707 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706378b2-9b00-4992-86ad-7d272681d7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:54.736474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706378b2-9b00-4992-86ad-7d272681d7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:54.736474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706378b2-9b00-4992-86ad-7d272681d7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:54.739403 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706378b2-9b00-4992-86ad-7d272681d7d0 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:54.758573 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 981/1955] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:54.758915 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706378b2-9b00-4992-86ad-7d272681d7d0 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:54.774567 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4a9cc-2f64-481e-9b07-6dcdedf62e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:54.775198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4a9cc-2f64-481e-9b07-6dcdedf62e47 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:54.775484 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4a9cc-2f64-481e-9b07-6dcdedf62e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:54.775765 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4a9cc-2f64-481e-9b07-6dcdedf62e47 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:54.776451 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4a9cc-2f64-481e-9b07-6dcdedf62e47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:54.777708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706378b2-9b00-4992-86ad-7d272681d7d0 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:54.778753 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4a9cc-2f64-481e-9b07-6dcdedf62e47 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:54.783584 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a959268-f8be-46ec-b1ac-96197e99de9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:54.784330 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a959268-f8be-46ec-b1ac-96197e99de9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:54.794120 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a959268-f8be-46ec-b1ac-96197e99de9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:54.794120 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a959268-f8be-46ec-b1ac-96197e99de9a admin admin] PATH_INFO: `/v3/projects/dc1520865d2b41b292abdf37eb3f294e/users/1c708c73ba1a443389e6c239cd75c101/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:54.794120 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a959268-f8be-46ec-b1ac-96197e99de9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc1520865d2b41b292abdf37eb3f294e, user_id=1c708c73ba1a443389e6c239cd75c101, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:54.794120 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a959268-f8be-46ec-b1ac-96197e99de9a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:54.804263 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 982/1956] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:54 2022] PUT /identity/v3/projects/dc1520865d2b41b292abdf37eb3f294e/users/1c708c73ba1a443389e6c239cd75c101/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:54.816913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0904780-0c14-4639-ac18-17b511d327a9 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:54.817206 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0904780-0c14-4639-ac18-17b511d327a9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:54.822587 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0904780-0c14-4639-ac18-17b511d327a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:54.852607 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f0904780-0c14-4639-ac18-17b511d327a9 None None] MFA Rules not processed for user `1c708c73ba1a443389e6c239cd75c101`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:54.854570 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f0904780-0c14-4639-ac18-17b511d327a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:54.864800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 975/1957] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:23:54 2022] POST /identity/v3/users => generated 304 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:54.869119 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4a9cc-2f64-481e-9b07-6dcdedf62e47 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:54.883563 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4a9cc-2f64-481e-9b07-6dcdedf62e47 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:54.889356 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:54.952578 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7972fc-d71f-47c0-b496-d6bb4212addb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:54.953314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7972fc-d71f-47c0-b496-d6bb4212addb admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:54.953677 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7972fc-d71f-47c0-b496-d6bb4212addb admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:54.954222 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7972fc-d71f-47c0-b496-d6bb4212addb admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:54.955019 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7972fc-d71f-47c0-b496-d6bb4212addb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:54.957115 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7972fc-d71f-47c0-b496-d6bb4212addb admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:54.967972 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 983/1958] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:23:54.970889 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 976/1959] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:54.974039 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7972fc-d71f-47c0-b496-d6bb4212addb admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:54.980001 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0904780-0c14-4639-ac18-17b511d327a9 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:54.981574 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f0904780-0c14-4639-ac18-17b511d327a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:54.984958 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7972fc-d71f-47c0-b496-d6bb4212addb admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:54.993600 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5dcf69-9a63-4245-8b3e-883b9c481e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:54.995429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dcf69-9a63-4245-8b3e-883b9c481e9e admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:54.996648 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dcf69-9a63-4245-8b3e-883b9c481e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:54.996780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5dcf69-9a63-4245-8b3e-883b9c481e9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:54.997409 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5dcf69-9a63-4245-8b3e-883b9c481e9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:54.999575 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5dcf69-9a63-4245-8b3e-883b9c481e9e admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:55.013945 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 977/1960] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:55.018226 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5dcf69-9a63-4245-8b3e-883b9c481e9e admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:55.032486 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5dcf69-9a63-4245-8b3e-883b9c481e9e admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:55.042313 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4befa085-b44c-4a86-937d-f326373c66db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:55.043148 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befa085-b44c-4a86-937d-f326373c66db admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:55.043708 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befa085-b44c-4a86-937d-f326373c66db admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:55.043994 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4befa085-b44c-4a86-937d-f326373c66db admin admin] PATH_INFO: `/v3/projects/a6435f0a400c4e64a882597dbcc9e194/users/5ae215038f71492fa51a0a26f73fd9ae/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:55.076384 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4befa085-b44c-4a86-937d-f326373c66db admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6435f0a400c4e64a882597dbcc9e194, user_id=5ae215038f71492fa51a0a26f73fd9ae, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:55.088464 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4befa085-b44c-4a86-937d-f326373c66db admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:55.090320 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0904780-0c14-4639-ac18-17b511d327a9 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:55.100866 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8093fa-2b0d-4395-ac73-ff65568e5f11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:55.103799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8093fa-2b0d-4395-ac73-ff65568e5f11 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:55.104320 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8093fa-2b0d-4395-ac73-ff65568e5f11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:55.104746 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8093fa-2b0d-4395-ac73-ff65568e5f11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:55.116547 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8093fa-2b0d-4395-ac73-ff65568e5f11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:55.124057 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8093fa-2b0d-4395-ac73-ff65568e5f11 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:55.140550 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 984/1961] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:23:55.186142 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 978/1962] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:55 2022] PUT /identity/v3/projects/a6435f0a400c4e64a882597dbcc9e194/users/5ae215038f71492fa51a0a26f73fd9ae/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:55.200066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86adb9-0b93-4e1d-ab7e-95b188f686eb None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:55.200478 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86adb9-0b93-4e1d-ab7e-95b188f686eb None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:55.200943 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86adb9-0b93-4e1d-ab7e-95b188f686eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:55.230516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-1e86adb9-0b93-4e1d-ab7e-95b188f686eb None None] MFA Rules not processed for user `5ae215038f71492fa51a0a26f73fd9ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:55.231729 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1e86adb9-0b93-4e1d-ab7e-95b188f686eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:55.321819 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 985/1963] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:55 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:55.323189 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4befa085-b44c-4a86-937d-f326373c66db admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:55.360835 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:55.418525 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4befa085-b44c-4a86-937d-f326373c66db admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:55.424397 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13deac-f394-4911-9e8b-731512a23f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:55.425414 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13deac-f394-4911-9e8b-731512a23f11 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:55.425683 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13deac-f394-4911-9e8b-731512a23f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:55.426198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13deac-f394-4911-9e8b-731512a23f11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:55.427197 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13deac-f394-4911-9e8b-731512a23f11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:55.429259 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13deac-f394-4911-9e8b-731512a23f11 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:55.543319 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 979/1964] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:23:55 2022] POST /identity/v3/projects => generated 409 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:55.546109 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86adb9-0b93-4e1d-ab7e-95b188f686eb None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:55.564691 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e86adb9-0b93-4e1d-ab7e-95b188f686eb None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:55.620905 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:55.636141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a1fc8-5fee-46e1-9769-a2bc3f78461c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:55.640630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a1fc8-5fee-46e1-9769-a2bc3f78461c admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:55.640929 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a1fc8-5fee-46e1-9769-a2bc3f78461c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:55.641213 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a1fc8-5fee-46e1-9769-a2bc3f78461c admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:55.642568 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a1fc8-5fee-46e1-9769-a2bc3f78461c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:55.644738 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726a1fc8-5fee-46e1-9769-a2bc3f78461c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:55.748399 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 986/1965] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:23:55 2022] POST /identity/v3/users => generated 311 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:23:55.753252 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13deac-f394-4911-9e8b-731512a23f11 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:55.766673 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13deac-f394-4911-9e8b-731512a23f11 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:55.771713 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b600bc-f82c-4982-ad46-a8bfb2ab3d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:55.772605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b600bc-f82c-4982-ad46-a8bfb2ab3d4e admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:55.772730 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b600bc-f82c-4982-ad46-a8bfb2ab3d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:55.773010 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b600bc-f82c-4982-ad46-a8bfb2ab3d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:55.773665 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b600bc-f82c-4982-ad46-a8bfb2ab3d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:55.775289 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b600bc-f82c-4982-ad46-a8bfb2ab3d4e admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:55.789770 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 980/1966] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:23:55.794586 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a1fc8-5fee-46e1-9769-a2bc3f78461c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:55.814966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a1fc8-5fee-46e1-9769-a2bc3f78461c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:55.825185 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259ef11-7d3e-479c-be8a-a47722755ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:55.826033 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259ef11-7d3e-479c-be8a-a47722755ac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:55.826413 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259ef11-7d3e-479c-be8a-a47722755ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:55.826811 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259ef11-7d3e-479c-be8a-a47722755ac3 admin admin] PATH_INFO: `/v3/projects/cfe41c01821f4c429a5e2d1476b65aef/users/4466c1861d9741578b21542be985205c/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:55.850634 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e259ef11-7d3e-479c-be8a-a47722755ac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfe41c01821f4c429a5e2d1476b65aef, user_id=4466c1861d9741578b21542be985205c, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:55.853888 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e259ef11-7d3e-479c-be8a-a47722755ac3 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:55.947518 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 987/1967] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:55 2022] PUT /identity/v3/projects/cfe41c01821f4c429a5e2d1476b65aef/users/4466c1861d9741578b21542be985205c/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:55.953667 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b600bc-f82c-4982-ad46-a8bfb2ab3d4e admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:55.964537 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b600bc-f82c-4982-ad46-a8bfb2ab3d4e admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:56.034772 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631aad4-ad85-41d6-aca3-3d79697db4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:56.035539 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631aad4-ad85-41d6-aca3-3d79697db4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:56.035822 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631aad4-ad85-41d6-aca3-3d79697db4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:56.036263 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631aad4-ad85-41d6-aca3-3d79697db4c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:56.037021 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631aad4-ad85-41d6-aca3-3d79697db4c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:56.038733 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631aad4-ad85-41d6-aca3-3d79697db4c9 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:56.052053 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 981/1968] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:55 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:23:56.057160 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259ef11-7d3e-479c-be8a-a47722755ac3 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:56.069374 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259ef11-7d3e-479c-be8a-a47722755ac3 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:56.074886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5e712-b834-4869-b538-7ff13e4d7334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:56.075757 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5e712-b834-4869-b538-7ff13e4d7334 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:56.076038 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5e712-b834-4869-b538-7ff13e4d7334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:56.076417 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5e712-b834-4869-b538-7ff13e4d7334 admin admin] PATH_INFO: `/v3/projects/cfe41c01821f4c429a5e2d1476b65aef/users/4466c1861d9741578b21542be985205c/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:56.078978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5e712-b834-4869-b538-7ff13e4d7334 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfe41c01821f4c429a5e2d1476b65aef, user_id=4466c1861d9741578b21542be985205c, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:56.081451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5e712-b834-4869-b538-7ff13e4d7334 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:56.097588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 988/1969] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:56 2022] PUT /identity/v3/projects/cfe41c01821f4c429a5e2d1476b65aef/users/4466c1861d9741578b21542be985205c/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:23:56.106689 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f6b14-8902-47cf-a2d4-4ada423f0a58 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:56.106983 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f6b14-8902-47cf-a2d4-4ada423f0a58 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:56.107264 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628f6b14-8902-47cf-a2d4-4ada423f0a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:56.137449 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-628f6b14-8902-47cf-a2d4-4ada423f0a58 None None] MFA Rules not processed for user `4466c1861d9741578b21542be985205c`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:56.139215 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-628f6b14-8902-47cf-a2d4-4ada423f0a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:56.229214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 982/1970] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:56 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:56.240568 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5e712-b834-4869-b538-7ff13e4d7334 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:56.387898 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5e712-b834-4869-b538-7ff13e4d7334 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:56.401524 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1443ba7-9785-44c9-a4d4-5abaae132a23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:56.402425 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1443ba7-9785-44c9-a4d4-5abaae132a23 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:56.403172 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1443ba7-9785-44c9-a4d4-5abaae132a23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:56.403604 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1443ba7-9785-44c9-a4d4-5abaae132a23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:56.417240 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1443ba7-9785-44c9-a4d4-5abaae132a23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:56.418794 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1443ba7-9785-44c9-a4d4-5abaae132a23 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:56.441116 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 989/1971] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:56 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:23:56.731212 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f6b14-8902-47cf-a2d4-4ada423f0a58 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:56.749520 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:56.809514 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628f6b14-8902-47cf-a2d4-4ada423f0a58 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:56.818183 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649af0e7-7772-43c9-a754-95cc7f458c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:56.818183 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649af0e7-7772-43c9-a754-95cc7f458c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:56.818183 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649af0e7-7772-43c9-a754-95cc7f458c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:56.818183 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649af0e7-7772-43c9-a754-95cc7f458c56 admin admin] PATH_INFO: `/v3/users/4d20573a6a4849a9992eb365bf4f3ea2` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:56.820238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649af0e7-7772-43c9-a754-95cc7f458c56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d20573a6a4849a9992eb365bf4f3ea2)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:56.822443 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649af0e7-7772-43c9-a754-95cc7f458c56 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:56.886693 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1443ba7-9785-44c9-a4d4-5abaae132a23 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:56.888504 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d1443ba7-9785-44c9-a4d4-5abaae132a23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:56.899375 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1443ba7-9785-44c9-a4d4-5abaae132a23 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:56.903061 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4faca0-d916-449f-8a69-a1a112525018 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:56.903661 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4faca0-d916-449f-8a69-a1a112525018 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:56.903945 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4faca0-d916-449f-8a69-a1a112525018 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:56.904269 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4faca0-d916-449f-8a69-a1a112525018 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:56.963416 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4faca0-d916-449f-8a69-a1a112525018 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:56.964886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4faca0-d916-449f-8a69-a1a112525018 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:56.975085 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 990/1972] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:56 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:23:57.017532 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-649af0e7-7772-43c9-a754-95cc7f458c56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d20573a6a4849a9992eb365bf4f3ea2'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:57.051323 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e80aa6-9d9b-4098-86d8-6cfa06006ff6 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:57.052769 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e80aa6-9d9b-4098-86d8-6cfa06006ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:57.057673 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e80aa6-9d9b-4098-86d8-6cfa06006ff6 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:57.057673 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 991/1973] 10.222.0.81 () {54 vars in 921 bytes} [Tue Sep 6 21:23:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 06 21:23:57.067795 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfa744-dacc-4e36-a28b-2c244814e3df None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:57.068090 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfa744-dacc-4e36-a28b-2c244814e3df None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:57.068406 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfa744-dacc-4e36-a28b-2c244814e3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:57.091446 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-0dbfa744-dacc-4e36-a28b-2c244814e3df None None] MFA Rules not processed for user `c3295306746f4552837f1bb12b2c500f`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:57.093382 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0dbfa744-dacc-4e36-a28b-2c244814e3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:57.106415 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-649af0e7-7772-43c9-a754-95cc7f458c56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d20573a6a4849a9992eb365bf4f3ea2'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:57.146007 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-649af0e7-7772-43c9-a754-95cc7f458c56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d20573a6a4849a9992eb365bf4f3ea2'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:57.146007 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-649af0e7-7772-43c9-a754-95cc7f458c56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d20573a6a4849a9992eb365bf4f3ea2'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:57.153176 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-649af0e7-7772-43c9-a754-95cc7f458c56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d20573a6a4849a9992eb365bf4f3ea2'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:57.160809 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 983/1974] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:23:56 2022] DELETE /identity/v3/users/4d20573a6a4849a9992eb365bf4f3ea2 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:57.164948 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598655ec-042f-4e4a-8680-8d2539d72666 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:57.165305 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598655ec-042f-4e4a-8680-8d2539d72666 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:57.165579 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598655ec-042f-4e4a-8680-8d2539d72666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:57.179175 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:57.185745 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-598655ec-042f-4e4a-8680-8d2539d72666 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:57.186973 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-598655ec-042f-4e4a-8680-8d2539d72666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:57.205810 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 992/1975] 10.222.0.81 () {58 vars in 1018 bytes} [Tue Sep 6 21:23:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:23:57.216540 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfa744-dacc-4e36-a28b-2c244814e3df None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:57.218050 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0dbfa744-dacc-4e36-a28b-2c244814e3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:57.241651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfa744-dacc-4e36-a28b-2c244814e3df None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:57.286114 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 984/1976] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:57.290352 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598655ec-042f-4e4a-8680-8d2539d72666 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:57.291739 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-598655ec-042f-4e4a-8680-8d2539d72666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:57.304066 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598655ec-042f-4e4a-8680-8d2539d72666 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:57.309555 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748c2dc-6818-4fb7-bb5b-7fa85b271ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:57.310236 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748c2dc-6818-4fb7-bb5b-7fa85b271ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:57.312150 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748c2dc-6818-4fb7-bb5b-7fa85b271ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:57.312150 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748c2dc-6818-4fb7-bb5b-7fa85b271ce4 admin admin] PATH_INFO: `/v3/users/c225198d426c46fd8f30afb37d753a3b` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:57.312150 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748c2dc-6818-4fb7-bb5b-7fa85b271ce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c225198d426c46fd8f30afb37d753a3b)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:57.314425 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc05f9-60e1-4196-84ad-ce5b859805f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3295306746f4552837f1bb12b2c500f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:57.314802 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748c2dc-6818-4fb7-bb5b-7fa85b271ce4 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:57.314997 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc05f9-60e1-4196-84ad-ce5b859805f7 service placement] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:57.315274 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc05f9-60e1-4196-84ad-ce5b859805f7 service placement] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:57.315655 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc05f9-60e1-4196-84ad-ce5b859805f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:57.324816 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc05f9-60e1-4196-84ad-ce5b859805f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:57.326744 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc05f9-60e1-4196-84ad-ce5b859805f7 service placement] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:57.347883 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 993/1977] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:23:57.348737 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc05f9-60e1-4196-84ad-ce5b859805f7 service placement] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:57.360350 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c8cc05f9-60e1-4196-84ad-ce5b859805f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:57.424275 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc05f9-60e1-4196-84ad-ce5b859805f7 service placement] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:57.428027 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab85b8-9a41-49e4-a329-117ff092d99a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:57.429278 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab85b8-9a41-49e4-a329-117ff092d99a service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:57.429278 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab85b8-9a41-49e4-a329-117ff092d99a service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:57.429278 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab85b8-9a41-49e4-a329-117ff092d99a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:57.438685 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab85b8-9a41-49e4-a329-117ff092d99a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:57.440122 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab85b8-9a41-49e4-a329-117ff092d99a service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:57.449995 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 994/1978] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:23:57.491817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6748c2dc-6818-4fb7-bb5b-7fa85b271ce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c225198d426c46fd8f30afb37d753a3b'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:57.598573 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:57.603049 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6748c2dc-6818-4fb7-bb5b-7fa85b271ce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c225198d426c46fd8f30afb37d753a3b'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:57.613809 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6748c2dc-6818-4fb7-bb5b-7fa85b271ce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c225198d426c46fd8f30afb37d753a3b'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:57.614503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6748c2dc-6818-4fb7-bb5b-7fa85b271ce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c225198d426c46fd8f30afb37d753a3b'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:57.621401 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6748c2dc-6818-4fb7-bb5b-7fa85b271ce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c225198d426c46fd8f30afb37d753a3b'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:57.628528 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 985/1979] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:23:57 2022] DELETE /identity/v3/users/c225198d426c46fd8f30afb37d753a3b => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:57.891557 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab85b8-9a41-49e4-a329-117ff092d99a service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:57.903113 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab85b8-9a41-49e4-a329-117ff092d99a service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:57.933725 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748c2dc-6818-4fb7-bb5b-7fa85b271ce4 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:57.936591 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6748c2dc-6818-4fb7-bb5b-7fa85b271ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:57.977402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f9616e-ff63-4a24-b473-6accae567070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:57.978108 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9616e-ff63-4a24-b473-6accae567070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:57.978443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9616e-ff63-4a24-b473-6accae567070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:57.978773 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9616e-ff63-4a24-b473-6accae567070 admin admin] PATH_INFO: `/v3/projects/97fb647ae3424cbe820eaf015be7e7d2` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:57.980137 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9616e-ff63-4a24-b473-6accae567070 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97fb647ae3424cbe820eaf015be7e7d2)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:57.982443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f9616e-ff63-4a24-b473-6accae567070 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:58.004461 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:58.025414 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748c2dc-6818-4fb7-bb5b-7fa85b271ce4 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:58.030076 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81667f44-36b2-4a7f-9c4b-1d492af66323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:58.030740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81667f44-36b2-4a7f-9c4b-1d492af66323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:58.031020 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81667f44-36b2-4a7f-9c4b-1d492af66323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:58.031295 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81667f44-36b2-4a7f-9c4b-1d492af66323 admin admin] PATH_INFO: `/v3/projects/12f35afdade74fbeaf350fd1d1d84abe` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:58.032600 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81667f44-36b2-4a7f-9c4b-1d492af66323 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12f35afdade74fbeaf350fd1d1d84abe)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:58.034565 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81667f44-36b2-4a7f-9c4b-1d492af66323 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:58.079591 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f9f9616e-ff63-4a24-b473-6accae567070 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97fb647ae3424cbe820eaf015be7e7d2', 'request_id': 'req-f9f9616e-ff63-4a24-b473-6accae567070'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:58.085188 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f9f9616e-ff63-4a24-b473-6accae567070 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97fb647ae3424cbe820eaf015be7e7d2', 'request_id': 'req-f9f9616e-ff63-4a24-b473-6accae567070'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:58.091301 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f9f9616e-ff63-4a24-b473-6accae567070 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97fb647ae3424cbe820eaf015be7e7d2', 'request_id': 'req-f9f9616e-ff63-4a24-b473-6accae567070'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:58.130637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-81667f44-36b2-4a7f-9c4b-1d492af66323 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12f35afdade74fbeaf350fd1d1d84abe', 'request_id': 'req-81667f44-36b2-4a7f-9c4b-1d492af66323'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:58.145762 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f9f9616e-ff63-4a24-b473-6accae567070 admin admin] The token cache is being invalidate because project 97fb647ae3424cbe820eaf015be7e7d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:23:58.146055 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f9f9616e-ff63-4a24-b473-6accae567070 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:58.146751 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f9f9616e-ff63-4a24-b473-6accae567070 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:58.148279 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 995/1980] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:23:57 2022] DELETE /identity/v3/projects/97fb647ae3424cbe820eaf015be7e7d2 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:58.153278 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd6950-1092-4fce-bb60-406a4792e84e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:58.153636 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd6950-1092-4fce-bb60-406a4792e84e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:58.153916 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd6950-1092-4fce-bb60-406a4792e84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:58.174127 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-77dd6950-1092-4fce-bb60-406a4792e84e None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:58.175331 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-77dd6950-1092-4fce-bb60-406a4792e84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:58.237682 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-81667f44-36b2-4a7f-9c4b-1d492af66323 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12f35afdade74fbeaf350fd1d1d84abe', 'request_id': 'req-81667f44-36b2-4a7f-9c4b-1d492af66323'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:58.238111 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 996/1981] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:23:58.245777 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fc07a-8f21-4b31-9180-d89041f07385 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:58.246268 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fc07a-8f21-4b31-9180-d89041f07385 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:58.249329 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634fc07a-8f21-4b31-9180-d89041f07385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:58.250823 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-81667f44-36b2-4a7f-9c4b-1d492af66323 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12f35afdade74fbeaf350fd1d1d84abe', 'request_id': 'req-81667f44-36b2-4a7f-9c4b-1d492af66323'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:58.263419 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-81667f44-36b2-4a7f-9c4b-1d492af66323 admin admin] The token cache is being invalidate because project 12f35afdade74fbeaf350fd1d1d84abe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:23:58.263719 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-81667f44-36b2-4a7f-9c4b-1d492af66323 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:58.264434 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-81667f44-36b2-4a7f-9c4b-1d492af66323 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:58.266295 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 986/1982] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:23:57 2022] DELETE /identity/v3/projects/12f35afdade74fbeaf350fd1d1d84abe => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:58.272743 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81667f44-36b2-4a7f-9c4b-1d492af66323 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:58.274373 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-81667f44-36b2-4a7f-9c4b-1d492af66323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:58.274945 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-634fc07a-8f21-4b31-9180-d89041f07385 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:58.276618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-634fc07a-8f21-4b31-9180-d89041f07385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:58.287330 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 997/1983] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:23:58.291703 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634fc07a-8f21-4b31-9180-d89041f07385 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:58.293367 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81667f44-36b2-4a7f-9c4b-1d492af66323 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:58.301245 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8a308-81d7-4ab3-8ee2-357ced91cf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:58.301939 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634fc07a-8f21-4b31-9180-d89041f07385 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:58.302285 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8a308-81d7-4ab3-8ee2-357ced91cf61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:58.302811 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8a308-81d7-4ab3-8ee2-357ced91cf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:58.303230 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8a308-81d7-4ab3-8ee2-357ced91cf61 admin admin] PATH_INFO: `/v3/users/1c708c73ba1a443389e6c239cd75c101` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:58.304593 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8a308-81d7-4ab3-8ee2-357ced91cf61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c708c73ba1a443389e6c239cd75c101)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:58.306684 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8a308-81d7-4ab3-8ee2-357ced91cf61 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:58.306824 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015e9bc-0d23-48d4-9ec6-dbdf411332c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:58.307479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015e9bc-0d23-48d4-9ec6-dbdf411332c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:58.307822 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015e9bc-0d23-48d4-9ec6-dbdf411332c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:58.308210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015e9bc-0d23-48d4-9ec6-dbdf411332c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:58.308925 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015e9bc-0d23-48d4-9ec6-dbdf411332c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:23:58.309289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015e9bc-0d23-48d4-9ec6-dbdf411332c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:58.311116 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015e9bc-0d23-48d4-9ec6-dbdf411332c0 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:58.328210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 998/1984] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:23:58.333712 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015e9bc-0d23-48d4-9ec6-dbdf411332c0 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:58.346649 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015e9bc-0d23-48d4-9ec6-dbdf411332c0 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:58.353866 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f951087-86a9-43de-b73b-98a86e571df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:58.355426 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f951087-86a9-43de-b73b-98a86e571df8 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:58.355719 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f951087-86a9-43de-b73b-98a86e571df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:58.355999 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f951087-86a9-43de-b73b-98a86e571df8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:58.356749 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f951087-86a9-43de-b73b-98a86e571df8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:58.362184 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f951087-86a9-43de-b73b-98a86e571df8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:58.465455 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 999/1985] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:23:58 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:58.466492 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f951087-86a9-43de-b73b-98a86e571df8 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:58.473921 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:58.489255 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-bfe8a308-81d7-4ab3-8ee2-357ced91cf61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c708c73ba1a443389e6c239cd75c101'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:58.533129 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f951087-86a9-43de-b73b-98a86e571df8 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:58.537828 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03699d87-78c1-45a6-88e6-2bb007e8dce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:58.538440 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03699d87-78c1-45a6-88e6-2bb007e8dce4 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:58.538721 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03699d87-78c1-45a6-88e6-2bb007e8dce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:58.542840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03699d87-78c1-45a6-88e6-2bb007e8dce4 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:58.543500 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03699d87-78c1-45a6-88e6-2bb007e8dce4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:58.543775 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-bfe8a308-81d7-4ab3-8ee2-357ced91cf61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c708c73ba1a443389e6c239cd75c101'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:58.545703 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03699d87-78c1-45a6-88e6-2bb007e8dce4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:58.555298 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:58.559292 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-bfe8a308-81d7-4ab3-8ee2-357ced91cf61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c708c73ba1a443389e6c239cd75c101'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:58.560364 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-bfe8a308-81d7-4ab3-8ee2-357ced91cf61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c708c73ba1a443389e6c239cd75c101'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:58.567134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-bfe8a308-81d7-4ab3-8ee2-357ced91cf61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c708c73ba1a443389e6c239cd75c101'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:58.573177 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 987/1986] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:23:58 2022] DELETE /identity/v3/users/1c708c73ba1a443389e6c239cd75c101 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:23:58.658556 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1000/1987] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:23:58 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:23:58.660456 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8a308-81d7-4ab3-8ee2-357ced91cf61 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:58.662181 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-bfe8a308-81d7-4ab3-8ee2-357ced91cf61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:58.736360 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8a308-81d7-4ab3-8ee2-357ced91cf61 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:58.742443 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f7116-50d7-416b-93d1-089eb68bb14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:58.743076 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f7116-50d7-416b-93d1-089eb68bb14c admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:58.743359 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f7116-50d7-416b-93d1-089eb68bb14c admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:58.743630 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f7116-50d7-416b-93d1-089eb68bb14c admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:58.744438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f7116-50d7-416b-93d1-089eb68bb14c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:58.746684 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f7116-50d7-416b-93d1-089eb68bb14c admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:58.758902 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 988/1988] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:58.763174 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03699d87-78c1-45a6-88e6-2bb007e8dce4 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:58.773992 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03699d87-78c1-45a6-88e6-2bb007e8dce4 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:58.779116 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c600b7-4553-40e3-8537-6b42fbe72963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:58.787369 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c600b7-4553-40e3-8537-6b42fbe72963 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:58.787369 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c600b7-4553-40e3-8537-6b42fbe72963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:58.787369 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c600b7-4553-40e3-8537-6b42fbe72963 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:58.787369 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c600b7-4553-40e3-8537-6b42fbe72963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:58.787369 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c600b7-4553-40e3-8537-6b42fbe72963 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:58.795552 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1001/1989] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:58.800330 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f7116-50d7-416b-93d1-089eb68bb14c admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:58.812794 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f7116-50d7-416b-93d1-089eb68bb14c admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:58.818720 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80e946-b44a-41c6-812d-4933876ba6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:58.819634 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80e946-b44a-41c6-812d-4933876ba6a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:58.820370 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80e946-b44a-41c6-812d-4933876ba6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:58.820592 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb80e946-b44a-41c6-812d-4933876ba6a5 admin admin] PATH_INFO: `/v3/projects/38a132d7bd744c23b2aaaa1bf07c4963/users/091e1a1eb9f243a5af0f1b9a5489b5cd/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:58.838964 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80e946-b44a-41c6-812d-4933876ba6a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38a132d7bd744c23b2aaaa1bf07c4963, user_id=091e1a1eb9f243a5af0f1b9a5489b5cd, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:58.842543 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb80e946-b44a-41c6-812d-4933876ba6a5 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:58.912763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 989/1990] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:58 2022] PUT /identity/v3/projects/38a132d7bd744c23b2aaaa1bf07c4963/users/091e1a1eb9f243a5af0f1b9a5489b5cd/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:58.925042 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142303bd-b8d3-4843-8ea8-236fb6a625cb None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:58.925042 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142303bd-b8d3-4843-8ea8-236fb6a625cb None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:58.925042 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142303bd-b8d3-4843-8ea8-236fb6a625cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:58.954868 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-142303bd-b8d3-4843-8ea8-236fb6a625cb None None] MFA Rules not processed for user `091e1a1eb9f243a5af0f1b9a5489b5cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:58.956056 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-142303bd-b8d3-4843-8ea8-236fb6a625cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:58.973342 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80e946-b44a-41c6-812d-4933876ba6a5 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:58.975200 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-eb80e946-b44a-41c6-812d-4933876ba6a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:59.030626 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1002/1991] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:59.035559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142303bd-b8d3-4843-8ea8-236fb6a625cb None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:59.049570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb80e946-b44a-41c6-812d-4933876ba6a5 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:59.054242 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac376e7-963d-41a4-8ca4-686031ad4123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:59.054878 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac376e7-963d-41a4-8ca4-686031ad4123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:59.055155 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac376e7-963d-41a4-8ca4-686031ad4123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:59.055438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac376e7-963d-41a4-8ca4-686031ad4123 admin admin] PATH_INFO: `/v3/projects/dc1520865d2b41b292abdf37eb3f294e` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:59.056610 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac376e7-963d-41a4-8ca4-686031ad4123 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc1520865d2b41b292abdf37eb3f294e)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:59.058541 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac376e7-963d-41a4-8ca4-686031ad4123 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:59.102826 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142303bd-b8d3-4843-8ea8-236fb6a625cb None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:59.107642 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2e79b-d424-4150-a98a-40bcb6875433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:59.108288 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2e79b-d424-4150-a98a-40bcb6875433 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:59.108575 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2e79b-d424-4150-a98a-40bcb6875433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:59.108850 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2e79b-d424-4150-a98a-40bcb6875433 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:59.109490 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2e79b-d424-4150-a98a-40bcb6875433 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:59.111630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe2e79b-d424-4150-a98a-40bcb6875433 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:59.176206 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0ac376e7-963d-41a4-8ca4-686031ad4123 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc1520865d2b41b292abdf37eb3f294e', 'request_id': 'req-0ac376e7-963d-41a4-8ca4-686031ad4123'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:59.186729 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:59.239394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1003/1992] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:23:59 2022] POST /identity/v3/projects => generated 373 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:23:59.243392 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2e79b-d424-4150-a98a-40bcb6875433 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:59.272382 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0ac376e7-963d-41a4-8ca4-686031ad4123 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc1520865d2b41b292abdf37eb3f294e', 'request_id': 'req-0ac376e7-963d-41a4-8ca4-686031ad4123'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:59.278817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0ac376e7-963d-41a4-8ca4-686031ad4123 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc1520865d2b41b292abdf37eb3f294e', 'request_id': 'req-0ac376e7-963d-41a4-8ca4-686031ad4123'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:59.291555 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0ac376e7-963d-41a4-8ca4-686031ad4123 admin admin] The token cache is being invalidate because project dc1520865d2b41b292abdf37eb3f294e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:23:59.291853 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0ac376e7-963d-41a4-8ca4-686031ad4123 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:59.292730 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0ac376e7-963d-41a4-8ca4-686031ad4123 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:23:59.294707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 990/1993] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:23:58 2022] DELETE /identity/v3/projects/dc1520865d2b41b292abdf37eb3f294e => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:59.300388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009afc2-e888-4265-b186-f9629c42dad4 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:59.300682 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009afc2-e888-4265-b186-f9629c42dad4 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:59.305107 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009afc2-e888-4265-b186-f9629c42dad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:59.315235 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2e79b-d424-4150-a98a-40bcb6875433 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:59.320270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4eef7-e46e-4575-8c33-895624e5393b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:59.320939 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4eef7-e46e-4575-8c33-895624e5393b admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:59.321153 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4eef7-e46e-4575-8c33-895624e5393b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:59.321426 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc4eef7-e46e-4575-8c33-895624e5393b admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:59.322048 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc4eef7-e46e-4575-8c33-895624e5393b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:59.323947 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc4eef7-e46e-4575-8c33-895624e5393b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:59.326592 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-7009afc2-e888-4265-b186-f9629c42dad4 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:59.328309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7009afc2-e888-4265-b186-f9629c42dad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:59.337070 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 991/1994] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:23:59.345825 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10b382-fee3-4c5b-a999-607eccd47b2f None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:59.346126 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10b382-fee3-4c5b-a999-607eccd47b2f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:59.346384 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc10b382-fee3-4c5b-a999-607eccd47b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:59.358276 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:59.366246 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-cc10b382-fee3-4c5b-a999-607eccd47b2f None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:59.367609 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-cc10b382-fee3-4c5b-a999-607eccd47b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:59.376564 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 992/1995] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:23:59.380630 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10b382-fee3-4c5b-a999-607eccd47b2f None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:59.389364 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc10b382-fee3-4c5b-a999-607eccd47b2f None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:59.393953 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbddd36-5838-4462-a060-ae274c0e3642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:59.394530 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbddd36-5838-4462-a060-ae274c0e3642 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:59.394903 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbddd36-5838-4462-a060-ae274c0e3642 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:59.395207 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbddd36-5838-4462-a060-ae274c0e3642 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:59.395843 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbddd36-5838-4462-a060-ae274c0e3642 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:23:59.396180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbddd36-5838-4462-a060-ae274c0e3642 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:59.397767 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbddd36-5838-4462-a060-ae274c0e3642 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:59.410739 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 993/1996] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:23:59.413641 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbddd36-5838-4462-a060-ae274c0e3642 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:59.417602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1004/1997] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:23:59 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:23:59.423299 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4eef7-e46e-4575-8c33-895624e5393b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:59.424818 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbddd36-5838-4462-a060-ae274c0e3642 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:59.425976 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-dcc4eef7-e46e-4575-8c33-895624e5393b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:59.429563 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e366ea0-ef67-48ea-808a-63d09ca603c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:59.430244 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e366ea0-ef67-48ea-808a-63d09ca603c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:59.430532 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e366ea0-ef67-48ea-808a-63d09ca603c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:59.430808 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e366ea0-ef67-48ea-808a-63d09ca603c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:59.431500 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e366ea0-ef67-48ea-808a-63d09ca603c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:59.433455 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e366ea0-ef67-48ea-808a-63d09ca603c9 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:59.439377 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc4eef7-e46e-4575-8c33-895624e5393b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:59.448445 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede7ec9-f82f-4532-8bb5-1125cfe6e63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:59.449115 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede7ec9-f82f-4532-8bb5-1125cfe6e63d admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:59.449403 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede7ec9-f82f-4532-8bb5-1125cfe6e63d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:59.449683 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ede7ec9-f82f-4532-8bb5-1125cfe6e63d admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:59.450338 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede7ec9-f82f-4532-8bb5-1125cfe6e63d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:59.452060 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ede7ec9-f82f-4532-8bb5-1125cfe6e63d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:59.465567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1005/1998] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:23:59.469049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede7ec9-f82f-4532-8bb5-1125cfe6e63d admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:59.479104 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ede7ec9-f82f-4532-8bb5-1125cfe6e63d admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:59.484175 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457c18d-4c16-407d-8c5b-b904bdd957c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:59.484849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457c18d-4c16-407d-8c5b-b904bdd957c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:59.485631 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457c18d-4c16-407d-8c5b-b904bdd957c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:59.488315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457c18d-4c16-407d-8c5b-b904bdd957c2 admin admin] PATH_INFO: `/v3/projects/986086afb14245d3afc8f2799bf162fc/users/e1cbb1517e98482f88a0ad7a8e1f9234/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:59.501711 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457c18d-4c16-407d-8c5b-b904bdd957c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=986086afb14245d3afc8f2799bf162fc, user_id=e1cbb1517e98482f88a0ad7a8e1f9234, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:59.504397 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457c18d-4c16-407d-8c5b-b904bdd957c2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:59.546144 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 994/1999] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:23:59 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:23:59.547137 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e366ea0-ef67-48ea-808a-63d09ca603c9 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:59.613647 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e366ea0-ef67-48ea-808a-63d09ca603c9 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:59.619575 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1006/2000] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:59 2022] PUT /identity/v3/projects/986086afb14245d3afc8f2799bf162fc/users/e1cbb1517e98482f88a0ad7a8e1f9234/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:23:59.620741 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457c18d-4c16-407d-8c5b-b904bdd957c2 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:59.673539 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc2bc3-ebcd-40f6-8c8e-01d10a16d317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:59.674321 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc2bc3-ebcd-40f6-8c8e-01d10a16d317 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:59.674610 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc2bc3-ebcd-40f6-8c8e-01d10a16d317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:59.675113 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc2bc3-ebcd-40f6-8c8e-01d10a16d317 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:59.675663 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc2bc3-ebcd-40f6-8c8e-01d10a16d317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:59.677806 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bc2bc3-ebcd-40f6-8c8e-01d10a16d317 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:59.686169 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457c18d-4c16-407d-8c5b-b904bdd957c2 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:59.692055 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75f3b2-5150-4816-b4f9-fbb72314d544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:59.700647 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75f3b2-5150-4816-b4f9-fbb72314d544 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:59.700647 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75f3b2-5150-4816-b4f9-fbb72314d544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:59.700647 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75f3b2-5150-4816-b4f9-fbb72314d544 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:59.700647 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75f3b2-5150-4816-b4f9-fbb72314d544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:59.700647 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75f3b2-5150-4816-b4f9-fbb72314d544 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:59.709831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1007/2001] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:59.711002 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75f3b2-5150-4816-b4f9-fbb72314d544 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:59.720401 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75f3b2-5150-4816-b4f9-fbb72314d544 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:59.725073 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e495436-dc4f-4239-abc6-b2d497220a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:59.725694 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e495436-dc4f-4239-abc6-b2d497220a99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:59.725973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e495436-dc4f-4239-abc6-b2d497220a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:59.726249 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e495436-dc4f-4239-abc6-b2d497220a99 admin admin] PATH_INFO: `/v3/projects/986086afb14245d3afc8f2799bf162fc/users/e1cbb1517e98482f88a0ad7a8e1f9234/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:59.728401 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e495436-dc4f-4239-abc6-b2d497220a99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=986086afb14245d3afc8f2799bf162fc, user_id=e1cbb1517e98482f88a0ad7a8e1f9234, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:59.731039 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e495436-dc4f-4239-abc6-b2d497220a99 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:59.741359 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1008/2002] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:59 2022] PUT /identity/v3/projects/986086afb14245d3afc8f2799bf162fc/users/e1cbb1517e98482f88a0ad7a8e1f9234/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:23:59.760950 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c669f-2cb8-48d5-93b3-ef1cd35f4232 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:59.761240 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c669f-2cb8-48d5-93b3-ef1cd35f4232 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:59.761526 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c669f-2cb8-48d5-93b3-ef1cd35f4232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:59.783757 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 995/2003] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:23:59 2022] POST /identity/v3/users => generated 292 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:23:59.784893 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc2bc3-ebcd-40f6-8c8e-01d10a16d317 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:59.790909 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d01c669f-2cb8-48d5-93b3-ef1cd35f4232 None None] MFA Rules not processed for user `e1cbb1517e98482f88a0ad7a8e1f9234`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:23:59.792172 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d01c669f-2cb8-48d5-93b3-ef1cd35f4232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:59.795868 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bc2bc3-ebcd-40f6-8c8e-01d10a16d317 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:59.854262 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04e982-edd0-48b4-bf36-5a04ab1f12b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:59.854885 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04e982-edd0-48b4-bf36-5a04ab1f12b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:59.855170 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04e982-edd0-48b4-bf36-5a04ab1f12b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:59.855448 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe04e982-edd0-48b4-bf36-5a04ab1f12b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:59.856177 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04e982-edd0-48b4-bf36-5a04ab1f12b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:59.857786 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe04e982-edd0-48b4-bf36-5a04ab1f12b3 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:59.862615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1009/2004] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:23:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:23:59.868479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 996/2005] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:59.872383 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c669f-2cb8-48d5-93b3-ef1cd35f4232 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:59.878190 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04e982-edd0-48b4-bf36-5a04ab1f12b3 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:59.878190 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-fe04e982-edd0-48b4-bf36-5a04ab1f12b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:23:59.884312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c669f-2cb8-48d5-93b3-ef1cd35f4232 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:59.888931 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5b6ae-ed18-4c62-98e8-4c755cebae60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:59.889645 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5b6ae-ed18-4c62-98e8-4c755cebae60 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:59.889996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5b6ae-ed18-4c62-98e8-4c755cebae60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:59.890338 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f5b6ae-ed18-4c62-98e8-4c755cebae60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:59.891047 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5b6ae-ed18-4c62-98e8-4c755cebae60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:59.893526 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f5b6ae-ed18-4c62-98e8-4c755cebae60 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:59.904243 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1010/2006] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:23:59.908701 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5b6ae-ed18-4c62-98e8-4c755cebae60 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:23:59.910221 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:59.918949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f5b6ae-ed18-4c62-98e8-4c755cebae60 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:59.924082 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1061c25-4277-4901-9fc6-46d9185093db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:59.924786 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1061c25-4277-4901-9fc6-46d9185093db admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:59.925068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1061c25-4277-4901-9fc6-46d9185093db admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:59.925617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1061c25-4277-4901-9fc6-46d9185093db admin admin] PATH_INFO: `/v3/projects/7af22586fd39415489ada2ce44124042/users/479e6d6faf9a45668b3be64a6588ca13/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:59.927702 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:23:59.936572 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe04e982-edd0-48b4-bf36-5a04ab1f12b3 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:23:59.941065 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1061c25-4277-4901-9fc6-46d9185093db admin admin] RBAC: Authorizing `identity:create_grant(project_id=7af22586fd39415489ada2ce44124042, user_id=479e6d6faf9a45668b3be64a6588ca13, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:59.942469 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64ba73-80c7-44b2-ae87-00631039dd89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:23:59.943285 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64ba73-80c7-44b2-ae87-00631039dd89 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:23:59.943704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64ba73-80c7-44b2-ae87-00631039dd89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:23:59.943892 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1061c25-4277-4901-9fc6-46d9185093db admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:59.944139 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64ba73-80c7-44b2-ae87-00631039dd89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:23:59.954947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64ba73-80c7-44b2-ae87-00631039dd89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:23:59.961812 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64ba73-80c7-44b2-ae87-00631039dd89 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:23:59.968188 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 997/2007] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:23:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:24:00.050144 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1011/2008] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:23:59 2022] PUT /identity/v3/projects/7af22586fd39415489ada2ce44124042/users/479e6d6faf9a45668b3be64a6588ca13/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:24:00.060312 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5b9b9-3011-41a3-968f-59b9976b8338 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:00.060837 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5b9b9-3011-41a3-968f-59b9976b8338 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:00.060987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5b9b9-3011-41a3-968f-59b9976b8338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:00.096408 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-1fd5b9b9-3011-41a3-968f-59b9976b8338 None None] MFA Rules not processed for user `479e6d6faf9a45668b3be64a6588ca13`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:00.098175 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1fd5b9b9-3011-41a3-968f-59b9976b8338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:00.162606 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 998/2009] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:00.167091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1061c25-4277-4901-9fc6-46d9185093db admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:00.232651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1061c25-4277-4901-9fc6-46d9185093db admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:00.238036 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6075c8-49b4-4cd6-82e7-f77f370a56ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:00.238676 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6075c8-49b4-4cd6-82e7-f77f370a56ef admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:00.238960 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6075c8-49b4-4cd6-82e7-f77f370a56ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:00.239261 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6075c8-49b4-4cd6-82e7-f77f370a56ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:00.239892 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6075c8-49b4-4cd6-82e7-f77f370a56ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:00.241839 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6075c8-49b4-4cd6-82e7-f77f370a56ef admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:00.324527 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1012/2010] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:24:00 2022] POST /identity/v3/projects => generated 385 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:24:00.330376 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5b9b9-3011-41a3-968f-59b9976b8338 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:00.342091 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5b9b9-3011-41a3-968f-59b9976b8338 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:00.431989 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7ab4b-9a18-44d4-9764-f782563ec7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:00.432796 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7ab4b-9a18-44d4-9764-f782563ec7c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:00.433168 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7ab4b-9a18-44d4-9764-f782563ec7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:00.433599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da7ab4b-9a18-44d4-9764-f782563ec7c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:00.434347 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7ab4b-9a18-44d4-9764-f782563ec7c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:00.436425 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da7ab4b-9a18-44d4-9764-f782563ec7c0 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:00.551858 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 999/2011] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:24:00 2022] POST /identity/v3/users => generated 299 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:24:00.553299 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6075c8-49b4-4cd6-82e7-f77f370a56ef admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:00.564643 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6075c8-49b4-4cd6-82e7-f77f370a56ef admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:00.569254 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf20987-a6a2-4b81-97a7-8bb85a3b0b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:00.569889 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf20987-a6a2-4b81-97a7-8bb85a3b0b67 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:00.570165 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf20987-a6a2-4b81-97a7-8bb85a3b0b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:00.570436 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf20987-a6a2-4b81-97a7-8bb85a3b0b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:00.571073 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf20987-a6a2-4b81-97a7-8bb85a3b0b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:00.572682 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf20987-a6a2-4b81-97a7-8bb85a3b0b67 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:00.583314 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1013/2012] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:00.587461 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7ab4b-9a18-44d4-9764-f782563ec7c0 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:00.597729 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da7ab4b-9a18-44d4-9764-f782563ec7c0 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:00.602452 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ad71a-718a-437e-b705-a3e522411123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:00.603096 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ad71a-718a-437e-b705-a3e522411123 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:00.603377 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ad71a-718a-437e-b705-a3e522411123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:00.603650 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3ad71a-718a-437e-b705-a3e522411123 admin admin] PATH_INFO: `/v3/projects/5eabc0a621ad495cafa2240ed7277da3/users/9666cc40bce1473c9c991b71d4704ff0/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:00.618740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ad71a-718a-437e-b705-a3e522411123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eabc0a621ad495cafa2240ed7277da3, user_id=9666cc40bce1473c9c991b71d4704ff0, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:00.621439 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3ad71a-718a-437e-b705-a3e522411123 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:00.703728 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:00.720331 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1000/2013] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:24:00 2022] PUT /identity/v3/projects/5eabc0a621ad495cafa2240ed7277da3/users/9666cc40bce1473c9c991b71d4704ff0/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:24:00.722299 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf20987-a6a2-4b81-97a7-8bb85a3b0b67 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:00.739356 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf20987-a6a2-4b81-97a7-8bb85a3b0b67 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:00.824754 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac20e4a-73c3-4117-8a6f-eb6e547dab0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:00.825482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac20e4a-73c3-4117-8a6f-eb6e547dab0b admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:00.825798 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac20e4a-73c3-4117-8a6f-eb6e547dab0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:00.826073 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac20e4a-73c3-4117-8a6f-eb6e547dab0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:00.826719 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac20e4a-73c3-4117-8a6f-eb6e547dab0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:00.828372 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac20e4a-73c3-4117-8a6f-eb6e547dab0b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:00.841993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1014/2014] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:00.849148 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ad71a-718a-437e-b705-a3e522411123 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:00.854305 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3ad71a-718a-437e-b705-a3e522411123 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:00.859371 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a485b2-e991-4b44-a200-f9b6799249b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:00.860730 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a485b2-e991-4b44-a200-f9b6799249b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:00.862061 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a485b2-e991-4b44-a200-f9b6799249b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:00.862245 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a485b2-e991-4b44-a200-f9b6799249b0 admin admin] PATH_INFO: `/v3/projects/5eabc0a621ad495cafa2240ed7277da3/users/9666cc40bce1473c9c991b71d4704ff0/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:00.864163 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a485b2-e991-4b44-a200-f9b6799249b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eabc0a621ad495cafa2240ed7277da3, user_id=9666cc40bce1473c9c991b71d4704ff0, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:00.866885 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a485b2-e991-4b44-a200-f9b6799249b0 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:00.877779 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1001/2015] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:24:00 2022] PUT /identity/v3/projects/5eabc0a621ad495cafa2240ed7277da3/users/9666cc40bce1473c9c991b71d4704ff0/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:00.895819 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e484c75-8609-4c33-8361-55384a661284 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:00.895819 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e484c75-8609-4c33-8361-55384a661284 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:00.895819 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e484c75-8609-4c33-8361-55384a661284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:00.923170 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8e484c75-8609-4c33-8361-55384a661284 None None] MFA Rules not processed for user `9666cc40bce1473c9c991b71d4704ff0`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:00.924435 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8e484c75-8609-4c33-8361-55384a661284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:00.965268 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:00.991882 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1015/2016] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:00 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:01.002386 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a485b2-e991-4b44-a200-f9b6799249b0 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:01.057372 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a485b2-e991-4b44-a200-f9b6799249b0 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:01.061123 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad997b26-bb74-44e8-ba12-abc11cd45179 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:01.061726 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad997b26-bb74-44e8-ba12-abc11cd45179 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:01.062004 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad997b26-bb74-44e8-ba12-abc11cd45179 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:01.062274 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad997b26-bb74-44e8-ba12-abc11cd45179 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:01.127373 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad997b26-bb74-44e8-ba12-abc11cd45179 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:01.129040 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad997b26-bb74-44e8-ba12-abc11cd45179 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:01.138649 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1002/2017] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:24:01.300841 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e484c75-8609-4c33-8361-55384a661284 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:01.374475 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e484c75-8609-4c33-8361-55384a661284 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:01.380351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6032ae-4d90-448c-982f-110c39c1222a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:01.380993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6032ae-4d90-448c-982f-110c39c1222a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:01.381338 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6032ae-4d90-448c-982f-110c39c1222a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:01.381532 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6032ae-4d90-448c-982f-110c39c1222a admin admin] PATH_INFO: `/v3/users/091e1a1eb9f243a5af0f1b9a5489b5cd` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:01.382865 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6032ae-4d90-448c-982f-110c39c1222a admin admin] RBAC: Authorizing `identity:delete_user(user_id=091e1a1eb9f243a5af0f1b9a5489b5cd)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:01.384849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6032ae-4d90-448c-982f-110c39c1222a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:01.529167 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-fa6032ae-4d90-448c-982f-110c39c1222a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '091e1a1eb9f243a5af0f1b9a5489b5cd'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:01.592505 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-fa6032ae-4d90-448c-982f-110c39c1222a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '091e1a1eb9f243a5af0f1b9a5489b5cd'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:01.607567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-fa6032ae-4d90-448c-982f-110c39c1222a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '091e1a1eb9f243a5af0f1b9a5489b5cd'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:01.608302 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-fa6032ae-4d90-448c-982f-110c39c1222a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '091e1a1eb9f243a5af0f1b9a5489b5cd'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:01.616078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-fa6032ae-4d90-448c-982f-110c39c1222a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '091e1a1eb9f243a5af0f1b9a5489b5cd'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:01.622505 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1016/2018] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:24:01 2022] DELETE /identity/v3/users/091e1a1eb9f243a5af0f1b9a5489b5cd => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:01.627764 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da8f0f-d1bb-4d06-8187-1075e2df9f8a None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:01.628052 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da8f0f-d1bb-4d06-8187-1075e2df9f8a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:01.631180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da8f0f-d1bb-4d06-8187-1075e2df9f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:01.647380 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-b8da8f0f-d1bb-4d06-8187-1075e2df9f8a None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:01.648653 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b8da8f0f-d1bb-4d06-8187-1075e2df9f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:01.677773 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:01.709406 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1003/2019] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:24:01.721623 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6032ae-4d90-448c-982f-110c39c1222a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:01.723091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fa6032ae-4d90-448c-982f-110c39c1222a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:01.788373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6032ae-4d90-448c-982f-110c39c1222a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:01.792507 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa7556-ff97-4f01-955f-c7709b160ccb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:01.793122 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa7556-ff97-4f01-955f-c7709b160ccb service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:01.793614 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa7556-ff97-4f01-955f-c7709b160ccb service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:01.793732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa7556-ff97-4f01-955f-c7709b160ccb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:01.804510 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa7556-ff97-4f01-955f-c7709b160ccb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:01.805956 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa7556-ff97-4f01-955f-c7709b160ccb service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:01.811479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:01.816950 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1017/2020] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:24:02.297184 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da8f0f-d1bb-4d06-8187-1075e2df9f8a None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:02.299215 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b8da8f0f-d1bb-4d06-8187-1075e2df9f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:02.314538 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da8f0f-d1bb-4d06-8187-1075e2df9f8a None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:02.325959 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdab02-c8e4-4cf3-8bf5-01bef50eb5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:02.325959 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdab02-c8e4-4cf3-8bf5-01bef50eb5e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:02.325959 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdab02-c8e4-4cf3-8bf5-01bef50eb5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:02.325959 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bdab02-c8e4-4cf3-8bf5-01bef50eb5e2 admin admin] PATH_INFO: `/v3/projects/38a132d7bd744c23b2aaaa1bf07c4963` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:02.326625 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bdab02-c8e4-4cf3-8bf5-01bef50eb5e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38a132d7bd744c23b2aaaa1bf07c4963)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:02.326625 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bdab02-c8e4-4cf3-8bf5-01bef50eb5e2 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:02.429315 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d2bdab02-c8e4-4cf3-8bf5-01bef50eb5e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38a132d7bd744c23b2aaaa1bf07c4963', 'request_id': 'req-d2bdab02-c8e4-4cf3-8bf5-01bef50eb5e2'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:02.489668 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d2bdab02-c8e4-4cf3-8bf5-01bef50eb5e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38a132d7bd744c23b2aaaa1bf07c4963', 'request_id': 'req-d2bdab02-c8e4-4cf3-8bf5-01bef50eb5e2'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:02.496936 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d2bdab02-c8e4-4cf3-8bf5-01bef50eb5e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38a132d7bd744c23b2aaaa1bf07c4963', 'request_id': 'req-d2bdab02-c8e4-4cf3-8bf5-01bef50eb5e2'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:02.511239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d2bdab02-c8e4-4cf3-8bf5-01bef50eb5e2 admin admin] The token cache is being invalidate because project 38a132d7bd744c23b2aaaa1bf07c4963 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:24:02.511516 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d2bdab02-c8e4-4cf3-8bf5-01bef50eb5e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:02.512996 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d2bdab02-c8e4-4cf3-8bf5-01bef50eb5e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:02.516132 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1004/2021] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:24:02 2022] DELETE /identity/v3/projects/38a132d7bd744c23b2aaaa1bf07c4963 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:02.520518 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa7556-ff97-4f01-955f-c7709b160ccb service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:02.531012 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa7556-ff97-4f01-955f-c7709b160ccb service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:02.589605 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ab3b9-4f93-4e86-abb4-55e7f6000030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:02.590168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ab3b9-4f93-4e86-abb4-55e7f6000030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:02.590453 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ab3b9-4f93-4e86-abb4-55e7f6000030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:02.590728 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ab3b9-4f93-4e86-abb4-55e7f6000030 admin admin] PATH_INFO: `/v3/users/e1cbb1517e98482f88a0ad7a8e1f9234` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:02.591847 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ab3b9-4f93-4e86-abb4-55e7f6000030 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1cbb1517e98482f88a0ad7a8e1f9234)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:02.593799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ab3b9-4f93-4e86-abb4-55e7f6000030 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:02.874732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-893ab3b9-4f93-4e86-abb4-55e7f6000030 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1cbb1517e98482f88a0ad7a8e1f9234'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:02.934500 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-893ab3b9-4f93-4e86-abb4-55e7f6000030 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1cbb1517e98482f88a0ad7a8e1f9234'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:02.947006 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-893ab3b9-4f93-4e86-abb4-55e7f6000030 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1cbb1517e98482f88a0ad7a8e1f9234'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:02.947634 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-893ab3b9-4f93-4e86-abb4-55e7f6000030 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1cbb1517e98482f88a0ad7a8e1f9234'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:02.954748 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-893ab3b9-4f93-4e86-abb4-55e7f6000030 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1cbb1517e98482f88a0ad7a8e1f9234'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:02.960553 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1018/2022] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:24:02 2022] DELETE /identity/v3/users/e1cbb1517e98482f88a0ad7a8e1f9234 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:24:03.457729 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdab02-c8e4-4cf3-8bf5-01bef50eb5e2 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:03.459267 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d2bdab02-c8e4-4cf3-8bf5-01bef50eb5e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:03.477636 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bdab02-c8e4-4cf3-8bf5-01bef50eb5e2 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:03.536005 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f27637-399d-4d74-b48a-ea4c41ad0c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:03.536670 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f27637-399d-4d74-b48a-ea4c41ad0c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:03.536949 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f27637-399d-4d74-b48a-ea4c41ad0c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:03.537219 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f27637-399d-4d74-b48a-ea4c41ad0c8c admin admin] PATH_INFO: `/v3/projects/986086afb14245d3afc8f2799bf162fc` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:03.538327 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f27637-399d-4d74-b48a-ea4c41ad0c8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=986086afb14245d3afc8f2799bf162fc)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:03.540404 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f27637-399d-4d74-b48a-ea4c41ad0c8c admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:03.708685 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f4f27637-399d-4d74-b48a-ea4c41ad0c8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '986086afb14245d3afc8f2799bf162fc', 'request_id': 'req-f4f27637-399d-4d74-b48a-ea4c41ad0c8c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:03.850115 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f4f27637-399d-4d74-b48a-ea4c41ad0c8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '986086afb14245d3afc8f2799bf162fc', 'request_id': 'req-f4f27637-399d-4d74-b48a-ea4c41ad0c8c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:03.858381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:03.858860 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f4f27637-399d-4d74-b48a-ea4c41ad0c8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '986086afb14245d3afc8f2799bf162fc', 'request_id': 'req-f4f27637-399d-4d74-b48a-ea4c41ad0c8c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:03.877314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f4f27637-399d-4d74-b48a-ea4c41ad0c8c admin admin] The token cache is being invalidate because project 986086afb14245d3afc8f2799bf162fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:24:03.877314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f4f27637-399d-4d74-b48a-ea4c41ad0c8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:03.877314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f4f27637-399d-4d74-b48a-ea4c41ad0c8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:03.877314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1005/2023] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:24:03 2022] DELETE /identity/v3/projects/986086afb14245d3afc8f2799bf162fc => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:03.879830 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fdaa9-2c14-42aa-ab48-d4a1f57747b6 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:03.880344 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fdaa9-2c14-42aa-ab48-d4a1f57747b6 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:03.880429 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067fdaa9-2c14-42aa-ab48-d4a1f57747b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:03.900859 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-067fdaa9-2c14-42aa-ab48-d4a1f57747b6 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:03.902087 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-067fdaa9-2c14-42aa-ab48-d4a1f57747b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:03.976498 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1019/2024] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:03.984182 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1612d0-553c-4241-a93b-e44a909c8a9f None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:03.984478 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1612d0-553c-4241-a93b-e44a909c8a9f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:03.984880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1612d0-553c-4241-a93b-e44a909c8a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:04.009428 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-2b1612d0-553c-4241-a93b-e44a909c8a9f None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:04.010660 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-2b1612d0-553c-4241-a93b-e44a909c8a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:04.031943 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1006/2025] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:04.034029 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fdaa9-2c14-42aa-ab48-d4a1f57747b6 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:04.045139 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067fdaa9-2c14-42aa-ab48-d4a1f57747b6 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:04.050431 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ffd4e-67de-4f1d-904c-c0d22d46cb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:04.051046 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ffd4e-67de-4f1d-904c-c0d22d46cb94 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:04.051330 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ffd4e-67de-4f1d-904c-c0d22d46cb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:04.051619 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ffd4e-67de-4f1d-904c-c0d22d46cb94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:04.052287 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ffd4e-67de-4f1d-904c-c0d22d46cb94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:24:04.052592 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ffd4e-67de-4f1d-904c-c0d22d46cb94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:04.054204 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ffd4e-67de-4f1d-904c-c0d22d46cb94 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:04.067681 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1020/2026] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:24:04.072182 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1612d0-553c-4241-a93b-e44a909c8a9f None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:04.082129 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1612d0-553c-4241-a93b-e44a909c8a9f None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:04.087117 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b126b-2b74-4e57-94db-38bf27bb1e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:04.088231 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b126b-2b74-4e57-94db-38bf27bb1e80 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:04.088231 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b126b-2b74-4e57-94db-38bf27bb1e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:04.088425 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b126b-2b74-4e57-94db-38bf27bb1e80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:04.089041 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b126b-2b74-4e57-94db-38bf27bb1e80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:04.091020 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b126b-2b74-4e57-94db-38bf27bb1e80 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:04.191337 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1007/2027] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:24:04 2022] POST /identity/v3/projects => generated 361 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:24:04.192471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ffd4e-67de-4f1d-904c-c0d22d46cb94 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:04.202683 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ffd4e-67de-4f1d-904c-c0d22d46cb94 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:04.206459 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:04.265253 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2fb15-2aa5-4aaa-9252-edacee055fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:04.265867 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2fb15-2aa5-4aaa-9252-edacee055fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:04.266145 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2fb15-2aa5-4aaa-9252-edacee055fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:04.266477 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f2fb15-2aa5-4aaa-9252-edacee055fc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:04.267125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f2fb15-2aa5-4aaa-9252-edacee055fc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:04.269074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f2fb15-2aa5-4aaa-9252-edacee055fc4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:04.354174 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1021/2028] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:24:04 2022] POST /identity/v3/users => generated 281 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:24:04.358775 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b126b-2b74-4e57-94db-38bf27bb1e80 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:04.370807 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b126b-2b74-4e57-94db-38bf27bb1e80 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:04.375671 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a90a2f-16af-45d7-b35d-b189d75018d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:04.376317 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a90a2f-16af-45d7-b35d-b189d75018d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:04.376637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a90a2f-16af-45d7-b35d-b189d75018d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:04.376975 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a90a2f-16af-45d7-b35d-b189d75018d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:04.377589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a90a2f-16af-45d7-b35d-b189d75018d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:04.379263 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a90a2f-16af-45d7-b35d-b189d75018d6 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:04.390251 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1008/2029] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:24:04.394671 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2fb15-2aa5-4aaa-9252-edacee055fc4 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:04.406209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f2fb15-2aa5-4aaa-9252-edacee055fc4 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:04.411889 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d838c-5cda-40b6-9b1c-31080987e784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:04.412781 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d838c-5cda-40b6-9b1c-31080987e784 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:04.413251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d838c-5cda-40b6-9b1c-31080987e784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:04.413590 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d838c-5cda-40b6-9b1c-31080987e784 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:04.414236 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d838c-5cda-40b6-9b1c-31080987e784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:04.415949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2d838c-5cda-40b6-9b1c-31080987e784 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:04.428120 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1022/2030] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:24:04.432862 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a90a2f-16af-45d7-b35d-b189d75018d6 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:04.443113 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a90a2f-16af-45d7-b35d-b189d75018d6 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:04.448023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ce278-1a4e-4c87-8b61-9cb810fdbdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:04.448900 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ce278-1a4e-4c87-8b61-9cb810fdbdbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:04.449263 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ce278-1a4e-4c87-8b61-9cb810fdbdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:04.449687 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ce278-1a4e-4c87-8b61-9cb810fdbdbe admin admin] PATH_INFO: `/v3/projects/d61c76d1a8894ec389c426b297cda639/users/656cc9ac52424e2dacebe1025c7b6bec/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:04.466775 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ce278-1a4e-4c87-8b61-9cb810fdbdbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d61c76d1a8894ec389c426b297cda639, user_id=656cc9ac52424e2dacebe1025c7b6bec, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:04.469442 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ce278-1a4e-4c87-8b61-9cb810fdbdbe admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:04.516617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d838c-5cda-40b6-9b1c-31080987e784 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:04.518537 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fd2d838c-5cda-40b6-9b1c-31080987e784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:04.531701 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2d838c-5cda-40b6-9b1c-31080987e784 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:04.537134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0173e4-2332-4233-a750-4874fa5c6602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:04.537766 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0173e4-2332-4233-a750-4874fa5c6602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:04.538049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0173e4-2332-4233-a750-4874fa5c6602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:04.538325 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0173e4-2332-4233-a750-4874fa5c6602 admin admin] PATH_INFO: `/v3/users/5ae215038f71492fa51a0a26f73fd9ae` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:04.539471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0173e4-2332-4233-a750-4874fa5c6602 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ae215038f71492fa51a0a26f73fd9ae)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:04.541395 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0173e4-2332-4233-a750-4874fa5c6602 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:04.558280 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1009/2031] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:24:04 2022] PUT /identity/v3/projects/d61c76d1a8894ec389c426b297cda639/users/656cc9ac52424e2dacebe1025c7b6bec/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:24:04.568635 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882a65b-bb78-419d-b685-067203014a6f None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:04.568921 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882a65b-bb78-419d-b685-067203014a6f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:04.569197 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882a65b-bb78-419d-b685-067203014a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:04.597769 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-4882a65b-bb78-419d-b685-067203014a6f None None] MFA Rules not processed for user `656cc9ac52424e2dacebe1025c7b6bec`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:04.599068 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4882a65b-bb78-419d-b685-067203014a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:04.663146 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1010/2032] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:24:04.667616 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882a65b-bb78-419d-b685-067203014a6f None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:04.730353 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882a65b-bb78-419d-b685-067203014a6f None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:04.735103 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41191d06-9f62-4c2e-8ca0-2ad67d63c927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:04.735720 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41191d06-9f62-4c2e-8ca0-2ad67d63c927 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:04.736008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41191d06-9f62-4c2e-8ca0-2ad67d63c927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:04.736325 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41191d06-9f62-4c2e-8ca0-2ad67d63c927 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:04.736957 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41191d06-9f62-4c2e-8ca0-2ad67d63c927 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:04.738917 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41191d06-9f62-4c2e-8ca0-2ad67d63c927 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:04.754713 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-7a0173e4-2332-4233-a750-4874fa5c6602 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ae215038f71492fa51a0a26f73fd9ae'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:04.826514 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:04.834238 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1011/2033] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:24:04 2022] POST /identity/v3/projects => generated 365 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:24:04.838434 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41191d06-9f62-4c2e-8ca0-2ad67d63c927 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:04.854685 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-7a0173e4-2332-4233-a750-4874fa5c6602 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ae215038f71492fa51a0a26f73fd9ae'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:04.868038 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-7a0173e4-2332-4233-a750-4874fa5c6602 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ae215038f71492fa51a0a26f73fd9ae'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:04.868919 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-7a0173e4-2332-4233-a750-4874fa5c6602 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ae215038f71492fa51a0a26f73fd9ae'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:04.876550 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-7a0173e4-2332-4233-a750-4874fa5c6602 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ae215038f71492fa51a0a26f73fd9ae'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:04.883110 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1023/2034] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:24:04 2022] DELETE /identity/v3/users/5ae215038f71492fa51a0a26f73fd9ae => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:24:04.887474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b20e53-5fae-4709-80f4-195f6953f732 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:04.887761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b20e53-5fae-4709-80f4-195f6953f732 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:04.888184 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b20e53-5fae-4709-80f4-195f6953f732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:04.906050 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41191d06-9f62-4c2e-8ca0-2ad67d63c927 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:04.908851 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-87b20e53-5fae-4709-80f4-195f6953f732 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:04.910122 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-87b20e53-5fae-4709-80f4-195f6953f732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:04.984494 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939f54c-5d10-47a9-b8b2-66920b52a106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:04.985214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939f54c-5d10-47a9-b8b2-66920b52a106 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:04.985496 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939f54c-5d10-47a9-b8b2-66920b52a106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:04.985803 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939f54c-5d10-47a9-b8b2-66920b52a106 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:04.986686 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939f54c-5d10-47a9-b8b2-66920b52a106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:04.988684 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939f54c-5d10-47a9-b8b2-66920b52a106 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:05.011261 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:05.022124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1024/2035] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:24:05.032137 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b20e53-5fae-4709-80f4-195f6953f732 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:05.033873 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-87b20e53-5fae-4709-80f4-195f6953f732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:05.094006 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b20e53-5fae-4709-80f4-195f6953f732 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:05.098632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b1b5e-952d-4ad1-9ca3-241b6df2f533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:05.099307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b1b5e-952d-4ad1-9ca3-241b6df2f533 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:05.099653 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b1b5e-952d-4ad1-9ca3-241b6df2f533 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:05.100261 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b1b5e-952d-4ad1-9ca3-241b6df2f533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:05.103471 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1012/2036] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:24:04 2022] POST /identity/v3/users => generated 289 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:24:05.107532 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939f54c-5d10-47a9-b8b2-66920b52a106 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:05.109478 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b939f54c-5d10-47a9-b8b2-66920b52a106 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:05.109770 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b1b5e-952d-4ad1-9ca3-241b6df2f533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:05.110942 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b1b5e-952d-4ad1-9ca3-241b6df2f533 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:05.123153 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939f54c-5d10-47a9-b8b2-66920b52a106 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:05.127283 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1025/2037] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:24:05.127725 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbca057-4f29-4683-94da-8ae7e9dd136d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:05.128386 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbca057-4f29-4683-94da-8ae7e9dd136d admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:05.128694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbca057-4f29-4683-94da-8ae7e9dd136d admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:05.128934 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbca057-4f29-4683-94da-8ae7e9dd136d admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:05.129592 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbca057-4f29-4683-94da-8ae7e9dd136d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:05.131834 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbca057-4f29-4683-94da-8ae7e9dd136d admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:05.146830 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1013/2038] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:24:05.147605 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b1b5e-952d-4ad1-9ca3-241b6df2f533 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:05.157458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b1b5e-952d-4ad1-9ca3-241b6df2f533 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:05.163713 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039a2d5-6254-4932-a7dc-09b67e2c55fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:05.164043 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039a2d5-6254-4932-a7dc-09b67e2c55fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:05.164521 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039a2d5-6254-4932-a7dc-09b67e2c55fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:05.164765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039a2d5-6254-4932-a7dc-09b67e2c55fe admin admin] PATH_INFO: `/v3/projects/3fa857a2077840b0bb5410f1f9ad6253/users/0fd199d4aa2c48cb89b57356c051e1db/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:05.183848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039a2d5-6254-4932-a7dc-09b67e2c55fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fa857a2077840b0bb5410f1f9ad6253, user_id=0fd199d4aa2c48cb89b57356c051e1db, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:05.186730 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039a2d5-6254-4932-a7dc-09b67e2c55fe admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:05.273878 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1026/2039] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:24:05 2022] PUT /identity/v3/projects/3fa857a2077840b0bb5410f1f9ad6253/users/0fd199d4aa2c48cb89b57356c051e1db/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:05.274774 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbca057-4f29-4683-94da-8ae7e9dd136d admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:05.285180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbca057-4f29-4683-94da-8ae7e9dd136d admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:05.355082 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729093d-1962-4494-b2fa-1da12bbce870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:05.355760 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729093d-1962-4494-b2fa-1da12bbce870 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:05.356059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729093d-1962-4494-b2fa-1da12bbce870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:05.356392 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729093d-1962-4494-b2fa-1da12bbce870 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:05.357046 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9729093d-1962-4494-b2fa-1da12bbce870 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:05.358860 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9729093d-1962-4494-b2fa-1da12bbce870 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:05.376083 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1014/2040] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:05 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:24:05.382323 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039a2d5-6254-4932-a7dc-09b67e2c55fe admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:05.394370 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039a2d5-6254-4932-a7dc-09b67e2c55fe admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:05.400838 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165849ee-5715-4c4a-918a-f9ca9b4e10ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:05.401512 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165849ee-5715-4c4a-918a-f9ca9b4e10ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:05.402140 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165849ee-5715-4c4a-918a-f9ca9b4e10ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:05.402140 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165849ee-5715-4c4a-918a-f9ca9b4e10ba admin admin] PATH_INFO: `/v3/projects/3fa857a2077840b0bb5410f1f9ad6253/users/0fd199d4aa2c48cb89b57356c051e1db/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:05.404408 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165849ee-5715-4c4a-918a-f9ca9b4e10ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fa857a2077840b0bb5410f1f9ad6253, user_id=0fd199d4aa2c48cb89b57356c051e1db, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:05.407703 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165849ee-5715-4c4a-918a-f9ca9b4e10ba admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:05.418563 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1027/2041] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:24:05 2022] PUT /identity/v3/projects/3fa857a2077840b0bb5410f1f9ad6253/users/0fd199d4aa2c48cb89b57356c051e1db/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:05.431001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f2030-edcb-4c3b-b0ff-c385641270ec None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:05.431305 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f2030-edcb-4c3b-b0ff-c385641270ec None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:05.431568 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f2030-edcb-4c3b-b0ff-c385641270ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:05.461359 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-984f2030-edcb-4c3b-b0ff-c385641270ec None None] MFA Rules not processed for user `0fd199d4aa2c48cb89b57356c051e1db`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:05.462778 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-984f2030-edcb-4c3b-b0ff-c385641270ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:05.474806 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:05.556389 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1015/2042] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:05 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:05.666761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165849ee-5715-4c4a-918a-f9ca9b4e10ba admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:05.668819 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-165849ee-5715-4c4a-918a-f9ca9b4e10ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:05.671811 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f2030-edcb-4c3b-b0ff-c385641270ec None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:05.674144 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-984f2030-edcb-4c3b-b0ff-c385641270ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:05.738864 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984f2030-edcb-4c3b-b0ff-c385641270ec None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:05.742678 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eee8ed-2086-4f8d-9b61-acb4403b9a8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:05.743351 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eee8ed-2086-4f8d-9b61-acb4403b9a8a service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:05.743641 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eee8ed-2086-4f8d-9b61-acb4403b9a8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:05.743919 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eee8ed-2086-4f8d-9b61-acb4403b9a8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:05.750668 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165849ee-5715-4c4a-918a-f9ca9b4e10ba admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:05.753337 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eee8ed-2086-4f8d-9b61-acb4403b9a8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:05.754793 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eee8ed-2086-4f8d-9b61-acb4403b9a8a service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:05.755513 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46445f8-7c26-496f-a96c-e67f9cac43e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:05.758218 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46445f8-7c26-496f-a96c-e67f9cac43e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:05.758505 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46445f8-7c26-496f-a96c-e67f9cac43e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:05.758786 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46445f8-7c26-496f-a96c-e67f9cac43e4 admin admin] PATH_INFO: `/v3/projects/a6435f0a400c4e64a882597dbcc9e194` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:05.761090 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46445f8-7c26-496f-a96c-e67f9cac43e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6435f0a400c4e64a882597dbcc9e194)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:05.765761 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1016/2043] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:05 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:24:05.765923 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46445f8-7c26-496f-a96c-e67f9cac43e4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:05.908823 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b46445f8-7c26-496f-a96c-e67f9cac43e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6435f0a400c4e64a882597dbcc9e194', 'request_id': 'req-b46445f8-7c26-496f-a96c-e67f9cac43e4'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:05.908823 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b46445f8-7c26-496f-a96c-e67f9cac43e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6435f0a400c4e64a882597dbcc9e194', 'request_id': 'req-b46445f8-7c26-496f-a96c-e67f9cac43e4'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:05.912180 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b46445f8-7c26-496f-a96c-e67f9cac43e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6435f0a400c4e64a882597dbcc9e194', 'request_id': 'req-b46445f8-7c26-496f-a96c-e67f9cac43e4'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:05.915182 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:06.031571 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b46445f8-7c26-496f-a96c-e67f9cac43e4 admin admin] The token cache is being invalidate because project a6435f0a400c4e64a882597dbcc9e194 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:24:06.031892 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b46445f8-7c26-496f-a96c-e67f9cac43e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:06.033164 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b46445f8-7c26-496f-a96c-e67f9cac43e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:06.034667 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1028/2044] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:24:05 2022] DELETE /identity/v3/projects/a6435f0a400c4e64a882597dbcc9e194 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:06.038756 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eee8ed-2086-4f8d-9b61-acb4403b9a8a service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:06.051132 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eee8ed-2086-4f8d-9b61-acb4403b9a8a service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:06.125293 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8bb4e-a820-45ec-9e3c-f9c749b83fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:06.126034 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8bb4e-a820-45ec-9e3c-f9c749b83fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:06.126324 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8bb4e-a820-45ec-9e3c-f9c749b83fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:06.132531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8bb4e-a820-45ec-9e3c-f9c749b83fa0 admin admin] PATH_INFO: `/v3/users/4466c1861d9741578b21542be985205c` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:06.132531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8bb4e-a820-45ec-9e3c-f9c749b83fa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4466c1861d9741578b21542be985205c)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:06.132531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff8bb4e-a820-45ec-9e3c-f9c749b83fa0 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:06.352219 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-4ff8bb4e-a820-45ec-9e3c-f9c749b83fa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4466c1861d9741578b21542be985205c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:06.355087 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:06.397981 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-4ff8bb4e-a820-45ec-9e3c-f9c749b83fa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4466c1861d9741578b21542be985205c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:06.413505 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-4ff8bb4e-a820-45ec-9e3c-f9c749b83fa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4466c1861d9741578b21542be985205c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:06.414689 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-4ff8bb4e-a820-45ec-9e3c-f9c749b83fa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4466c1861d9741578b21542be985205c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:06.422938 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-4ff8bb4e-a820-45ec-9e3c-f9c749b83fa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4466c1861d9741578b21542be985205c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:06.429601 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1017/2045] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:24:06 2022] DELETE /identity/v3/users/4466c1861d9741578b21542be985205c => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:06.851233 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46445f8-7c26-496f-a96c-e67f9cac43e4 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:06.852879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b46445f8-7c26-496f-a96c-e67f9cac43e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:06.870096 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46445f8-7c26-496f-a96c-e67f9cac43e4 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:06.900449 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8bb4e-a820-45ec-9e3c-f9c749b83fa0 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:06.901935 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4ff8bb4e-a820-45ec-9e3c-f9c749b83fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:06.933421 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f2db8a-c8b6-46f0-8cdb-6108aeafd327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:06.934068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2db8a-c8b6-46f0-8cdb-6108aeafd327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:06.934524 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2db8a-c8b6-46f0-8cdb-6108aeafd327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:06.934987 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f2db8a-c8b6-46f0-8cdb-6108aeafd327 admin admin] PATH_INFO: `/v3/projects/cfe41c01821f4c429a5e2d1476b65aef` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:06.936453 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2db8a-c8b6-46f0-8cdb-6108aeafd327 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfe41c01821f4c429a5e2d1476b65aef)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:06.938394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f2db8a-c8b6-46f0-8cdb-6108aeafd327 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:06.978835 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8bb4e-a820-45ec-9e3c-f9c749b83fa0 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:06.983961 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef04552-31e3-4ea5-a451-c6aac2a261a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:06.984664 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef04552-31e3-4ea5-a451-c6aac2a261a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:06.984930 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef04552-31e3-4ea5-a451-c6aac2a261a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:06.985206 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef04552-31e3-4ea5-a451-c6aac2a261a8 admin admin] PATH_INFO: `/v3/users/656cc9ac52424e2dacebe1025c7b6bec` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:06.986961 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef04552-31e3-4ea5-a451-c6aac2a261a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=656cc9ac52424e2dacebe1025c7b6bec)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:06.989079 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef04552-31e3-4ea5-a451-c6aac2a261a8 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:07.061930 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-93f2db8a-c8b6-46f0-8cdb-6108aeafd327 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfe41c01821f4c429a5e2d1476b65aef', 'request_id': 'req-93f2db8a-c8b6-46f0-8cdb-6108aeafd327'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:07.068354 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-93f2db8a-c8b6-46f0-8cdb-6108aeafd327 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfe41c01821f4c429a5e2d1476b65aef', 'request_id': 'req-93f2db8a-c8b6-46f0-8cdb-6108aeafd327'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:07.074740 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-93f2db8a-c8b6-46f0-8cdb-6108aeafd327 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfe41c01821f4c429a5e2d1476b65aef', 'request_id': 'req-93f2db8a-c8b6-46f0-8cdb-6108aeafd327'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:07.157436 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-93f2db8a-c8b6-46f0-8cdb-6108aeafd327 admin admin] The token cache is being invalidate because project cfe41c01821f4c429a5e2d1476b65aef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:24:07.158267 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-93f2db8a-c8b6-46f0-8cdb-6108aeafd327 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:07.160699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-93f2db8a-c8b6-46f0-8cdb-6108aeafd327 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:07.160699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1029/2046] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:24:06 2022] DELETE /identity/v3/projects/cfe41c01821f4c429a5e2d1476b65aef => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:07.165026 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d792810-6b28-45c8-8463-56f20845a8e2 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:07.165309 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d792810-6b28-45c8-8463-56f20845a8e2 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:07.165581 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d792810-6b28-45c8-8463-56f20845a8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:07.186440 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-5d792810-6b28-45c8-8463-56f20845a8e2 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:07.187735 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5d792810-6b28-45c8-8463-56f20845a8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:07.265632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1030/2047] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:24:07.277700 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508aec1-865e-44ad-9015-a09016397132 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:07.278391 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508aec1-865e-44ad-9015-a09016397132 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:07.278666 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508aec1-865e-44ad-9015-a09016397132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:07.292811 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-eef04552-31e3-4ea5-a451-c6aac2a261a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '656cc9ac52424e2dacebe1025c7b6bec'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:07.303320 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8508aec1-865e-44ad-9015-a09016397132 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:07.310697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8508aec1-865e-44ad-9015-a09016397132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:07.314583 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1031/2048] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:07.318522 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508aec1-865e-44ad-9015-a09016397132 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:07.320193 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8508aec1-865e-44ad-9015-a09016397132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:07.340368 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:07.378055 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508aec1-865e-44ad-9015-a09016397132 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:07.381712 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b6b40b-2c55-4cc7-a14f-9373bb56717c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:07.382328 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6b40b-2c55-4cc7-a14f-9373bb56717c service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:07.382610 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6b40b-2c55-4cc7-a14f-9373bb56717c service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:07.382887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b6b40b-2c55-4cc7-a14f-9373bb56717c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:07.384814 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-85b6b40b-2c55-4cc7-a14f-9373bb56717c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:07.404430 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-eef04552-31e3-4ea5-a451-c6aac2a261a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '656cc9ac52424e2dacebe1025c7b6bec'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:07.417755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-eef04552-31e3-4ea5-a451-c6aac2a261a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '656cc9ac52424e2dacebe1025c7b6bec'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:07.418417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-eef04552-31e3-4ea5-a451-c6aac2a261a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '656cc9ac52424e2dacebe1025c7b6bec'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:07.426441 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-eef04552-31e3-4ea5-a451-c6aac2a261a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '656cc9ac52424e2dacebe1025c7b6bec'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:07.432529 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1018/2049] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:24:06 2022] DELETE /identity/v3/users/656cc9ac52424e2dacebe1025c7b6bec => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:24:07.433709 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef04552-31e3-4ea5-a451-c6aac2a261a8 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:07.435117 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-eef04552-31e3-4ea5-a451-c6aac2a261a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:07.451575 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6b40b-2c55-4cc7-a14f-9373bb56717c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:07.453059 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b6b40b-2c55-4cc7-a14f-9373bb56717c service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:07.466192 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1032/2050] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:07 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:24:07.468125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b793b-8d38-41c0-a4d2-54cb5062df78 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:07.468433 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b793b-8d38-41c0-a4d2-54cb5062df78 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:07.468713 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b793b-8d38-41c0-a4d2-54cb5062df78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:07.488550 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:07.489883 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-018b793b-8d38-41c0-a4d2-54cb5062df78 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:07.491156 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-018b793b-8d38-41c0-a4d2-54cb5062df78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:07.505610 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef04552-31e3-4ea5-a451-c6aac2a261a8 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:07.510415 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf89e33-44de-4b38-b7e8-c2172bf41c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:07.511043 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf89e33-44de-4b38-b7e8-c2172bf41c9b admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:07.511327 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf89e33-44de-4b38-b7e8-c2172bf41c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:07.511607 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf89e33-44de-4b38-b7e8-c2172bf41c9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:07.512291 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf89e33-44de-4b38-b7e8-c2172bf41c9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:24:07.512601 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf89e33-44de-4b38-b7e8-c2172bf41c9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:07.514216 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf89e33-44de-4b38-b7e8-c2172bf41c9b admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:07.529563 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1019/2051] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:24:07.531719 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf89e33-44de-4b38-b7e8-c2172bf41c9b admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:07.544062 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf89e33-44de-4b38-b7e8-c2172bf41c9b admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:07.554650 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88806a9c-6ddf-41a3-82f5-2e8c4f3022a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:07.555560 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88806a9c-6ddf-41a3-82f5-2e8c4f3022a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:07.555947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88806a9c-6ddf-41a3-82f5-2e8c4f3022a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:07.556603 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88806a9c-6ddf-41a3-82f5-2e8c4f3022a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:07.557362 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88806a9c-6ddf-41a3-82f5-2e8c4f3022a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:07.559404 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88806a9c-6ddf-41a3-82f5-2e8c4f3022a7 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:07.563204 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1033/2052] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:07.573368 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b793b-8d38-41c0-a4d2-54cb5062df78 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:07.574776 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-018b793b-8d38-41c0-a4d2-54cb5062df78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:07.635924 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b793b-8d38-41c0-a4d2-54cb5062df78 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:07.646906 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a726d30-0216-4202-8b82-d44317b6c167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:07.648037 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a726d30-0216-4202-8b82-d44317b6c167 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:07.648037 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a726d30-0216-4202-8b82-d44317b6c167 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:07.648269 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a726d30-0216-4202-8b82-d44317b6c167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:07.659851 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a726d30-0216-4202-8b82-d44317b6c167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:07.664263 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a726d30-0216-4202-8b82-d44317b6c167 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:07.671439 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1020/2053] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:24:07 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:24:07.672978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1034/2054] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:24:07.675647 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88806a9c-6ddf-41a3-82f5-2e8c4f3022a7 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:07.775575 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88806a9c-6ddf-41a3-82f5-2e8c4f3022a7 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:07.788652 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926974dc-8735-4758-bf5d-0959e23e37a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:07.789458 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926974dc-8735-4758-bf5d-0959e23e37a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:07.789743 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926974dc-8735-4758-bf5d-0959e23e37a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:07.790073 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926974dc-8735-4758-bf5d-0959e23e37a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:07.790810 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926974dc-8735-4758-bf5d-0959e23e37a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:07.798990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926974dc-8735-4758-bf5d-0959e23e37a5 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:07.903708 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1021/2055] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:24:07 2022] POST /identity/v3/users => generated 287 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:24:07.909689 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a726d30-0216-4202-8b82-d44317b6c167 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:07.920631 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a726d30-0216-4202-8b82-d44317b6c167 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:07.927866 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ceb295-abed-46ec-9874-fdc014d3a229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:07.928727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ceb295-abed-46ec-9874-fdc014d3a229 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:07.929012 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ceb295-abed-46ec-9874-fdc014d3a229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:07.930105 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ceb295-abed-46ec-9874-fdc014d3a229 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:07.930105 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ceb295-abed-46ec-9874-fdc014d3a229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:07.933000 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ceb295-abed-46ec-9874-fdc014d3a229 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:07.949093 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1035/2056] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:07.953422 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926974dc-8735-4758-bf5d-0959e23e37a5 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:07.967337 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926974dc-8735-4758-bf5d-0959e23e37a5 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:07.972661 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a8288-a7f8-4fd1-9ea2-deb432bb491c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:07.973338 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a8288-a7f8-4fd1-9ea2-deb432bb491c admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:07.973621 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a8288-a7f8-4fd1-9ea2-deb432bb491c admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:07.974092 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a8288-a7f8-4fd1-9ea2-deb432bb491c admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:07.975134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a8288-a7f8-4fd1-9ea2-deb432bb491c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:07.976907 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a8288-a7f8-4fd1-9ea2-deb432bb491c admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:07.987690 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1022/2057] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:07.992785 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ceb295-abed-46ec-9874-fdc014d3a229 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:08.004079 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ceb295-abed-46ec-9874-fdc014d3a229 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:08.009457 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124269c2-a7bc-472a-8e34-ad08ff9b1ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:08.010131 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124269c2-a7bc-472a-8e34-ad08ff9b1ea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:08.010420 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124269c2-a7bc-472a-8e34-ad08ff9b1ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:08.010699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124269c2-a7bc-472a-8e34-ad08ff9b1ea6 admin admin] PATH_INFO: `/v3/projects/fdc4cec936994a9d90d60247faf4f7c0/users/2b5f0b0928874046ad7f4d873796d344/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:08.034423 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124269c2-a7bc-472a-8e34-ad08ff9b1ea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdc4cec936994a9d90d60247faf4f7c0, user_id=2b5f0b0928874046ad7f4d873796d344, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:08.037159 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124269c2-a7bc-472a-8e34-ad08ff9b1ea6 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:08.141804 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321077d-225c-4ae9-b55c-2d4bc5341875 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:08.142733 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321077d-225c-4ae9-b55c-2d4bc5341875 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:08.142997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321077d-225c-4ae9-b55c-2d4bc5341875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:08.147911 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1036/2058] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:24:07 2022] PUT /identity/v3/projects/fdc4cec936994a9d90d60247faf4f7c0/users/2b5f0b0928874046ad7f4d873796d344/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:08.162767 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124269c2-a7bc-472a-8e34-ad08ff9b1ea6 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:08.164682 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-124269c2-a7bc-472a-8e34-ad08ff9b1ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:08.165225 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-1321077d-225c-4ae9-b55c-2d4bc5341875 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:08.166522 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1321077d-225c-4ae9-b55c-2d4bc5341875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:08.249064 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124269c2-a7bc-472a-8e34-ad08ff9b1ea6 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:08.253333 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1023/2059] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:24:08.257999 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66fcad-1314-47fb-946d-7bcb827c5d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:08.258799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66fcad-1314-47fb-946d-7bcb827c5d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:08.259179 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66fcad-1314-47fb-946d-7bcb827c5d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:08.259532 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa66fcad-1314-47fb-946d-7bcb827c5d1d admin admin] PATH_INFO: `/v3/projects/d61c76d1a8894ec389c426b297cda639` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:08.260839 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66fcad-1314-47fb-946d-7bcb827c5d1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d61c76d1a8894ec389c426b297cda639)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:08.262783 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa66fcad-1314-47fb-946d-7bcb827c5d1d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:08.265525 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321077d-225c-4ae9-b55c-2d4bc5341875 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:08.267855 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1321077d-225c-4ae9-b55c-2d4bc5341875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:08.330720 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321077d-225c-4ae9-b55c-2d4bc5341875 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:08.334490 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f5664-e6aa-4a7b-b254-72a48d481d88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:08.335198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f5664-e6aa-4a7b-b254-72a48d481d88 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:08.335477 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f5664-e6aa-4a7b-b254-72a48d481d88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:08.335790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f5664-e6aa-4a7b-b254-72a48d481d88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:08.345981 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f5664-e6aa-4a7b-b254-72a48d481d88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:08.347492 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f5664-e6aa-4a7b-b254-72a48d481d88 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:08.356983 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1024/2060] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:24:08.387671 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-aa66fcad-1314-47fb-946d-7bcb827c5d1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd61c76d1a8894ec389c426b297cda639', 'request_id': 'req-aa66fcad-1314-47fb-946d-7bcb827c5d1d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:08.393322 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-aa66fcad-1314-47fb-946d-7bcb827c5d1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd61c76d1a8894ec389c426b297cda639', 'request_id': 'req-aa66fcad-1314-47fb-946d-7bcb827c5d1d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:08.400188 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-aa66fcad-1314-47fb-946d-7bcb827c5d1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd61c76d1a8894ec389c426b297cda639', 'request_id': 'req-aa66fcad-1314-47fb-946d-7bcb827c5d1d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:08.482133 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-aa66fcad-1314-47fb-946d-7bcb827c5d1d admin admin] The token cache is being invalidate because project d61c76d1a8894ec389c426b297cda639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:24:08.482652 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-aa66fcad-1314-47fb-946d-7bcb827c5d1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:08.483707 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-aa66fcad-1314-47fb-946d-7bcb827c5d1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:08.486802 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1037/2061] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:24:08 2022] DELETE /identity/v3/projects/d61c76d1a8894ec389c426b297cda639 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:24:08.492989 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f5664-e6aa-4a7b-b254-72a48d481d88 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:08.510919 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f5664-e6aa-4a7b-b254-72a48d481d88 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:08.578525 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2412b4f2-146f-4af2-b8e9-582e9854d23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:08.579171 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412b4f2-146f-4af2-b8e9-582e9854d23d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:08.579962 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412b4f2-146f-4af2-b8e9-582e9854d23d admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:08.580269 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2412b4f2-146f-4af2-b8e9-582e9854d23d admin admin] PATH_INFO: `/v3/users/0fd199d4aa2c48cb89b57356c051e1db` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:08.581414 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412b4f2-146f-4af2-b8e9-582e9854d23d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fd199d4aa2c48cb89b57356c051e1db)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:08.583338 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2412b4f2-146f-4af2-b8e9-582e9854d23d admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:08.853782 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-2412b4f2-146f-4af2-b8e9-582e9854d23d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fd199d4aa2c48cb89b57356c051e1db'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:08.928809 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-2412b4f2-146f-4af2-b8e9-582e9854d23d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fd199d4aa2c48cb89b57356c051e1db'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:08.941993 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-2412b4f2-146f-4af2-b8e9-582e9854d23d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fd199d4aa2c48cb89b57356c051e1db'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:08.942688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-2412b4f2-146f-4af2-b8e9-582e9854d23d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fd199d4aa2c48cb89b57356c051e1db'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:08.949661 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-2412b4f2-146f-4af2-b8e9-582e9854d23d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fd199d4aa2c48cb89b57356c051e1db'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:08.956200 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1025/2062] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:24:08 2022] DELETE /identity/v3/users/0fd199d4aa2c48cb89b57356c051e1db => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:09.575899 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:09.662978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66fcad-1314-47fb-946d-7bcb827c5d1d admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:09.664544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-aa66fcad-1314-47fb-946d-7bcb827c5d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:09.680745 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa66fcad-1314-47fb-946d-7bcb827c5d1d admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:09.773447 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb7cd79-500c-4225-9f97-bda8d9b2d674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:09.774011 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7cd79-500c-4225-9f97-bda8d9b2d674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:09.774337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7cd79-500c-4225-9f97-bda8d9b2d674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:09.774831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb7cd79-500c-4225-9f97-bda8d9b2d674 admin admin] PATH_INFO: `/v3/projects/3fa857a2077840b0bb5410f1f9ad6253` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:09.776132 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7cd79-500c-4225-9f97-bda8d9b2d674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fa857a2077840b0bb5410f1f9ad6253)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:09.778116 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb7cd79-500c-4225-9f97-bda8d9b2d674 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:09.885528 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:09.898289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0fb7cd79-500c-4225-9f97-bda8d9b2d674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fa857a2077840b0bb5410f1f9ad6253', 'request_id': 'req-0fb7cd79-500c-4225-9f97-bda8d9b2d674'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:09.904948 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0fb7cd79-500c-4225-9f97-bda8d9b2d674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fa857a2077840b0bb5410f1f9ad6253', 'request_id': 'req-0fb7cd79-500c-4225-9f97-bda8d9b2d674'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:09.912823 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0fb7cd79-500c-4225-9f97-bda8d9b2d674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fa857a2077840b0bb5410f1f9ad6253', 'request_id': 'req-0fb7cd79-500c-4225-9f97-bda8d9b2d674'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:10.062704 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0fb7cd79-500c-4225-9f97-bda8d9b2d674 admin admin] The token cache is being invalidate because project 3fa857a2077840b0bb5410f1f9ad6253 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:24:10.062704 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0fb7cd79-500c-4225-9f97-bda8d9b2d674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:10.062704 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0fb7cd79-500c-4225-9f97-bda8d9b2d674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:10.065425 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7c645-c1ab-4069-96d7-0ddc173c43fd None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:10.066311 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7c645-c1ab-4069-96d7-0ddc173c43fd None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:10.066763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7c645-c1ab-4069-96d7-0ddc173c43fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:10.070615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1038/2063] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:24:09 2022] DELETE /identity/v3/projects/3fa857a2077840b0bb5410f1f9ad6253 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:10.094850 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fe991-044a-4565-8939-54ebc283ff44 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:10.096130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fe991-044a-4565-8939-54ebc283ff44 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:10.096609 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577fe991-044a-4565-8939-54ebc283ff44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:10.102265 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-94c7c645-c1ab-4069-96d7-0ddc173c43fd None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:10.103727 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-94c7c645-c1ab-4069-96d7-0ddc173c43fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:10.137014 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-577fe991-044a-4565-8939-54ebc283ff44 None None] MFA Rules not processed for user `2b5f0b0928874046ad7f4d873796d344`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:10.140713 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-577fe991-044a-4565-8939-54ebc283ff44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:10.191486 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1026/2064] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:10.194112 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79a63f-2df1-4ad1-9139-104220aeb492 None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:10.194684 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79a63f-2df1-4ad1-9139-104220aeb492 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:10.195138 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79a63f-2df1-4ad1-9139-104220aeb492 None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:10.197830 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1027/2065] 10.222.0.81 () {54 vars in 921 bytes} [Tue Sep 6 21:24:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:24:10.199605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b0d03-9564-4d16-986e-1ffabab48a9c None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:10.201235 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b0d03-9564-4d16-986e-1ffabab48a9c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:10.202445 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b0d03-9564-4d16-986e-1ffabab48a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:10.227843 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-bb8b0d03-9564-4d16-986e-1ffabab48a9c None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:10.229332 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-bb8b0d03-9564-4d16-986e-1ffabab48a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:10.244198 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1039/2066] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:10.244690 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1028/2067] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:10.245687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75762536-6d5a-45ea-9cf6-5e1f3a72d7f9 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:10.245976 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75762536-6d5a-45ea-9cf6-5e1f3a72d7f9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:10.246252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75762536-6d5a-45ea-9cf6-5e1f3a72d7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:10.246606 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b0d03-9564-4d16-986e-1ffabab48a9c None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:10.258547 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b0d03-9564-4d16-986e-1ffabab48a9c None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:10.267986 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbce56-5ec2-4f37-88b0-96771c2064bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:10.268855 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-75762536-6d5a-45ea-9cf6-5e1f3a72d7f9 None None] MFA Rules not processed for user `c3295306746f4552837f1bb12b2c500f`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:10.269154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbce56-5ec2-4f37-88b0-96771c2064bd admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:10.269816 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbce56-5ec2-4f37-88b0-96771c2064bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:10.272702 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-75762536-6d5a-45ea-9cf6-5e1f3a72d7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:10.272946 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbce56-5ec2-4f37-88b0-96771c2064bd admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:10.272946 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbce56-5ec2-4f37-88b0-96771c2064bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:24:10.272946 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbce56-5ec2-4f37-88b0-96771c2064bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:10.273813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fbce56-5ec2-4f37-88b0-96771c2064bd admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:10.286471 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1029/2068] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:24:10.287916 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbce56-5ec2-4f37-88b0-96771c2064bd admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:10.289830 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-97fbce56-5ec2-4f37-88b0-96771c2064bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:10.361727 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbce56-5ec2-4f37-88b0-96771c2064bd admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:10.366503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99734d99-d6b2-4ed0-93a8-750f4587aed3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:10.367251 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99734d99-d6b2-4ed0-93a8-750f4587aed3 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:10.367726 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99734d99-d6b2-4ed0-93a8-750f4587aed3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:10.368375 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99734d99-d6b2-4ed0-93a8-750f4587aed3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:10.378002 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99734d99-d6b2-4ed0-93a8-750f4587aed3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:10.386269 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99734d99-d6b2-4ed0-93a8-750f4587aed3 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:10.400712 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1040/2069] 10.222.0.81 () {58 vars in 1018 bytes} [Tue Sep 6 21:24:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:10.401733 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75762536-6d5a-45ea-9cf6-5e1f3a72d7f9 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:10.412877 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75762536-6d5a-45ea-9cf6-5e1f3a72d7f9 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:10.413196 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1030/2070] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:24:10.418056 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3f777-c336-4893-ad5a-757b0cbf8037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:10.418730 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3f777-c336-4893-ad5a-757b0cbf8037 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:10.419480 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3f777-c336-4893-ad5a-757b0cbf8037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:10.419758 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a3f777-c336-4893-ad5a-757b0cbf8037 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:10.420502 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3f777-c336-4893-ad5a-757b0cbf8037 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:10.423048 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a3f777-c336-4893-ad5a-757b0cbf8037 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:10.438190 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99734d99-d6b2-4ed0-93a8-750f4587aed3 service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:10.440276 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-99734d99-d6b2-4ed0-93a8-750f4587aed3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:10.464621 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99734d99-d6b2-4ed0-93a8-750f4587aed3 service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:10.472282 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306c610-3473-4af4-8abf-6cfccc1b3439 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3295306746f4552837f1bb12b2c500f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:10.473215 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306c610-3473-4af4-8abf-6cfccc1b3439 service placement] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:10.473643 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306c610-3473-4af4-8abf-6cfccc1b3439 service placement] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:10.474089 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306c610-3473-4af4-8abf-6cfccc1b3439 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:10.486119 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306c610-3473-4af4-8abf-6cfccc1b3439 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:10.488927 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d306c610-3473-4af4-8abf-6cfccc1b3439 service placement] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:10.503832 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1031/2071] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:24:10.508122 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:10.579234 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1041/2072] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:24:10 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:24:10.583218 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306c610-3473-4af4-8abf-6cfccc1b3439 service placement] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:10.598996 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306c610-3473-4af4-8abf-6cfccc1b3439 service placement] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:10.662513 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf8991-38b1-4752-96e0-1b504132f883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:10.663408 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf8991-38b1-4752-96e0-1b504132f883 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:10.663689 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf8991-38b1-4752-96e0-1b504132f883 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:10.663959 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf8991-38b1-4752-96e0-1b504132f883 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:10.664671 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf8991-38b1-4752-96e0-1b504132f883 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:10.666721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf8991-38b1-4752-96e0-1b504132f883 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:10.754110 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1032/2073] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:24:10 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:24:10.758266 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3f777-c336-4893-ad5a-757b0cbf8037 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:10.769521 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a3f777-c336-4893-ad5a-757b0cbf8037 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:10.779416 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a004555-62ed-45a8-b3b2-78b2be10957a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:10.780525 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a004555-62ed-45a8-b3b2-78b2be10957a admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:10.780829 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a004555-62ed-45a8-b3b2-78b2be10957a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:10.781108 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a004555-62ed-45a8-b3b2-78b2be10957a admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:10.781764 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a004555-62ed-45a8-b3b2-78b2be10957a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:10.783747 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a004555-62ed-45a8-b3b2-78b2be10957a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:10.795069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1042/2074] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:24:10.799184 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf8991-38b1-4752-96e0-1b504132f883 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:10.810081 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf8991-38b1-4752-96e0-1b504132f883 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:10.815021 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea926f0c-b10e-479e-95b5-a786a85ea44e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:10.816319 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea926f0c-b10e-479e-95b5-a786a85ea44e admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:10.816615 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea926f0c-b10e-479e-95b5-a786a85ea44e admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:10.816905 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea926f0c-b10e-479e-95b5-a786a85ea44e admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:10.817546 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea926f0c-b10e-479e-95b5-a786a85ea44e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:10.819225 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea926f0c-b10e-479e-95b5-a786a85ea44e admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:10.830088 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1033/2075] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:10.834615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a004555-62ed-45a8-b3b2-78b2be10957a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:10.847008 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a004555-62ed-45a8-b3b2-78b2be10957a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:10.855606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabf88b-228f-4ba6-ba26-1f8bc5efcc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:10.856750 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabf88b-228f-4ba6-ba26-1f8bc5efcc46 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:10.857486 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabf88b-228f-4ba6-ba26-1f8bc5efcc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:10.857840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cabf88b-228f-4ba6-ba26-1f8bc5efcc46 admin admin] PATH_INFO: `/v3/projects/732992b7830b46d1b50d2cc85ca61f17/users/a718b4c930464d7681cf3b02c084672c/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:10.878903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabf88b-228f-4ba6-ba26-1f8bc5efcc46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=732992b7830b46d1b50d2cc85ca61f17, user_id=a718b4c930464d7681cf3b02c084672c, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:10.879087 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cabf88b-228f-4ba6-ba26-1f8bc5efcc46 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:10.962039 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1043/2076] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:24:10 2022] PUT /identity/v3/projects/732992b7830b46d1b50d2cc85ca61f17/users/a718b4c930464d7681cf3b02c084672c/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:10.968298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e0431-45d9-474e-84d9-afa19a79828f None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:10.968681 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e0431-45d9-474e-84d9-afa19a79828f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:10.968956 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784e0431-45d9-474e-84d9-afa19a79828f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:11.004519 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-784e0431-45d9-474e-84d9-afa19a79828f None None] MFA Rules not processed for user `a718b4c930464d7681cf3b02c084672c`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:11.006069 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-784e0431-45d9-474e-84d9-afa19a79828f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:11.097890 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1034/2077] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:11.102726 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabf88b-228f-4ba6-ba26-1f8bc5efcc46 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:11.171100 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cabf88b-228f-4ba6-ba26-1f8bc5efcc46 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:11.176838 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd8210-cd50-4b84-9d44-d784ce44e864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:11.177579 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd8210-cd50-4b84-9d44-d784ce44e864 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:11.177853 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd8210-cd50-4b84-9d44-d784ce44e864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:11.178124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd8210-cd50-4b84-9d44-d784ce44e864 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:11.178764 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd8210-cd50-4b84-9d44-d784ce44e864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:11.180688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd8210-cd50-4b84-9d44-d784ce44e864 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:11.228340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e0431-45d9-474e-84d9-afa19a79828f None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:11.229795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-784e0431-45d9-474e-84d9-afa19a79828f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:11.246711 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784e0431-45d9-474e-84d9-afa19a79828f None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:11.249563 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0169c0-7c04-40ce-ab18-0ad0c50b90dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:11.250203 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0169c0-7c04-40ce-ab18-0ad0c50b90dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:11.250485 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0169c0-7c04-40ce-ab18-0ad0c50b90dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:11.250762 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0169c0-7c04-40ce-ab18-0ad0c50b90dd admin admin] PATH_INFO: `/v3/users/caa6c1fb5b354a409bc8f1a69dc2e718` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:11.251894 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0169c0-7c04-40ce-ab18-0ad0c50b90dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=caa6c1fb5b354a409bc8f1a69dc2e718)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:11.253898 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0169c0-7c04-40ce-ab18-0ad0c50b90dd admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:11.331942 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1044/2078] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:24:11 2022] POST /identity/v3/projects => generated 387 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:24:11.335757 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd8210-cd50-4b84-9d44-d784ce44e864 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:11.397613 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd8210-cd50-4b84-9d44-d784ce44e864 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:11.402396 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f97501-1a39-4520-bbbb-5d075298bd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:11.407715 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f97501-1a39-4520-bbbb-5d075298bd9c admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:11.407715 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f97501-1a39-4520-bbbb-5d075298bd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:11.407715 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f97501-1a39-4520-bbbb-5d075298bd9c admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:11.407715 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f97501-1a39-4520-bbbb-5d075298bd9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:11.407715 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f97501-1a39-4520-bbbb-5d075298bd9c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:11.474660 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0c0169c0-7c04-40ce-ab18-0ad0c50b90dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caa6c1fb5b354a409bc8f1a69dc2e718'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:11.495600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1045/2079] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:24:11 2022] POST /identity/v3/users => generated 300 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:24:11.499587 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f97501-1a39-4520-bbbb-5d075298bd9c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:11.509268 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f97501-1a39-4520-bbbb-5d075298bd9c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:11.514043 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c43343-91e4-4769-a3e7-3c77f8aeaf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:11.514640 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c43343-91e4-4769-a3e7-3c77f8aeaf8b admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:11.514926 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c43343-91e4-4769-a3e7-3c77f8aeaf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:11.515203 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c43343-91e4-4769-a3e7-3c77f8aeaf8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:11.515873 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c43343-91e4-4769-a3e7-3c77f8aeaf8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:11.517668 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c43343-91e4-4769-a3e7-3c77f8aeaf8b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:11.529337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1046/2080] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:24:11.533379 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c43343-91e4-4769-a3e7-3c77f8aeaf8b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:11.543504 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c43343-91e4-4769-a3e7-3c77f8aeaf8b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:11.546196 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0c0169c0-7c04-40ce-ab18-0ad0c50b90dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caa6c1fb5b354a409bc8f1a69dc2e718'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:11.548700 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcff5a-f258-4876-9005-2a6bda0ecfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:11.549338 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcff5a-f258-4876-9005-2a6bda0ecfc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:11.549617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcff5a-f258-4876-9005-2a6bda0ecfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:11.549890 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dcff5a-f258-4876-9005-2a6bda0ecfc3 admin admin] PATH_INFO: `/v3/projects/4bcb4a36ee4f499ba7d32a2d128e6d7b/users/72573a2966674ff8ad4721eb58867dad/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:11.559514 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0c0169c0-7c04-40ce-ab18-0ad0c50b90dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caa6c1fb5b354a409bc8f1a69dc2e718'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:11.560369 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0c0169c0-7c04-40ce-ab18-0ad0c50b90dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caa6c1fb5b354a409bc8f1a69dc2e718'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:11.564775 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dcff5a-f258-4876-9005-2a6bda0ecfc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bcb4a36ee4f499ba7d32a2d128e6d7b, user_id=72573a2966674ff8ad4721eb58867dad, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:11.567473 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dcff5a-f258-4876-9005-2a6bda0ecfc3 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:11.568715 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-0c0169c0-7c04-40ce-ab18-0ad0c50b90dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caa6c1fb5b354a409bc8f1a69dc2e718'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:11.574596 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1035/2081] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:24:11 2022] DELETE /identity/v3/users/caa6c1fb5b354a409bc8f1a69dc2e718 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:24:11.616163 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:11.673385 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1047/2082] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:24:11 2022] PUT /identity/v3/projects/4bcb4a36ee4f499ba7d32a2d128e6d7b/users/72573a2966674ff8ad4721eb58867dad/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:24:11.677586 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0169c0-7c04-40ce-ab18-0ad0c50b90dd admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:11.679424 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-0c0169c0-7c04-40ce-ab18-0ad0c50b90dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:11.763671 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0169c0-7c04-40ce-ab18-0ad0c50b90dd admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:11.831344 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910beac8-3d95-4431-b821-6e5b9a829174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:11.832438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910beac8-3d95-4431-b821-6e5b9a829174 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:11.832724 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910beac8-3d95-4431-b821-6e5b9a829174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:11.833000 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910beac8-3d95-4431-b821-6e5b9a829174 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:11.833645 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910beac8-3d95-4431-b821-6e5b9a829174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:11.835285 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910beac8-3d95-4431-b821-6e5b9a829174 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:11.845799 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1036/2083] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:11 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:11.850152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcff5a-f258-4876-9005-2a6bda0ecfc3 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:11.860790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dcff5a-f258-4876-9005-2a6bda0ecfc3 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:11.868189 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d09fea-77f3-4bf2-8329-aae58a10cb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:11.868189 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d09fea-77f3-4bf2-8329-aae58a10cb1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:11.868189 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d09fea-77f3-4bf2-8329-aae58a10cb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:11.868548 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d09fea-77f3-4bf2-8329-aae58a10cb1c admin admin] PATH_INFO: `/v3/projects/4bcb4a36ee4f499ba7d32a2d128e6d7b/users/72573a2966674ff8ad4721eb58867dad/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:11.870881 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d09fea-77f3-4bf2-8329-aae58a10cb1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bcb4a36ee4f499ba7d32a2d128e6d7b, user_id=72573a2966674ff8ad4721eb58867dad, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:11.873669 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d09fea-77f3-4bf2-8329-aae58a10cb1c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:11.886691 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1048/2084] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:24:11 2022] PUT /identity/v3/projects/4bcb4a36ee4f499ba7d32a2d128e6d7b/users/72573a2966674ff8ad4721eb58867dad/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:11.897302 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910beac8-3d95-4431-b821-6e5b9a829174 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:11.899202 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157656b6-ee00-4fbe-a664-de8ea9ff066a None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:11.899492 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157656b6-ee00-4fbe-a664-de8ea9ff066a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:11.899761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157656b6-ee00-4fbe-a664-de8ea9ff066a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:11.904149 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-910beac8-3d95-4431-b821-6e5b9a829174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:11.921621 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910beac8-3d95-4431-b821-6e5b9a829174 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:11.943537 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-157656b6-ee00-4fbe-a664-de8ea9ff066a None None] MFA Rules not processed for user `72573a2966674ff8ad4721eb58867dad`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:11.945258 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-157656b6-ee00-4fbe-a664-de8ea9ff066a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:11.984394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5a3b41-5778-4365-8190-63a172a20893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:11.985101 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a3b41-5778-4365-8190-63a172a20893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:11.985511 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a3b41-5778-4365-8190-63a172a20893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:11.986522 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5a3b41-5778-4365-8190-63a172a20893 admin admin] PATH_INFO: `/v3/projects/ed9089e888aa4598916d257986dc0b70` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:11.986967 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a3b41-5778-4365-8190-63a172a20893 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed9089e888aa4598916d257986dc0b70)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:11.988951 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5a3b41-5778-4365-8190-63a172a20893 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:12.016893 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1049/2085] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:11 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:12.028800 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157656b6-ee00-4fbe-a664-de8ea9ff066a None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:12.030305 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-157656b6-ee00-4fbe-a664-de8ea9ff066a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:12.073247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6e5a3b41-5778-4365-8190-63a172a20893 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed9089e888aa4598916d257986dc0b70', 'request_id': 'req-6e5a3b41-5778-4365-8190-63a172a20893'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:12.092724 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157656b6-ee00-4fbe-a664-de8ea9ff066a None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:12.141347 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6e5a3b41-5778-4365-8190-63a172a20893 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed9089e888aa4598916d257986dc0b70', 'request_id': 'req-6e5a3b41-5778-4365-8190-63a172a20893'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:12.149961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999af421-b104-438d-91db-dd51dc944e3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:12.150427 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6e5a3b41-5778-4365-8190-63a172a20893 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed9089e888aa4598916d257986dc0b70', 'request_id': 'req-6e5a3b41-5778-4365-8190-63a172a20893'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:12.150585 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999af421-b104-438d-91db-dd51dc944e3e service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:12.151798 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999af421-b104-438d-91db-dd51dc944e3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:12.152029 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999af421-b104-438d-91db-dd51dc944e3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:12.164139 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6e5a3b41-5778-4365-8190-63a172a20893 admin admin] The token cache is being invalidate because project ed9089e888aa4598916d257986dc0b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:24:12.164376 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6e5a3b41-5778-4365-8190-63a172a20893 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:12.165047 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6e5a3b41-5778-4365-8190-63a172a20893 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:12.166564 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1037/2086] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:24:11 2022] DELETE /identity/v3/projects/ed9089e888aa4598916d257986dc0b70 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:12.171186 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64657da1-43c6-4351-a304-e922088250ad None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:12.171474 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64657da1-43c6-4351-a304-e922088250ad None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:12.171755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64657da1-43c6-4351-a304-e922088250ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:12.191675 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-64657da1-43c6-4351-a304-e922088250ad None None] MFA Rules not processed for user `2b5f0b0928874046ad7f4d873796d344`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:12.192943 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-64657da1-43c6-4351-a304-e922088250ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:12.215138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999af421-b104-438d-91db-dd51dc944e3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:12.216631 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999af421-b104-438d-91db-dd51dc944e3e service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:12.226911 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1050/2087] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:12 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:24:12.227583 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999af421-b104-438d-91db-dd51dc944e3e service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:12.257655 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1038/2088] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:12.271575 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64657da1-43c6-4351-a304-e922088250ad None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:12.273463 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-64657da1-43c6-4351-a304-e922088250ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:12.301038 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999af421-b104-438d-91db-dd51dc944e3e service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:12.308951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b660b2-7ae2-42f8-925b-57dcab76a7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:12.311528 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b660b2-7ae2-42f8-925b-57dcab76a7a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:12.311815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b660b2-7ae2-42f8-925b-57dcab76a7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:12.315074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b660b2-7ae2-42f8-925b-57dcab76a7a3 admin admin] PATH_INFO: `/v3/users/441fa4964cdd474a8fe12b56e6266afa` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:12.315074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b660b2-7ae2-42f8-925b-57dcab76a7a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=441fa4964cdd474a8fe12b56e6266afa)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:12.315907 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b660b2-7ae2-42f8-925b-57dcab76a7a3 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:12.335070 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:12.352512 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64657da1-43c6-4351-a304-e922088250ad None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:12.357231 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea0227-5610-4822-93ec-62b1e06ec1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:12.357967 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea0227-5610-4822-93ec-62b1e06ec1a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:12.358152 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea0227-5610-4822-93ec-62b1e06ec1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:12.358427 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea0227-5610-4822-93ec-62b1e06ec1a6 admin admin] PATH_INFO: `/v3/users/a718b4c930464d7681cf3b02c084672c` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:12.359589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea0227-5610-4822-93ec-62b1e06ec1a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a718b4c930464d7681cf3b02c084672c)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:12.361551 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea0227-5610-4822-93ec-62b1e06ec1a6 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:12.545946 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-61b660b2-7ae2-42f8-925b-57dcab76a7a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '441fa4964cdd474a8fe12b56e6266afa'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:12.590421 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f0ea0227-5610-4822-93ec-62b1e06ec1a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a718b4c930464d7681cf3b02c084672c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:12.638482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-61b660b2-7ae2-42f8-925b-57dcab76a7a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '441fa4964cdd474a8fe12b56e6266afa'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:12.652159 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-61b660b2-7ae2-42f8-925b-57dcab76a7a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '441fa4964cdd474a8fe12b56e6266afa'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:12.652876 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-61b660b2-7ae2-42f8-925b-57dcab76a7a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '441fa4964cdd474a8fe12b56e6266afa'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:12.660455 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-61b660b2-7ae2-42f8-925b-57dcab76a7a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '441fa4964cdd474a8fe12b56e6266afa'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:12.666908 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1051/2089] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:24:12 2022] DELETE /identity/v3/users/441fa4964cdd474a8fe12b56e6266afa => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:12.706126 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f0ea0227-5610-4822-93ec-62b1e06ec1a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a718b4c930464d7681cf3b02c084672c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:12.731210 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f0ea0227-5610-4822-93ec-62b1e06ec1a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a718b4c930464d7681cf3b02c084672c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:12.732339 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f0ea0227-5610-4822-93ec-62b1e06ec1a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a718b4c930464d7681cf3b02c084672c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:12.740767 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f0ea0227-5610-4822-93ec-62b1e06ec1a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a718b4c930464d7681cf3b02c084672c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:12.747659 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1039/2090] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:24:12 2022] DELETE /identity/v3/users/a718b4c930464d7681cf3b02c084672c => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:12.752298 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746da7c6-4248-472a-b5a8-f17008215917 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:12.752750 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746da7c6-4248-472a-b5a8-f17008215917 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:12.752999 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746da7c6-4248-472a-b5a8-f17008215917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:12.774383 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-746da7c6-4248-472a-b5a8-f17008215917 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:12.776300 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-746da7c6-4248-472a-b5a8-f17008215917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:12.847316 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1052/2091] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:12.853951 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea0227-5610-4822-93ec-62b1e06ec1a6 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:12.855399 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f0ea0227-5610-4822-93ec-62b1e06ec1a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:12.914616 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea0227-5610-4822-93ec-62b1e06ec1a6 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:12.918356 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859150e-1b35-4b15-83b3-2e1265c2e278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:12.918975 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859150e-1b35-4b15-83b3-2e1265c2e278 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:12.919508 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859150e-1b35-4b15-83b3-2e1265c2e278 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:12.919784 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859150e-1b35-4b15-83b3-2e1265c2e278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:12.931063 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859150e-1b35-4b15-83b3-2e1265c2e278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:12.932635 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d859150e-1b35-4b15-83b3-2e1265c2e278 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:12.942993 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1040/2092] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:24:12.975684 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746da7c6-4248-472a-b5a8-f17008215917 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:12.977418 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-746da7c6-4248-472a-b5a8-f17008215917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:13.022004 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746da7c6-4248-472a-b5a8-f17008215917 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:13.050479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201296e-4391-4d4d-9954-1ee360bed4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:13.052410 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201296e-4391-4d4d-9954-1ee360bed4d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:13.053234 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201296e-4391-4d4d-9954-1ee360bed4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:13.054365 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3201296e-4391-4d4d-9954-1ee360bed4d4 admin admin] PATH_INFO: `/v3/projects/9ba40177a485449784d08026261e9258` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:13.059055 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3201296e-4391-4d4d-9954-1ee360bed4d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ba40177a485449784d08026261e9258)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:13.063116 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3201296e-4391-4d4d-9954-1ee360bed4d4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:13.130723 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:13.281561 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-3201296e-4391-4d4d-9954-1ee360bed4d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ba40177a485449784d08026261e9258', 'request_id': 'req-3201296e-4391-4d4d-9954-1ee360bed4d4'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:13.297434 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-3201296e-4391-4d4d-9954-1ee360bed4d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ba40177a485449784d08026261e9258', 'request_id': 'req-3201296e-4391-4d4d-9954-1ee360bed4d4'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:13.306263 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-3201296e-4391-4d4d-9954-1ee360bed4d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ba40177a485449784d08026261e9258', 'request_id': 'req-3201296e-4391-4d4d-9954-1ee360bed4d4'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:13.572569 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-3201296e-4391-4d4d-9954-1ee360bed4d4 admin admin] The token cache is being invalidate because project 9ba40177a485449784d08026261e9258 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:24:13.572569 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-3201296e-4391-4d4d-9954-1ee360bed4d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:13.572569 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-3201296e-4391-4d4d-9954-1ee360bed4d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:13.572569 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1053/2093] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:24:12 2022] DELETE /identity/v3/projects/9ba40177a485449784d08026261e9258 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:13.573883 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2668a6d-8c92-4ce2-bb71-01610024390c None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:13.573883 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2668a6d-8c92-4ce2-bb71-01610024390c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:13.573883 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2668a6d-8c92-4ce2-bb71-01610024390c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:13.575719 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201296e-4391-4d4d-9954-1ee360bed4d4 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:13.577193 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3201296e-4391-4d4d-9954-1ee360bed4d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:13.592295 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c2668a6d-8c92-4ce2-bb71-01610024390c None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:13.593692 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c2668a6d-8c92-4ce2-bb71-01610024390c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:13.641951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3201296e-4391-4d4d-9954-1ee360bed4d4 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:13.647157 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a371e-66fa-41c8-8b41-2fae5132ebf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:13.648300 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a371e-66fa-41c8-8b41-2fae5132ebf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:13.648816 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a371e-66fa-41c8-8b41-2fae5132ebf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:13.649305 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a371e-66fa-41c8-8b41-2fae5132ebf0 admin admin] PATH_INFO: `/v3/users/479e6d6faf9a45668b3be64a6588ca13` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:13.650505 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a371e-66fa-41c8-8b41-2fae5132ebf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=479e6d6faf9a45668b3be64a6588ca13)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:13.652504 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a371e-66fa-41c8-8b41-2fae5132ebf0 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:13.658391 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1041/2094] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:13.665628 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490529d-9d79-4303-9787-2ef80bb13423 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:13.665915 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490529d-9d79-4303-9787-2ef80bb13423 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:13.666193 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490529d-9d79-4303-9787-2ef80bb13423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:13.686658 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-4490529d-9d79-4303-9787-2ef80bb13423 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:13.687851 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4490529d-9d79-4303-9787-2ef80bb13423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:13.696597 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1042/2095] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:24:13.700744 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490529d-9d79-4303-9787-2ef80bb13423 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:13.709582 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490529d-9d79-4303-9787-2ef80bb13423 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:13.715040 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c893e6-a8fc-4cce-b1df-161e6b443b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:13.715942 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c893e6-a8fc-4cce-b1df-161e6b443b3f admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:13.715942 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c893e6-a8fc-4cce-b1df-161e6b443b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:13.716209 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c893e6-a8fc-4cce-b1df-161e6b443b3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:13.716882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c893e6-a8fc-4cce-b1df-161e6b443b3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:24:13.717187 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c893e6-a8fc-4cce-b1df-161e6b443b3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:13.718791 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c893e6-a8fc-4cce-b1df-161e6b443b3f admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:13.730570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1043/2096] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:24:13.735030 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c893e6-a8fc-4cce-b1df-161e6b443b3f admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:13.744937 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c893e6-a8fc-4cce-b1df-161e6b443b3f admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:13.749516 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61d6b5-6e7a-405e-89df-42bd4ebb8c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:13.750085 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61d6b5-6e7a-405e-89df-42bd4ebb8c3b admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:13.750370 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61d6b5-6e7a-405e-89df-42bd4ebb8c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:13.750914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61d6b5-6e7a-405e-89df-42bd4ebb8c3b admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:13.751267 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61d6b5-6e7a-405e-89df-42bd4ebb8c3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:13.753858 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61d6b5-6e7a-405e-89df-42bd4ebb8c3b admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:13.885664 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1044/2097] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:24:13 2022] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:24:13.886434 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61d6b5-6e7a-405e-89df-42bd4ebb8c3b admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:13.888141 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1c61d6b5-6e7a-405e-89df-42bd4ebb8c3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:13.952736 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0d8a371e-66fa-41c8-8b41-2fae5132ebf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '479e6d6faf9a45668b3be64a6588ca13'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:13.956210 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61d6b5-6e7a-405e-89df-42bd4ebb8c3b admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:13.961395 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1833ac2-6901-4e44-88d6-980e81fc6284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:13.962064 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1833ac2-6901-4e44-88d6-980e81fc6284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:13.962346 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1833ac2-6901-4e44-88d6-980e81fc6284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:13.962622 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1833ac2-6901-4e44-88d6-980e81fc6284 admin admin] PATH_INFO: `/v3/projects/732992b7830b46d1b50d2cc85ca61f17` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:13.963743 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1833ac2-6901-4e44-88d6-980e81fc6284 admin admin] RBAC: Authorizing `identity:delete_project(project_id=732992b7830b46d1b50d2cc85ca61f17)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:13.965772 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1833ac2-6901-4e44-88d6-980e81fc6284 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:14.037816 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:14.060230 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0d8a371e-66fa-41c8-8b41-2fae5132ebf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '479e6d6faf9a45668b3be64a6588ca13'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:14.077324 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0d8a371e-66fa-41c8-8b41-2fae5132ebf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '479e6d6faf9a45668b3be64a6588ca13'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:14.078396 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0d8a371e-66fa-41c8-8b41-2fae5132ebf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '479e6d6faf9a45668b3be64a6588ca13'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:14.079642 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f1833ac2-6901-4e44-88d6-980e81fc6284 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '732992b7830b46d1b50d2cc85ca61f17', 'request_id': 'req-f1833ac2-6901-4e44-88d6-980e81fc6284'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:14.087892 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0d8a371e-66fa-41c8-8b41-2fae5132ebf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '479e6d6faf9a45668b3be64a6588ca13'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:14.094360 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1054/2098] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:24:13 2022] DELETE /identity/v3/users/479e6d6faf9a45668b3be64a6588ca13 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:24:14.095571 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a371e-66fa-41c8-8b41-2fae5132ebf0 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:14.096814 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0d8a371e-66fa-41c8-8b41-2fae5132ebf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:14.163466 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a371e-66fa-41c8-8b41-2fae5132ebf0 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:14.168244 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b250860-b42f-40ca-b369-342a20c25a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:14.169087 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b250860-b42f-40ca-b369-342a20c25a13 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:14.170303 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b250860-b42f-40ca-b369-342a20c25a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:14.170303 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b250860-b42f-40ca-b369-342a20c25a13 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:14.171063 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b250860-b42f-40ca-b369-342a20c25a13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:14.173113 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b250860-b42f-40ca-b369-342a20c25a13 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:14.208507 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f1833ac2-6901-4e44-88d6-980e81fc6284 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '732992b7830b46d1b50d2cc85ca61f17', 'request_id': 'req-f1833ac2-6901-4e44-88d6-980e81fc6284'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:14.216013 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f1833ac2-6901-4e44-88d6-980e81fc6284 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '732992b7830b46d1b50d2cc85ca61f17', 'request_id': 'req-f1833ac2-6901-4e44-88d6-980e81fc6284'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:14.228416 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f1833ac2-6901-4e44-88d6-980e81fc6284 admin admin] The token cache is being invalidate because project 732992b7830b46d1b50d2cc85ca61f17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:24:14.228676 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f1833ac2-6901-4e44-88d6-980e81fc6284 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:14.229402 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f1833ac2-6901-4e44-88d6-980e81fc6284 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:14.234188 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1045/2099] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:24:13 2022] DELETE /identity/v3/projects/732992b7830b46d1b50d2cc85ca61f17 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:14.235614 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f15a6-8bde-46c2-a477-fcf887b15bbb None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:14.235906 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f15a6-8bde-46c2-a477-fcf887b15bbb None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:14.236258 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f15a6-8bde-46c2-a477-fcf887b15bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:14.274403 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-210f15a6-8bde-46c2-a477-fcf887b15bbb None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:14.275187 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1055/2100] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:24:14 2022] POST /identity/v3/users => generated 292 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:24:14.276254 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b250860-b42f-40ca-b369-342a20c25a13 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:14.281659 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:14.282609 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0b250860-b42f-40ca-b369-342a20c25a13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:14.285435 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-210f15a6-8bde-46c2-a477-fcf887b15bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:14.305086 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1046/2101] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:14.309415 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f15a6-8bde-46c2-a477-fcf887b15bbb None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:14.313692 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-210f15a6-8bde-46c2-a477-fcf887b15bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:14.315159 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b250860-b42f-40ca-b369-342a20c25a13 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:14.320946 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd3268-9742-456c-b2b3-3aa22d0d5b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:14.321617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd3268-9742-456c-b2b3-3aa22d0d5b6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:14.322071 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd3268-9742-456c-b2b3-3aa22d0d5b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:14.322360 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd3268-9742-456c-b2b3-3aa22d0d5b6a admin admin] PATH_INFO: `/v3/users/72573a2966674ff8ad4721eb58867dad` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:14.324385 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd3268-9742-456c-b2b3-3aa22d0d5b6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=72573a2966674ff8ad4721eb58867dad)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:14.326584 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd3268-9742-456c-b2b3-3aa22d0d5b6a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:14.327421 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f15a6-8bde-46c2-a477-fcf887b15bbb None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:14.334170 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0645ee9-2f6e-43f5-8848-416c072ebfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:14.334170 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0645ee9-2f6e-43f5-8848-416c072ebfb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:14.334170 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0645ee9-2f6e-43f5-8848-416c072ebfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:14.336725 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0645ee9-2f6e-43f5-8848-416c072ebfb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:14.336725 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0645ee9-2f6e-43f5-8848-416c072ebfb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:14.336725 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0645ee9-2f6e-43f5-8848-416c072ebfb9 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:14.348156 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1047/2102] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:14.349101 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0645ee9-2f6e-43f5-8848-416c072ebfb9 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:14.350884 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b0645ee9-2f6e-43f5-8848-416c072ebfb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:14.421773 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0645ee9-2f6e-43f5-8848-416c072ebfb9 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:14.425960 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd2614-cd7a-4eb1-8ba8-99792310d468 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:14.428825 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd2614-cd7a-4eb1-8ba8-99792310d468 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:14.428825 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd2614-cd7a-4eb1-8ba8-99792310d468 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:14.428825 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd2614-cd7a-4eb1-8ba8-99792310d468 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:14.437286 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd2614-cd7a-4eb1-8ba8-99792310d468 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:14.438746 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd2614-cd7a-4eb1-8ba8-99792310d468 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:14.449579 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1048/2103] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:24:14.450425 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd2614-cd7a-4eb1-8ba8-99792310d468 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:14.460311 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd2614-cd7a-4eb1-8ba8-99792310d468 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:14.465645 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffc149-b111-4cf3-8121-f0cc5e33e961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:14.466256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffc149-b111-4cf3-8121-f0cc5e33e961 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:14.466540 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffc149-b111-4cf3-8121-f0cc5e33e961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:14.466814 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffc149-b111-4cf3-8121-f0cc5e33e961 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:14.467454 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffc149-b111-4cf3-8121-f0cc5e33e961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:14.469227 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffc149-b111-4cf3-8121-f0cc5e33e961 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:14.491939 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1049/2104] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:14.491939 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffc149-b111-4cf3-8121-f0cc5e33e961 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:14.491939 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-eaffc149-b111-4cf3-8121-f0cc5e33e961 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:14.503455 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffc149-b111-4cf3-8121-f0cc5e33e961 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:14.509096 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b4a8f-2d16-4985-a415-f484b1aeabba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:14.509794 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b4a8f-2d16-4985-a415-f484b1aeabba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:14.510121 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b4a8f-2d16-4985-a415-f484b1aeabba admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:14.510837 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b4a8f-2d16-4985-a415-f484b1aeabba admin admin] PATH_INFO: `/v3/users/3806e4b660df42458fdd4af1aadb66a2` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:14.514907 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b4a8f-2d16-4985-a415-f484b1aeabba admin admin] RBAC: Authorizing `identity:delete_user(user_id=3806e4b660df42458fdd4af1aadb66a2)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:14.519695 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551b4a8f-2d16-4985-a415-f484b1aeabba admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:14.539959 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a5fd3268-9742-456c-b2b3-3aa22d0d5b6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72573a2966674ff8ad4721eb58867dad'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:14.729141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a5fd3268-9742-456c-b2b3-3aa22d0d5b6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72573a2966674ff8ad4721eb58867dad'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:14.744217 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a5fd3268-9742-456c-b2b3-3aa22d0d5b6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72573a2966674ff8ad4721eb58867dad'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:14.744989 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a5fd3268-9742-456c-b2b3-3aa22d0d5b6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72573a2966674ff8ad4721eb58867dad'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:14.752250 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a5fd3268-9742-456c-b2b3-3aa22d0d5b6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72573a2966674ff8ad4721eb58867dad'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:14.758370 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1056/2105] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:24:14 2022] DELETE /identity/v3/users/72573a2966674ff8ad4721eb58867dad => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:14.759140 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd3268-9742-456c-b2b3-3aa22d0d5b6a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:14.761031 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a5fd3268-9742-456c-b2b3-3aa22d0d5b6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:14.867268 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:14.871134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-551b4a8f-2d16-4985-a415-f484b1aeabba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3806e4b660df42458fdd4af1aadb66a2'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:14.876567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd3268-9742-456c-b2b3-3aa22d0d5b6a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:14.883943 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91651b21-e258-40c6-b474-9b2a196825cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:14.884751 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91651b21-e258-40c6-b474-9b2a196825cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:14.885101 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91651b21-e258-40c6-b474-9b2a196825cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:14.885444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91651b21-e258-40c6-b474-9b2a196825cd admin admin] PATH_INFO: `/v3/projects/d729bf327b664bd9bb3e9c873693d444/users/72ffe5ef0a434f6c8c73de58ef63a2d2/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:14.904050 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91651b21-e258-40c6-b474-9b2a196825cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d729bf327b664bd9bb3e9c873693d444, user_id=72ffe5ef0a434f6c8c73de58ef63a2d2, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:14.907058 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91651b21-e258-40c6-b474-9b2a196825cd admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:14.957661 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-551b4a8f-2d16-4985-a415-f484b1aeabba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3806e4b660df42458fdd4af1aadb66a2'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:14.974418 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1057/2106] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:24:14 2022] PUT /identity/v3/projects/d729bf327b664bd9bb3e9c873693d444/users/72ffe5ef0a434f6c8c73de58ef63a2d2/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:14.975567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91651b21-e258-40c6-b474-9b2a196825cd admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:14.978978 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-551b4a8f-2d16-4985-a415-f484b1aeabba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3806e4b660df42458fdd4af1aadb66a2'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:14.979817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-551b4a8f-2d16-4985-a415-f484b1aeabba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3806e4b660df42458fdd4af1aadb66a2'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:14.980054 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-91651b21-e258-40c6-b474-9b2a196825cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:14.992426 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-551b4a8f-2d16-4985-a415-f484b1aeabba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3806e4b660df42458fdd4af1aadb66a2'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:15.003342 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1050/2107] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:24:14 2022] DELETE /identity/v3/users/3806e4b660df42458fdd4af1aadb66a2 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:15.004878 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c06375-91c7-4c14-be20-f152fed45922 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:15.005171 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c06375-91c7-4c14-be20-f152fed45922 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:15.005434 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c06375-91c7-4c14-be20-f152fed45922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:15.038821 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-80c06375-91c7-4c14-be20-f152fed45922 None None] MFA Rules not processed for user `72ffe5ef0a434f6c8c73de58ef63a2d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:15.040385 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-80c06375-91c7-4c14-be20-f152fed45922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:15.081092 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91651b21-e258-40c6-b474-9b2a196825cd admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:15.119550 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1051/2108] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:15.119550 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774df810-eedb-4da7-b5f3-92fc7f622317 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:15.119550 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774df810-eedb-4da7-b5f3-92fc7f622317 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:15.119550 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774df810-eedb-4da7-b5f3-92fc7f622317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:15.143710 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-774df810-eedb-4da7-b5f3-92fc7f622317 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:15.145017 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-774df810-eedb-4da7-b5f3-92fc7f622317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:15.165163 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254bff2-ebf5-4d24-803f-9b94c3fe4079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:15.165969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254bff2-ebf5-4d24-803f-9b94c3fe4079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:15.166255 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254bff2-ebf5-4d24-803f-9b94c3fe4079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:15.166531 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8254bff2-ebf5-4d24-803f-9b94c3fe4079 admin admin] PATH_INFO: `/v3/projects/7af22586fd39415489ada2ce44124042` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:15.167684 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8254bff2-ebf5-4d24-803f-9b94c3fe4079 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7af22586fd39415489ada2ce44124042)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:15.169954 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8254bff2-ebf5-4d24-803f-9b94c3fe4079 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:15.208691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1052/2109] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:15.209614 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774df810-eedb-4da7-b5f3-92fc7f622317 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:15.210998 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-774df810-eedb-4da7-b5f3-92fc7f622317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:15.223402 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774df810-eedb-4da7-b5f3-92fc7f622317 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:15.231556 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55669a-d5e3-480f-b5ca-b476c0dcd1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:15.232234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55669a-d5e3-480f-b5ca-b476c0dcd1ea admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:15.232505 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55669a-d5e3-480f-b5ca-b476c0dcd1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:15.232842 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da55669a-d5e3-480f-b5ca-b476c0dcd1ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:15.233416 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55669a-d5e3-480f-b5ca-b476c0dcd1ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:15.235675 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da55669a-d5e3-480f-b5ca-b476c0dcd1ea admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:15.302972 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8254bff2-ebf5-4d24-803f-9b94c3fe4079 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7af22586fd39415489ada2ce44124042', 'request_id': 'req-8254bff2-ebf5-4d24-803f-9b94c3fe4079'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:15.318067 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8254bff2-ebf5-4d24-803f-9b94c3fe4079 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7af22586fd39415489ada2ce44124042', 'request_id': 'req-8254bff2-ebf5-4d24-803f-9b94c3fe4079'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:15.320734 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8254bff2-ebf5-4d24-803f-9b94c3fe4079 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7af22586fd39415489ada2ce44124042', 'request_id': 'req-8254bff2-ebf5-4d24-803f-9b94c3fe4079'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:15.325764 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1053/2110] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:24:15 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:24:15.325764 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55669a-d5e3-480f-b5ca-b476c0dcd1ea admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:15.328372 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-da55669a-d5e3-480f-b5ca-b476c0dcd1ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:15.390538 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:15.399251 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da55669a-d5e3-480f-b5ca-b476c0dcd1ea admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:15.404155 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71caf64-6ec0-48b5-9f2e-c7303ae6f18f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:15.404881 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71caf64-6ec0-48b5-9f2e-c7303ae6f18f service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:15.405234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71caf64-6ec0-48b5-9f2e-c7303ae6f18f service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:15.405577 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71caf64-6ec0-48b5-9f2e-c7303ae6f18f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:15.414931 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8254bff2-ebf5-4d24-803f-9b94c3fe4079 admin admin] The token cache is being invalidate because project 7af22586fd39415489ada2ce44124042 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:24:15.415331 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8254bff2-ebf5-4d24-803f-9b94c3fe4079 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:15.416078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8254bff2-ebf5-4d24-803f-9b94c3fe4079 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:15.417785 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1058/2111] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:24:14 2022] DELETE /identity/v3/projects/7af22586fd39415489ada2ce44124042 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:15.418806 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254bff2-ebf5-4d24-803f-9b94c3fe4079 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:15.420793 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8254bff2-ebf5-4d24-803f-9b94c3fe4079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:15.490251 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71caf64-6ec0-48b5-9f2e-c7303ae6f18f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:15.491919 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71caf64-6ec0-48b5-9f2e-c7303ae6f18f service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:15.492057 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8254bff2-ebf5-4d24-803f-9b94c3fe4079 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:15.498868 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd62ca-e10d-4abd-b588-ee0159d757f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:15.499679 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd62ca-e10d-4abd-b588-ee0159d757f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:15.500748 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd62ca-e10d-4abd-b588-ee0159d757f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:15.501137 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd62ca-e10d-4abd-b588-ee0159d757f4 admin admin] PATH_INFO: `/v3/projects/4bcb4a36ee4f499ba7d32a2d128e6d7b` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:15.503651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd62ca-e10d-4abd-b588-ee0159d757f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bcb4a36ee4f499ba7d32a2d128e6d7b)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:15.504326 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1054/2112] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:24:15.505155 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71caf64-6ec0-48b5-9f2e-c7303ae6f18f service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:15.510053 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd62ca-e10d-4abd-b588-ee0159d757f4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:15.518897 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71caf64-6ec0-48b5-9f2e-c7303ae6f18f service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:15.524546 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51046fff-a6cc-41d9-b6e3-14c195685d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:15.525176 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51046fff-a6cc-41d9-b6e3-14c195685d87 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:15.525461 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51046fff-a6cc-41d9-b6e3-14c195685d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:15.525741 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51046fff-a6cc-41d9-b6e3-14c195685d87 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:15.526142 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:15.526751 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51046fff-a6cc-41d9-b6e3-14c195685d87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:15.528924 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51046fff-a6cc-41d9-b6e3-14c195685d87 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:15.618644 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1055/2113] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:24:15 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:24:15.622806 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51046fff-a6cc-41d9-b6e3-14c195685d87 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:15.624698 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-51046fff-a6cc-41d9-b6e3-14c195685d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:15.638877 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51046fff-a6cc-41d9-b6e3-14c195685d87 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:15.661004 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9ddd62ca-e10d-4abd-b588-ee0159d757f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bcb4a36ee4f499ba7d32a2d128e6d7b', 'request_id': 'req-9ddd62ca-e10d-4abd-b588-ee0159d757f4'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:15.676198 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9ddd62ca-e10d-4abd-b588-ee0159d757f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bcb4a36ee4f499ba7d32a2d128e6d7b', 'request_id': 'req-9ddd62ca-e10d-4abd-b588-ee0159d757f4'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:15.676198 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9ddd62ca-e10d-4abd-b588-ee0159d757f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bcb4a36ee4f499ba7d32a2d128e6d7b', 'request_id': 'req-9ddd62ca-e10d-4abd-b588-ee0159d757f4'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:15.723478 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c55d20-c02d-453f-9fd0-10c30fda9998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:15.724619 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c55d20-c02d-453f-9fd0-10c30fda9998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:15.725100 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c55d20-c02d-453f-9fd0-10c30fda9998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:15.725555 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c55d20-c02d-453f-9fd0-10c30fda9998 admin admin] PATH_INFO: `/v3/users/9666cc40bce1473c9c991b71d4704ff0` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:15.726802 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c55d20-c02d-453f-9fd0-10c30fda9998 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9666cc40bce1473c9c991b71d4704ff0)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:15.730059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c55d20-c02d-453f-9fd0-10c30fda9998 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:15.779783 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9ddd62ca-e10d-4abd-b588-ee0159d757f4 admin admin] The token cache is being invalidate because project 4bcb4a36ee4f499ba7d32a2d128e6d7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:24:15.780249 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9ddd62ca-e10d-4abd-b588-ee0159d757f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:15.781707 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9ddd62ca-e10d-4abd-b588-ee0159d757f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:15.787498 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1059/2114] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:24:15 2022] DELETE /identity/v3/projects/4bcb4a36ee4f499ba7d32a2d128e6d7b => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:15.787498 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd62ca-e10d-4abd-b588-ee0159d757f4 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:15.789501 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9ddd62ca-e10d-4abd-b588-ee0159d757f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:15.807995 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd62ca-e10d-4abd-b588-ee0159d757f4 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:15.811539 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0adbc83-844b-483c-96ed-62d1c8420cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:15.812183 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adbc83-844b-483c-96ed-62d1c8420cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:15.812467 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adbc83-844b-483c-96ed-62d1c8420cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:15.812743 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0adbc83-844b-483c-96ed-62d1c8420cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:15.813422 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0adbc83-844b-483c-96ed-62d1c8420cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:15.815691 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0adbc83-844b-483c-96ed-62d1c8420cf1 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:15.825746 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1060/2115] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:15.827065 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc670d-949c-4be9-a620-37ea7d204b37 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:15.827360 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc670d-949c-4be9-a620-37ea7d204b37 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:15.827630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc670d-949c-4be9-a620-37ea7d204b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:15.848120 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f7cc670d-949c-4be9-a620-37ea7d204b37 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:15.849330 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f7cc670d-949c-4be9-a620-37ea7d204b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:15.857229 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1061/2116] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:15.858004 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc670d-949c-4be9-a620-37ea7d204b37 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:15.868066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc670d-949c-4be9-a620-37ea7d204b37 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:15.873102 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c80cd-1ab0-40c3-9e17-6bf486c0320e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:15.877164 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c80cd-1ab0-40c3-9e17-6bf486c0320e admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:15.877164 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c80cd-1ab0-40c3-9e17-6bf486c0320e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:15.877164 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c80cd-1ab0-40c3-9e17-6bf486c0320e admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:15.877164 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c80cd-1ab0-40c3-9e17-6bf486c0320e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:15.877164 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c80cd-1ab0-40c3-9e17-6bf486c0320e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:15.887640 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1062/2117] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:15.891887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19b171-1ed2-4929-b7d6-30e739afcaf6 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:15.892203 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19b171-1ed2-4929-b7d6-30e739afcaf6 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:15.892485 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19b171-1ed2-4929-b7d6-30e739afcaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:15.914974 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8a19b171-1ed2-4929-b7d6-30e739afcaf6 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:15.916315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8a19b171-1ed2-4929-b7d6-30e739afcaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:15.929590 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1063/2118] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:15.929590 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19b171-1ed2-4929-b7d6-30e739afcaf6 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:15.936790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19b171-1ed2-4929-b7d6-30e739afcaf6 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:15.943172 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d5c55d20-c02d-453f-9fd0-10c30fda9998 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9666cc40bce1473c9c991b71d4704ff0'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:15.944415 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c237b-b8f0-49f3-b9d5-f28e1a9981bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:15.945171 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c237b-b8f0-49f3-b9d5-f28e1a9981bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:15.945687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c237b-b8f0-49f3-b9d5-f28e1a9981bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:15.946513 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c237b-b8f0-49f3-b9d5-f28e1a9981bf admin admin] PATH_INFO: `/v3/projects/3462ef393fa642ee9e1a9a2dfa58690c/users/102c0e41a572484fb65687059032798f/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:15.961865 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c237b-b8f0-49f3-b9d5-f28e1a9981bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3462ef393fa642ee9e1a9a2dfa58690c, user_id=102c0e41a572484fb65687059032798f, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:15.964636 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c237b-b8f0-49f3-b9d5-f28e1a9981bf admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:16.026197 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d5c55d20-c02d-453f-9fd0-10c30fda9998 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9666cc40bce1473c9c991b71d4704ff0'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:16.039576 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d5c55d20-c02d-453f-9fd0-10c30fda9998 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9666cc40bce1473c9c991b71d4704ff0'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:16.040217 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d5c55d20-c02d-453f-9fd0-10c30fda9998 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9666cc40bce1473c9c991b71d4704ff0'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:16.047807 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d5c55d20-c02d-453f-9fd0-10c30fda9998 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9666cc40bce1473c9c991b71d4704ff0'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:16.050456 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1064/2119] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:24:15 2022] PUT /identity/v3/projects/3462ef393fa642ee9e1a9a2dfa58690c/users/102c0e41a572484fb65687059032798f/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:16.051373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c237b-b8f0-49f3-b9d5-f28e1a9981bf admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:16.053102 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-584c237b-b8f0-49f3-b9d5-f28e1a9981bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:16.056011 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1056/2120] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:24:15 2022] DELETE /identity/v3/users/9666cc40bce1473c9c991b71d4704ff0 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:16.072954 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5d63c-f299-4676-85ef-0e0c5f593faf None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:16.073637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5d63c-f299-4676-85ef-0e0c5f593faf None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:16.074124 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c5d63c-f299-4676-85ef-0e0c5f593faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:16.112898 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-73c5d63c-f299-4676-85ef-0e0c5f593faf None None] MFA Rules not processed for user `102c0e41a572484fb65687059032798f`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:16.114067 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-73c5d63c-f299-4676-85ef-0e0c5f593faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:16.131907 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c237b-b8f0-49f3-b9d5-f28e1a9981bf admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:16.213755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1057/2121] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:16.214894 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5d63c-f299-4676-85ef-0e0c5f593faf None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:16.216767 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-73c5d63c-f299-4676-85ef-0e0c5f593faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:16.236621 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bc11a-7647-404b-ab43-b2b6d15c1c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:16.236621 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bc11a-7647-404b-ab43-b2b6d15c1c80 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:16.236621 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bc11a-7647-404b-ab43-b2b6d15c1c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:16.236621 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bc11a-7647-404b-ab43-b2b6d15c1c80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:16.237578 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bc11a-7647-404b-ab43-b2b6d15c1c80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:24:16.237578 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bc11a-7647-404b-ab43-b2b6d15c1c80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:16.239327 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bc11a-7647-404b-ab43-b2b6d15c1c80 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:16.258907 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1065/2122] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:24:16.265912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bc11a-7647-404b-ab43-b2b6d15c1c80 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:16.268162 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-971bc11a-7647-404b-ab43-b2b6d15c1c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:16.286110 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bc11a-7647-404b-ab43-b2b6d15c1c80 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:16.294834 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bab51b-794c-41d9-b9ea-9c9f44afa92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:16.294834 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bab51b-794c-41d9-b9ea-9c9f44afa92c admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:16.294834 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bab51b-794c-41d9-b9ea-9c9f44afa92c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:16.294834 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bab51b-794c-41d9-b9ea-9c9f44afa92c admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:16.295285 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bab51b-794c-41d9-b9ea-9c9f44afa92c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:16.297611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bab51b-794c-41d9-b9ea-9c9f44afa92c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:16.306544 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c5d63c-f299-4676-85ef-0e0c5f593faf None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:16.313562 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba537187-4266-4833-83ff-c0c2ca5d9c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:16.314210 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba537187-4266-4833-83ff-c0c2ca5d9c26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:16.314494 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba537187-4266-4833-83ff-c0c2ca5d9c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:16.314789 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba537187-4266-4833-83ff-c0c2ca5d9c26 admin admin] PATH_INFO: `/v3/projects/6f6a33d31cb0434aa49c41eb8bb6daa7` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:16.315960 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba537187-4266-4833-83ff-c0c2ca5d9c26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f6a33d31cb0434aa49c41eb8bb6daa7)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:16.318213 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba537187-4266-4833-83ff-c0c2ca5d9c26 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:16.392789 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1066/2123] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:24:16 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:24:16.392789 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bab51b-794c-41d9-b9ea-9c9f44afa92c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:16.427736 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ba537187-4266-4833-83ff-c0c2ca5d9c26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f6a33d31cb0434aa49c41eb8bb6daa7', 'request_id': 'req-ba537187-4266-4833-83ff-c0c2ca5d9c26'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:16.456821 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bab51b-794c-41d9-b9ea-9c9f44afa92c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:16.511259 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed4204-07e2-4e11-868f-e9bf0829b76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:16.511870 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed4204-07e2-4e11-868f-e9bf0829b76e admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:16.512177 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed4204-07e2-4e11-868f-e9bf0829b76e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:16.512513 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed4204-07e2-4e11-868f-e9bf0829b76e admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:16.513249 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed4204-07e2-4e11-868f-e9bf0829b76e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:16.515127 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed4204-07e2-4e11-868f-e9bf0829b76e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:16.586078 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ba537187-4266-4833-83ff-c0c2ca5d9c26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f6a33d31cb0434aa49c41eb8bb6daa7', 'request_id': 'req-ba537187-4266-4833-83ff-c0c2ca5d9c26'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:16.593008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ba537187-4266-4833-83ff-c0c2ca5d9c26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f6a33d31cb0434aa49c41eb8bb6daa7', 'request_id': 'req-ba537187-4266-4833-83ff-c0c2ca5d9c26'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:16.621282 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ba537187-4266-4833-83ff-c0c2ca5d9c26 admin admin] The token cache is being invalidate because project 6f6a33d31cb0434aa49c41eb8bb6daa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:24:16.621282 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ba537187-4266-4833-83ff-c0c2ca5d9c26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:16.621282 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ba537187-4266-4833-83ff-c0c2ca5d9c26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:16.621282 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1058/2124] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:24:16 2022] DELETE /identity/v3/projects/6f6a33d31cb0434aa49c41eb8bb6daa7 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:16.621282 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba537187-4266-4833-83ff-c0c2ca5d9c26 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:16.621826 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ba537187-4266-4833-83ff-c0c2ca5d9c26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:16.621974 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba537187-4266-4833-83ff-c0c2ca5d9c26 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:16.626645 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1fb55-46e5-4146-bb18-b414b0f8af1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:16.627245 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1fb55-46e5-4146-bb18-b414b0f8af1d admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:16.628236 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1fb55-46e5-4146-bb18-b414b0f8af1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:16.628522 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b1fb55-46e5-4146-bb18-b414b0f8af1d admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:16.629154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b1fb55-46e5-4146-bb18-b414b0f8af1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:16.631089 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b1fb55-46e5-4146-bb18-b414b0f8af1d admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:16.695148 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1067/2125] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:24:16 2022] POST /identity/v3/projects => generated 379 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:24:16.695148 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db044a-15e2-4884-b077-6ecd51a68943 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:16.695148 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db044a-15e2-4884-b077-6ecd51a68943 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:16.695148 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68db044a-15e2-4884-b077-6ecd51a68943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:16.717853 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-68db044a-15e2-4884-b077-6ecd51a68943 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:16.719073 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-68db044a-15e2-4884-b077-6ecd51a68943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:16.720539 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:16.729569 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1059/2126] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:24:16 2022] POST /identity/v3/users => generated 298 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:24:16.730731 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1fb55-46e5-4146-bb18-b414b0f8af1d admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:16.733640 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-08b1fb55-46e5-4146-bb18-b414b0f8af1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:16.747873 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b1fb55-46e5-4146-bb18-b414b0f8af1d admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:16.788332 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1068/2127] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:16.789578 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db044a-15e2-4884-b077-6ecd51a68943 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:16.791940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-68db044a-15e2-4884-b077-6ecd51a68943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:16.808975 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68db044a-15e2-4884-b077-6ecd51a68943 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:16.818483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d69d1-08e1-4939-8618-1b08dc1b6e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:16.819601 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d69d1-08e1-4939-8618-1b08dc1b6e38 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:16.819931 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d69d1-08e1-4939-8618-1b08dc1b6e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:16.820234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4eaf97-b959-4bbb-a5e9-40312fc968b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:16.820387 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d69d1-08e1-4939-8618-1b08dc1b6e38 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:16.821155 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4eaf97-b959-4bbb-a5e9-40312fc968b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:16.821538 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4eaf97-b959-4bbb-a5e9-40312fc968b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:16.821883 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4eaf97-b959-4bbb-a5e9-40312fc968b2 admin admin] PATH_INFO: `/v3/projects/5eabc0a621ad495cafa2240ed7277da3` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:16.823265 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4eaf97-b959-4bbb-a5e9-40312fc968b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eabc0a621ad495cafa2240ed7277da3)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:16.825808 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4eaf97-b959-4bbb-a5e9-40312fc968b2 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:16.829362 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d69d1-08e1-4939-8618-1b08dc1b6e38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:16.831990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d69d1-08e1-4939-8618-1b08dc1b6e38 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:16.866881 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:16.924024 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1069/2128] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:24:16 2022] POST /identity/v3/users => generated 290 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:24:16.924024 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d69d1-08e1-4939-8618-1b08dc1b6e38 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:16.941402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d69d1-08e1-4939-8618-1b08dc1b6e38 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:16.957775 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-3b4eaf97-b959-4bbb-a5e9-40312fc968b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eabc0a621ad495cafa2240ed7277da3', 'request_id': 'req-3b4eaf97-b959-4bbb-a5e9-40312fc968b2'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:17.019642 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42514b78-d355-4f03-ae8d-97b2f6c00957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:17.020350 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42514b78-d355-4f03-ae8d-97b2f6c00957 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:17.020638 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42514b78-d355-4f03-ae8d-97b2f6c00957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:17.020928 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42514b78-d355-4f03-ae8d-97b2f6c00957 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:17.022125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42514b78-d355-4f03-ae8d-97b2f6c00957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:17.023828 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42514b78-d355-4f03-ae8d-97b2f6c00957 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:17.034303 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-3b4eaf97-b959-4bbb-a5e9-40312fc968b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eabc0a621ad495cafa2240ed7277da3', 'request_id': 'req-3b4eaf97-b959-4bbb-a5e9-40312fc968b2'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:17.037437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1070/2129] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:16 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:17.042463 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb15ef-6464-4380-9ac7-7efab269f755 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:17.042812 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb15ef-6464-4380-9ac7-7efab269f755 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:17.043105 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb15ef-6464-4380-9ac7-7efab269f755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:17.043811 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-3b4eaf97-b959-4bbb-a5e9-40312fc968b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eabc0a621ad495cafa2240ed7277da3', 'request_id': 'req-3b4eaf97-b959-4bbb-a5e9-40312fc968b2'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:17.060797 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-3b4eaf97-b959-4bbb-a5e9-40312fc968b2 admin admin] The token cache is being invalidate because project 5eabc0a621ad495cafa2240ed7277da3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:24:17.061156 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-3b4eaf97-b959-4bbb-a5e9-40312fc968b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:17.061868 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-3b4eaf97-b959-4bbb-a5e9-40312fc968b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:17.065134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1060/2130] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:24:16 2022] DELETE /identity/v3/projects/5eabc0a621ad495cafa2240ed7277da3 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:17.065134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4eaf97-b959-4bbb-a5e9-40312fc968b2 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:17.067659 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-3b4eaf97-b959-4bbb-a5e9-40312fc968b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:17.070589 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-c5eb15ef-6464-4380-9ac7-7efab269f755 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:17.074825 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c5eb15ef-6464-4380-9ac7-7efab269f755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:17.085457 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4eaf97-b959-4bbb-a5e9-40312fc968b2 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:17.099872 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7359f04-c8c7-4d68-b1e0-31b00c1fd677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:17.099872 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7359f04-c8c7-4d68-b1e0-31b00c1fd677 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:17.099872 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7359f04-c8c7-4d68-b1e0-31b00c1fd677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:17.099872 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7359f04-c8c7-4d68-b1e0-31b00c1fd677 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:17.103293 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7359f04-c8c7-4d68-b1e0-31b00c1fd677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:17.103293 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7359f04-c8c7-4d68-b1e0-31b00c1fd677 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:17.103458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1071/2131] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:17.103458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb15ef-6464-4380-9ac7-7efab269f755 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:17.103458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c5eb15ef-6464-4380-9ac7-7efab269f755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:17.116527 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1061/2132] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:17.119222 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7f566-6480-4d02-83e6-c0c97f197754 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:17.119755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7f566-6480-4d02-83e6-c0c97f197754 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:17.120250 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7f566-6480-4d02-83e6-c0c97f197754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:17.122985 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb15ef-6464-4380-9ac7-7efab269f755 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:17.128966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddef1b-d6b2-4057-b0f7-031f3da1e5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:17.131481 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddef1b-d6b2-4057-b0f7-031f3da1e5b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:17.131481 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddef1b-d6b2-4057-b0f7-031f3da1e5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:17.131481 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddef1b-d6b2-4057-b0f7-031f3da1e5b5 admin admin] PATH_INFO: `/v3/projects/eab297759d134ed58b91b593ebbf5ad2/users/65647f8d723c4cd9bd3039a9c83fb666/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:17.146714 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-94b7f566-6480-4d02-83e6-c0c97f197754 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:17.148780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-94b7f566-6480-4d02-83e6-c0c97f197754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:17.157553 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ddef1b-d6b2-4057-b0f7-031f3da1e5b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eab297759d134ed58b91b593ebbf5ad2, user_id=65647f8d723c4cd9bd3039a9c83fb666, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:17.161080 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ddef1b-d6b2-4057-b0f7-031f3da1e5b5 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:17.162416 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1062/2133] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:17.169910 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7f566-6480-4d02-83e6-c0c97f197754 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:17.175347 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7f566-6480-4d02-83e6-c0c97f197754 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:17.180297 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0733fca-d14b-48a0-8869-54eb49185c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:17.180914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0733fca-d14b-48a0-8869-54eb49185c99 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:17.181323 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0733fca-d14b-48a0-8869-54eb49185c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:17.181603 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0733fca-d14b-48a0-8869-54eb49185c99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:17.182367 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0733fca-d14b-48a0-8869-54eb49185c99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:24:17.182553 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0733fca-d14b-48a0-8869-54eb49185c99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:17.185293 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0733fca-d14b-48a0-8869-54eb49185c99 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:17.204284 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1063/2134] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:24:17.205326 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0733fca-d14b-48a0-8869-54eb49185c99 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:17.219010 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0733fca-d14b-48a0-8869-54eb49185c99 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:17.225762 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bb2af-9fc8-4304-9873-5529672dd6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:17.225762 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bb2af-9fc8-4304-9873-5529672dd6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:17.225762 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bb2af-9fc8-4304-9873-5529672dd6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:17.226211 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bb2af-9fc8-4304-9873-5529672dd6d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:17.226753 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630bb2af-9fc8-4304-9873-5529672dd6d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:17.228418 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630bb2af-9fc8-4304-9873-5529672dd6d2 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:17.239859 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1064/2135] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:17.241210 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2824a82-6ed3-4f32-9d4e-1ea9c138f58c None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:17.241501 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2824a82-6ed3-4f32-9d4e-1ea9c138f58c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:17.241778 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2824a82-6ed3-4f32-9d4e-1ea9c138f58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:17.262065 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-d2824a82-6ed3-4f32-9d4e-1ea9c138f58c None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:17.263307 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d2824a82-6ed3-4f32-9d4e-1ea9c138f58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:17.274905 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1065/2136] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:17.275654 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2824a82-6ed3-4f32-9d4e-1ea9c138f58c None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:17.290041 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2824a82-6ed3-4f32-9d4e-1ea9c138f58c None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:17.294128 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1072/2137] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:24:17 2022] PUT /identity/v3/projects/eab297759d134ed58b91b593ebbf5ad2/users/65647f8d723c4cd9bd3039a9c83fb666/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:17.294128 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddef1b-d6b2-4057-b0f7-031f3da1e5b5 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:17.387339 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd619c9-1681-41ff-ae35-440eb28a1efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:17.387964 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd619c9-1681-41ff-ae35-440eb28a1efd admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:17.388302 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd619c9-1681-41ff-ae35-440eb28a1efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:17.388629 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd619c9-1681-41ff-ae35-440eb28a1efd admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:17.389277 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd619c9-1681-41ff-ae35-440eb28a1efd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:17.391699 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd619c9-1681-41ff-ae35-440eb28a1efd admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:17.394712 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddef1b-d6b2-4057-b0f7-031f3da1e5b5 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:17.403100 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d901c-582a-43e8-bcd1-9ca4ad064cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:17.404024 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d901c-582a-43e8-bcd1-9ca4ad064cc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:17.404347 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d901c-582a-43e8-bcd1-9ca4ad064cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:17.404631 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d901c-582a-43e8-bcd1-9ca4ad064cc5 admin admin] PATH_INFO: `/v3/projects/38f7d46e72e94af784fb08557095e5ca/users/bd385d761783466bb6a8a1a95e5ea913/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:17.432287 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d901c-582a-43e8-bcd1-9ca4ad064cc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38f7d46e72e94af784fb08557095e5ca, user_id=bd385d761783466bb6a8a1a95e5ea913, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:17.435157 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d901c-582a-43e8-bcd1-9ca4ad064cc5 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:17.507150 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1073/2138] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:24:17 2022] PUT /identity/v3/projects/38f7d46e72e94af784fb08557095e5ca/users/bd385d761783466bb6a8a1a95e5ea913/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:17.508142 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d901c-582a-43e8-bcd1-9ca4ad064cc5 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:17.514953 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1066/2139] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:24:17 2022] POST /identity/v3/projects => generated 375 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:24:17.514953 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd619c9-1681-41ff-ae35-440eb28a1efd admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:17.554319 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:17.584127 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d901c-582a-43e8-bcd1-9ca4ad064cc5 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:17.589354 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4992488-6ba1-43a5-a875-041995430f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:17.590167 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4992488-6ba1-43a5-a875-041995430f8a admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:17.590298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd619c9-1681-41ff-ae35-440eb28a1efd admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:17.592412 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4992488-6ba1-43a5-a875-041995430f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:17.592736 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4992488-6ba1-43a5-a875-041995430f8a admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:17.593478 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4992488-6ba1-43a5-a875-041995430f8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:24:17.593748 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4992488-6ba1-43a5-a875-041995430f8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:17.595378 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4992488-6ba1-43a5-a875-041995430f8a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:17.597028 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3909f-0651-44a1-a845-b5feb9c48440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:17.601106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3909f-0651-44a1-a845-b5feb9c48440 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:17.601106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3909f-0651-44a1-a845-b5feb9c48440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:17.601106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3909f-0651-44a1-a845-b5feb9c48440 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:17.601106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3909f-0651-44a1-a845-b5feb9c48440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:17.601106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3909f-0651-44a1-a845-b5feb9c48440 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:17.612409 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1074/2140] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:24:17.613858 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4992488-6ba1-43a5-a875-041995430f8a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:17.618154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1067/2141] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:17.618154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82625ef4-b847-40af-bf39-342686f825df None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:17.618154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82625ef4-b847-40af-bf39-342686f825df None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:17.618154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82625ef4-b847-40af-bf39-342686f825df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:17.631070 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4992488-6ba1-43a5-a875-041995430f8a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:17.636909 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21b48e-92cb-45b2-b8ab-904004b45def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:17.637566 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21b48e-92cb-45b2-b8ab-904004b45def admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:17.637945 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21b48e-92cb-45b2-b8ab-904004b45def admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:17.638297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21b48e-92cb-45b2-b8ab-904004b45def admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:17.638952 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21b48e-92cb-45b2-b8ab-904004b45def admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:17.641169 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21b48e-92cb-45b2-b8ab-904004b45def admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:17.649679 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-82625ef4-b847-40af-bf39-342686f825df None None] MFA Rules not processed for user `bd385d761783466bb6a8a1a95e5ea913`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:17.651318 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-82625ef4-b847-40af-bf39-342686f825df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:17.712358 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1075/2142] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:24:17 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:24:17.713182 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21b48e-92cb-45b2-b8ab-904004b45def admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:17.720843 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1068/2143] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:17.722220 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82625ef4-b847-40af-bf39-342686f825df None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:17.723314 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21b48e-92cb-45b2-b8ab-904004b45def admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:17.728190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624184d-5b48-49c5-a832-bdaeea1290f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:17.728812 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624184d-5b48-49c5-a832-bdaeea1290f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:17.729101 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624184d-5b48-49c5-a832-bdaeea1290f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:17.729381 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624184d-5b48-49c5-a832-bdaeea1290f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:17.730007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624184d-5b48-49c5-a832-bdaeea1290f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:17.731943 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624184d-5b48-49c5-a832-bdaeea1290f2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:17.732802 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82625ef4-b847-40af-bf39-342686f825df None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:17.738104 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a7e2c-2205-4a88-90c1-d82ee9dd97a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:17.738868 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a7e2c-2205-4a88-90c1-d82ee9dd97a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:17.739159 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a7e2c-2205-4a88-90c1-d82ee9dd97a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:17.739422 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a7e2c-2205-4a88-90c1-d82ee9dd97a3 admin admin] PATH_INFO: `/v3/projects/eab297759d134ed58b91b593ebbf5ad2/users/65647f8d723c4cd9bd3039a9c83fb666/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:17.741360 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a7e2c-2205-4a88-90c1-d82ee9dd97a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eab297759d134ed58b91b593ebbf5ad2, user_id=65647f8d723c4cd9bd3039a9c83fb666, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:17.743986 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a7e2c-2205-4a88-90c1-d82ee9dd97a3 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:17.754295 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1069/2144] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:24:17 2022] PUT /identity/v3/projects/eab297759d134ed58b91b593ebbf5ad2/users/65647f8d723c4cd9bd3039a9c83fb666/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:17.755093 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a7e2c-2205-4a88-90c1-d82ee9dd97a3 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:17.784314 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:17.841508 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a7e2c-2205-4a88-90c1-d82ee9dd97a3 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:17.847215 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df29a0-86d5-4665-aa4f-39b8fd99322f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:17.848010 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df29a0-86d5-4665-aa4f-39b8fd99322f admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:17.848263 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df29a0-86d5-4665-aa4f-39b8fd99322f admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:17.848437 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df29a0-86d5-4665-aa4f-39b8fd99322f admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:17.849060 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df29a0-86d5-4665-aa4f-39b8fd99322f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:17.852446 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73df29a0-86d5-4665-aa4f-39b8fd99322f admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:17.860691 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1076/2145] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:24:17 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:24:17.863088 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624184d-5b48-49c5-a832-bdaeea1290f2 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:17.863997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1070/2146] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:17.865200 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a828b40-42a1-414a-b7fb-7fb28694767c None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:17.865485 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a828b40-42a1-414a-b7fb-7fb28694767c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:17.865758 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a828b40-42a1-414a-b7fb-7fb28694767c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:17.900032 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-0a828b40-42a1-414a-b7fb-7fb28694767c None None] MFA Rules not processed for user `65647f8d723c4cd9bd3039a9c83fb666`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:17.901425 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-0a828b40-42a1-414a-b7fb-7fb28694767c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:17.953774 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624184d-5b48-49c5-a832-bdaeea1290f2 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:17.962568 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48295e26-6859-4c7e-a624-0d8217c74857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:17.963581 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48295e26-6859-4c7e-a624-0d8217c74857 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:17.963973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48295e26-6859-4c7e-a624-0d8217c74857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:17.964323 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48295e26-6859-4c7e-a624-0d8217c74857 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:17.965065 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48295e26-6859-4c7e-a624-0d8217c74857 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:17.967346 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48295e26-6859-4c7e-a624-0d8217c74857 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:18.019471 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1071/2147] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:17 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:18.021070 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a828b40-42a1-414a-b7fb-7fb28694767c None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:18.038983 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a828b40-42a1-414a-b7fb-7fb28694767c None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:18.044650 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c7b4e-66ed-47df-8d6f-8fcc671092c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:18.045440 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c7b4e-66ed-47df-8d6f-8fcc671092c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:18.045936 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c7b4e-66ed-47df-8d6f-8fcc671092c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:18.046286 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90c7b4e-66ed-47df-8d6f-8fcc671092c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:18.047130 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c7b4e-66ed-47df-8d6f-8fcc671092c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:18.049547 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90c7b4e-66ed-47df-8d6f-8fcc671092c6 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:18.068519 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1077/2148] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:24:17 2022] POST /identity/v3/projects => generated 377 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:24:18.069494 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48295e26-6859-4c7e-a624-0d8217c74857 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:18.145353 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48295e26-6859-4c7e-a624-0d8217c74857 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:18.152915 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1072/2149] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:24:18 2022] POST /identity/v3/users => generated 287 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:24:18.153711 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c7b4e-66ed-47df-8d6f-8fcc671092c6 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:18.155407 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e90c7b4e-66ed-47df-8d6f-8fcc671092c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:18.159921 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f394d-488a-4e23-a8d3-d30c52a2bcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:18.160599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f394d-488a-4e23-a8d3-d30c52a2bcad admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:18.160878 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f394d-488a-4e23-a8d3-d30c52a2bcad admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:18.161147 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f394d-488a-4e23-a8d3-d30c52a2bcad admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:18.161940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f394d-488a-4e23-a8d3-d30c52a2bcad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:18.163530 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f394d-488a-4e23-a8d3-d30c52a2bcad admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:18.174408 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1078/2150] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:18.178254 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f394d-488a-4e23-a8d3-d30c52a2bcad admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:18.188327 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f394d-488a-4e23-a8d3-d30c52a2bcad admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:18.193949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42e622-0e34-441b-9a16-daa501254220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:18.194566 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42e622-0e34-441b-9a16-daa501254220 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:18.194846 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42e622-0e34-441b-9a16-daa501254220 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:18.195118 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42e622-0e34-441b-9a16-daa501254220 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:18.195749 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42e622-0e34-441b-9a16-daa501254220 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:18.198781 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42e622-0e34-441b-9a16-daa501254220 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:18.232815 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90c7b4e-66ed-47df-8d6f-8fcc671092c6 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:18.285886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1079/2151] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:24:18 2022] POST /identity/v3/users => generated 295 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:24:18.287376 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42e622-0e34-441b-9a16-daa501254220 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:18.290140 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43083c0-7ccf-45f4-8853-399a807d55a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:18.301198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43083c0-7ccf-45f4-8853-399a807d55a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:18.301198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43083c0-7ccf-45f4-8853-399a807d55a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:18.301198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43083c0-7ccf-45f4-8853-399a807d55a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:18.301198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c43083c0-7ccf-45f4-8853-399a807d55a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:18.301799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42e622-0e34-441b-9a16-daa501254220 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:18.305271 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d456e-5b60-4400-9ced-7ce38e83f4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:18.306648 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d456e-5b60-4400-9ced-7ce38e83f4cd admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:18.306648 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d456e-5b60-4400-9ced-7ce38e83f4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:18.306648 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d456e-5b60-4400-9ced-7ce38e83f4cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:18.307424 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d456e-5b60-4400-9ced-7ce38e83f4cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:18.308986 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d456e-5b60-4400-9ced-7ce38e83f4cd admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:18.321915 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1080/2152] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:18.323252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d456e-5b60-4400-9ced-7ce38e83f4cd admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:18.336044 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d456e-5b60-4400-9ced-7ce38e83f4cd admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:18.341198 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ca6e9-94b0-4c85-b611-58055f2b7bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:18.342004 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ca6e9-94b0-4c85-b611-58055f2b7bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:18.342277 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ca6e9-94b0-4c85-b611-58055f2b7bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:18.342551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ca6e9-94b0-4c85-b611-58055f2b7bfe admin admin] PATH_INFO: `/v3/projects/ffcce2fc82cd408098314577d292de54/users/7e90da0230e649ff9f36f057c251a553/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:18.348252 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:18.364545 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ca6e9-94b0-4c85-b611-58055f2b7bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffcce2fc82cd408098314577d292de54, user_id=7e90da0230e649ff9f36f057c251a553, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:18.367289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469ca6e9-94b0-4c85-b611-58055f2b7bfe admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:18.372941 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:18.374854 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43083c0-7ccf-45f4-8853-399a807d55a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:18.377138 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43083c0-7ccf-45f4-8853-399a807d55a6 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:18.389954 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1073/2153] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:24:18.390874 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43083c0-7ccf-45f4-8853-399a807d55a6 service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:18.405128 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43083c0-7ccf-45f4-8853-399a807d55a6 service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:18.409208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96495b0c-7760-478c-9007-e4816012b586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:18.409958 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96495b0c-7760-478c-9007-e4816012b586 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:18.410243 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96495b0c-7760-478c-9007-e4816012b586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:18.410550 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96495b0c-7760-478c-9007-e4816012b586 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:18.411202 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96495b0c-7760-478c-9007-e4816012b586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:18.412823 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96495b0c-7760-478c-9007-e4816012b586 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:18.422977 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1081/2154] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:24:18 2022] PUT /identity/v3/projects/ffcce2fc82cd408098314577d292de54/users/7e90da0230e649ff9f36f057c251a553/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:18.424497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ca6e9-94b0-4c85-b611-58055f2b7bfe admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:18.428463 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1074/2155] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:18.429341 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96495b0c-7760-478c-9007-e4816012b586 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:18.458031 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96495b0c-7760-478c-9007-e4816012b586 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:18.527913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ca6e9-94b0-4c85-b611-58055f2b7bfe admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:18.533710 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a57cc-8646-488c-9622-1dc0202b822d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:18.534345 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a57cc-8646-488c-9622-1dc0202b822d admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:18.534633 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a57cc-8646-488c-9622-1dc0202b822d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:18.534895 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a57cc-8646-488c-9622-1dc0202b822d admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:18.535675 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a57cc-8646-488c-9622-1dc0202b822d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:18.537203 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a57cc-8646-488c-9622-1dc0202b822d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:18.555569 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1082/2156] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:18.557955 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4212a9c-4946-46a6-bb33-a16fdb202dab None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:18.558551 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a6927-6b33-4b50-80fb-893a31bb1647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:18.558807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4212a9c-4946-46a6-bb33-a16fdb202dab None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:18.559417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a6927-6b33-4b50-80fb-893a31bb1647 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:18.559629 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4212a9c-4946-46a6-bb33-a16fdb202dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:18.560448 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a6927-6b33-4b50-80fb-893a31bb1647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:18.561488 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a6927-6b33-4b50-80fb-893a31bb1647 admin admin] PATH_INFO: `/v3/projects/169a78f58e1c45658158d8007dc052b3/users/57681995ccb44d5691a0e94ed124e8db/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:18.583497 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a6927-6b33-4b50-80fb-893a31bb1647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=169a78f58e1c45658158d8007dc052b3, user_id=57681995ccb44d5691a0e94ed124e8db, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:18.586910 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a6927-6b33-4b50-80fb-893a31bb1647 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:18.605943 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-e4212a9c-4946-46a6-bb33-a16fdb202dab None None] MFA Rules not processed for user `7e90da0230e649ff9f36f057c251a553`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:18.609534 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e4212a9c-4946-46a6-bb33-a16fdb202dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:18.669687 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1075/2157] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:24:18 2022] PUT /identity/v3/projects/169a78f58e1c45658158d8007dc052b3/users/57681995ccb44d5691a0e94ed124e8db/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:18.670950 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a6927-6b33-4b50-80fb-893a31bb1647 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:18.681241 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1083/2158] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:18.681241 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4212a9c-4946-46a6-bb33-a16fdb202dab None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:18.691628 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4212a9c-4946-46a6-bb33-a16fdb202dab None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:18.772158 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40ae18-f5d6-48d0-b9ce-eb446a2193c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:18.772158 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40ae18-f5d6-48d0-b9ce-eb446a2193c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:18.772158 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40ae18-f5d6-48d0-b9ce-eb446a2193c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:18.772158 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d40ae18-f5d6-48d0-b9ce-eb446a2193c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:18.772557 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40ae18-f5d6-48d0-b9ce-eb446a2193c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:18.773817 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d40ae18-f5d6-48d0-b9ce-eb446a2193c8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:18.774018 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a6927-6b33-4b50-80fb-893a31bb1647 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:18.779311 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce52cfc-856a-49fa-b3a9-14729ee23231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:18.779991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce52cfc-856a-49fa-b3a9-14729ee23231 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:18.780314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce52cfc-856a-49fa-b3a9-14729ee23231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:18.780589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce52cfc-856a-49fa-b3a9-14729ee23231 admin admin] PATH_INFO: `/v3/projects/b41bf1b3a81a4a90972eaeac2a6225a9/users/33be372f4c694ce688f4a958730590ee/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:18.785110 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1084/2159] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:18.786016 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40ae18-f5d6-48d0-b9ce-eb446a2193c8 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:18.788341 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8d40ae18-f5d6-48d0-b9ce-eb446a2193c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:18.796536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce52cfc-856a-49fa-b3a9-14729ee23231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b41bf1b3a81a4a90972eaeac2a6225a9, user_id=33be372f4c694ce688f4a958730590ee, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:18.800949 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce52cfc-856a-49fa-b3a9-14729ee23231 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:18.844688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d40ae18-f5d6-48d0-b9ce-eb446a2193c8 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:18.852813 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb1d78-1c1b-4faa-93cd-e41cd497fe43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:18.853436 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb1d78-1c1b-4faa-93cd-e41cd497fe43 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:18.853768 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb1d78-1c1b-4faa-93cd-e41cd497fe43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:18.853995 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb1d78-1c1b-4faa-93cd-e41cd497fe43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:18.911817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1076/2160] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:24:18 2022] PUT /identity/v3/projects/b41bf1b3a81a4a90972eaeac2a6225a9/users/33be372f4c694ce688f4a958730590ee/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:18.913418 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce52cfc-856a-49fa-b3a9-14729ee23231 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:18.942251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb1d78-1c1b-4faa-93cd-e41cd497fe43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:18.943471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb1d78-1c1b-4faa-93cd-e41cd497fe43 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:18.956585 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1085/2161] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:24:18.958583 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f1fd7-a280-491e-a15d-d4adfcc91022 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:18.959057 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f1fd7-a280-491e-a15d-d4adfcc91022 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:18.960652 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f1fd7-a280-491e-a15d-d4adfcc91022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:19.002082 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:19.007003 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-635f1fd7-a280-491e-a15d-d4adfcc91022 None None] MFA Rules not processed for user `33be372f4c694ce688f4a958730590ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:19.008879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-635f1fd7-a280-491e-a15d-d4adfcc91022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:19.009000 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce52cfc-856a-49fa-b3a9-14729ee23231 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:19.015191 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780ed86-180c-4b31-8daa-6000e32901e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:19.015937 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780ed86-180c-4b31-8daa-6000e32901e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:19.016258 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780ed86-180c-4b31-8daa-6000e32901e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:19.016549 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780ed86-180c-4b31-8daa-6000e32901e9 admin admin] PATH_INFO: `/v3/projects/169a78f58e1c45658158d8007dc052b3/users/57681995ccb44d5691a0e94ed124e8db/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:19.019787 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780ed86-180c-4b31-8daa-6000e32901e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=169a78f58e1c45658158d8007dc052b3, user_id=57681995ccb44d5691a0e94ed124e8db, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:19.022932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780ed86-180c-4b31-8daa-6000e32901e9 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:19.036631 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1077/2162] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:24:18 2022] PUT /identity/v3/projects/169a78f58e1c45658158d8007dc052b3/users/57681995ccb44d5691a0e94ed124e8db/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:19.047576 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1700f-a36e-46cb-aa4f-5c76ca34691f None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:19.047860 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1700f-a36e-46cb-aa4f-5c76ca34691f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:19.048229 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f1700f-a36e-46cb-aa4f-5c76ca34691f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:19.098751 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f3f1700f-a36e-46cb-aa4f-5c76ca34691f None None] MFA Rules not processed for user `57681995ccb44d5691a0e94ed124e8db`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:19.099989 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f3f1700f-a36e-46cb-aa4f-5c76ca34691f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:19.103403 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:19.183261 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1086/2163] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:19.188572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f1fd7-a280-491e-a15d-d4adfcc91022 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:19.212560 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f1fd7-a280-491e-a15d-d4adfcc91022 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:19.288725 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1078/2164] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:24:19.313607 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1700f-a36e-46cb-aa4f-5c76ca34691f None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:19.370626 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba9383-0edd-43fa-a955-992c2bb8c5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:19.371800 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba9383-0edd-43fa-a955-992c2bb8c5a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:19.372210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba9383-0edd-43fa-a955-992c2bb8c5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:19.372666 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba9383-0edd-43fa-a955-992c2bb8c5a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:19.373714 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba9383-0edd-43fa-a955-992c2bb8c5a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:19.376924 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ba9383-0edd-43fa-a955-992c2bb8c5a7 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:19.386435 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f1700f-a36e-46cb-aa4f-5c76ca34691f None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:19.397449 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f788e-3bdc-45b1-b826-cce48284040e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:19.399601 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f788e-3bdc-45b1-b826-cce48284040e service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:19.400226 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f788e-3bdc-45b1-b826-cce48284040e service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:19.400680 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f788e-3bdc-45b1-b826-cce48284040e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:19.464967 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f788e-3bdc-45b1-b826-cce48284040e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:19.467132 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f788e-3bdc-45b1-b826-cce48284040e service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:19.473964 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:19.482769 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1079/2165] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:24:19.504838 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1087/2166] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:24:19 2022] POST /identity/v3/projects => generated 375 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:24:19.508904 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f788e-3bdc-45b1-b826-cce48284040e service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:19.522618 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f788e-3bdc-45b1-b826-cce48284040e service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:19.608333 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba5b76-b2d6-4dc0-8b41-a1bc9c955782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:19.609101 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba5b76-b2d6-4dc0-8b41-a1bc9c955782 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:19.609503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba5b76-b2d6-4dc0-8b41-a1bc9c955782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:19.609987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba5b76-b2d6-4dc0-8b41-a1bc9c955782 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:19.610461 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba5b76-b2d6-4dc0-8b41-a1bc9c955782 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:19.612749 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba5b76-b2d6-4dc0-8b41-a1bc9c955782 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:19.749737 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1080/2167] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:24:19 2022] POST /identity/v3/users => generated 294 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:24:19.754021 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba9383-0edd-43fa-a955-992c2bb8c5a7 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:19.772727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba9383-0edd-43fa-a955-992c2bb8c5a7 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:19.779766 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea23b4-3d1e-4259-8881-2e706d6af172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:19.780777 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea23b4-3d1e-4259-8881-2e706d6af172 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:19.781271 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea23b4-3d1e-4259-8881-2e706d6af172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:19.781551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ea23b4-3d1e-4259-8881-2e706d6af172 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:19.782210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea23b4-3d1e-4259-8881-2e706d6af172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:19.785642 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ea23b4-3d1e-4259-8881-2e706d6af172 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:19.805512 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1088/2168] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:19.809499 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba5b76-b2d6-4dc0-8b41-a1bc9c955782 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:19.821369 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba5b76-b2d6-4dc0-8b41-a1bc9c955782 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:19.827960 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fe447-ce7e-43d8-8433-d330c1dc5610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:19.828679 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fe447-ce7e-43d8-8433-d330c1dc5610 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:19.829392 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fe447-ce7e-43d8-8433-d330c1dc5610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:19.829392 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38fe447-ce7e-43d8-8433-d330c1dc5610 admin admin] PATH_INFO: `/v3/projects/1a7f9e56659a42aca6b19bc2f0d9e225/users/b9952018510a41c8ae58f77526f8d2cf/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:19.853689 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fe447-ce7e-43d8-8433-d330c1dc5610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a7f9e56659a42aca6b19bc2f0d9e225, user_id=b9952018510a41c8ae58f77526f8d2cf, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:19.857112 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38fe447-ce7e-43d8-8433-d330c1dc5610 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:19.958212 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1081/2169] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:24:19 2022] PUT /identity/v3/projects/1a7f9e56659a42aca6b19bc2f0d9e225/users/b9952018510a41c8ae58f77526f8d2cf/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:19.959198 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea23b4-3d1e-4259-8881-2e706d6af172 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:19.975701 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ea23b4-3d1e-4259-8881-2e706d6af172 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:20.042937 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee30e1-6a9a-41d7-921c-196f4ffb4e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:20.043536 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee30e1-6a9a-41d7-921c-196f4ffb4e5a admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:20.043818 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee30e1-6a9a-41d7-921c-196f4ffb4e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:20.044558 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee30e1-6a9a-41d7-921c-196f4ffb4e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:20.045203 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee30e1-6a9a-41d7-921c-196f4ffb4e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:20.047161 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee30e1-6a9a-41d7-921c-196f4ffb4e5a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:20.057772 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1089/2170] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:20.061444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:20.062734 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fe447-ce7e-43d8-8433-d330c1dc5610 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:20.088264 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38fe447-ce7e-43d8-8433-d330c1dc5610 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:20.088264 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc8519-78c3-45ef-a684-58bdece67a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:20.088264 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc8519-78c3-45ef-a684-58bdece67a43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:20.088264 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc8519-78c3-45ef-a684-58bdece67a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:20.088678 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc8519-78c3-45ef-a684-58bdece67a43 admin admin] PATH_INFO: `/v3/projects/1a7f9e56659a42aca6b19bc2f0d9e225/users/b9952018510a41c8ae58f77526f8d2cf/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:20.090143 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc8519-78c3-45ef-a684-58bdece67a43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a7f9e56659a42aca6b19bc2f0d9e225, user_id=b9952018510a41c8ae58f77526f8d2cf, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:20.092932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accc8519-78c3-45ef-a684-58bdece67a43 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:20.103871 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1082/2171] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:24:20 2022] PUT /identity/v3/projects/1a7f9e56659a42aca6b19bc2f0d9e225/users/b9952018510a41c8ae58f77526f8d2cf/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:20.115172 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a0afd-dfee-44d0-8b99-e4a92f46e3da None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:20.115456 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a0afd-dfee-44d0-8b99-e4a92f46e3da None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:20.115731 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a0afd-dfee-44d0-8b99-e4a92f46e3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:20.146812 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-562a0afd-dfee-44d0-8b99-e4a92f46e3da None None] MFA Rules not processed for user `b9952018510a41c8ae58f77526f8d2cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:20.148174 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-562a0afd-dfee-44d0-8b99-e4a92f46e3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:20.245000 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1090/2172] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:20.265178 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc8519-78c3-45ef-a684-58bdece67a43 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:20.333826 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:20.339111 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc8519-78c3-45ef-a684-58bdece67a43 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:20.342756 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6995fe49-9ce6-443b-b411-30104f76584a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:20.343467 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995fe49-9ce6-443b-b411-30104f76584a service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:20.343745 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995fe49-9ce6-443b-b411-30104f76584a service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:20.344015 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6995fe49-9ce6-443b-b411-30104f76584a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:20.409466 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:20.409836 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995fe49-9ce6-443b-b411-30104f76584a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:20.412040 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6995fe49-9ce6-443b-b411-30104f76584a service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:20.423594 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1083/2173] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:24:20.591663 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a0afd-dfee-44d0-8b99-e4a92f46e3da None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:20.606555 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a0afd-dfee-44d0-8b99-e4a92f46e3da None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:20.611046 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382a6ed-c9fe-4110-a789-c83f33cca1af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:20.612672 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382a6ed-c9fe-4110-a789-c83f33cca1af service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:20.612798 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382a6ed-c9fe-4110-a789-c83f33cca1af service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:20.613127 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382a6ed-c9fe-4110-a789-c83f33cca1af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:20.615004 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9382a6ed-c9fe-4110-a789-c83f33cca1af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:20.679536 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382a6ed-c9fe-4110-a789-c83f33cca1af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:20.681042 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382a6ed-c9fe-4110-a789-c83f33cca1af service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:20.690371 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1091/2174] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:24:20.957746 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:21.134906 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:21.322706 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0c83f-1c9c-43c2-9213-577c38b769c4 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:21.323251 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0c83f-1c9c-43c2-9213-577c38b769c4 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:21.324022 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c0c83f-1c9c-43c2-9213-577c38b769c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:21.357867 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-72c0c83f-1c9c-43c2-9213-577c38b769c4 None None] MFA Rules not processed for user `7e90da0230e649ff9f36f057c251a553`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:21.359156 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-72c0c83f-1c9c-43c2-9213-577c38b769c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:21.433765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382a6ed-c9fe-4110-a789-c83f33cca1af service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:21.444075 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382a6ed-c9fe-4110-a789-c83f33cca1af service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:21.448394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfbbed-b734-40fc-abec-5b5d6920c75d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:21.449106 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfbbed-b734-40fc-abec-5b5d6920c75d service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:21.449476 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfbbed-b734-40fc-abec-5b5d6920c75d service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:21.449953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bfbbed-b734-40fc-abec-5b5d6920c75d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:21.452385 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1084/2175] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:21.510573 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:21.546500 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfbbed-b734-40fc-abec-5b5d6920c75d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:21.547984 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bfbbed-b734-40fc-abec-5b5d6920c75d service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:21.558111 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1092/2176] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:24:21.906768 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:22.050428 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:22.220150 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:22.277922 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:22.408198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0c83f-1c9c-43c2-9213-577c38b769c4 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:22.422977 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c0c83f-1c9c-43c2-9213-577c38b769c4 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:22.423373 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2fe35-aab9-4117-bc0c-be2cf4b220c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:22.423986 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2fe35-aab9-4117-bc0c-be2cf4b220c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:22.424972 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2fe35-aab9-4117-bc0c-be2cf4b220c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:22.425253 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2fe35-aab9-4117-bc0c-be2cf4b220c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:22.487857 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b2fe35-aab9-4117-bc0c-be2cf4b220c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:22.489386 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b2fe35-aab9-4117-bc0c-be2cf4b220c2 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:22.499249 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1085/2177] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:22 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:24:22.678283 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:22.844184 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:23.004190 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:23.763142 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfbbed-b734-40fc-abec-5b5d6920c75d service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:23.827981 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:23.832667 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bfbbed-b734-40fc-abec-5b5d6920c75d service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:23.838447 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139ec74-58a0-47f9-9d59-a59f2d962793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:23.839315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139ec74-58a0-47f9-9d59-a59f2d962793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:23.839695 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139ec74-58a0-47f9-9d59-a59f2d962793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:23.840161 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139ec74-58a0-47f9-9d59-a59f2d962793 admin admin] PATH_INFO: `/v3/users/33be372f4c694ce688f4a958730590ee` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:23.842675 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139ec74-58a0-47f9-9d59-a59f2d962793 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33be372f4c694ce688f4a958730590ee)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:23.844758 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0139ec74-58a0-47f9-9d59-a59f2d962793 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:24.049732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0139ec74-58a0-47f9-9d59-a59f2d962793 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33be372f4c694ce688f4a958730590ee'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:24.162893 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0139ec74-58a0-47f9-9d59-a59f2d962793 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33be372f4c694ce688f4a958730590ee'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:24.182265 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0139ec74-58a0-47f9-9d59-a59f2d962793 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33be372f4c694ce688f4a958730590ee'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:24.183307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0139ec74-58a0-47f9-9d59-a59f2d962793 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33be372f4c694ce688f4a958730590ee'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:24.193318 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0139ec74-58a0-47f9-9d59-a59f2d962793 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33be372f4c694ce688f4a958730590ee'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:24.197531 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1093/2178] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:24:23 2022] DELETE /identity/v3/users/33be372f4c694ce688f4a958730590ee => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:24.204308 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af37d70-93bb-43ae-811e-b4603a4e111a None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:24.204817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af37d70-93bb-43ae-811e-b4603a4e111a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:24.205079 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af37d70-93bb-43ae-811e-b4603a4e111a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:24.229475 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-1af37d70-93bb-43ae-811e-b4603a4e111a None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:24.231561 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1af37d70-93bb-43ae-811e-b4603a4e111a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:24.307499 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1086/2179] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:24.314363 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139ec74-58a0-47f9-9d59-a59f2d962793 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:24.316374 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0139ec74-58a0-47f9-9d59-a59f2d962793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:24.398935 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0139ec74-58a0-47f9-9d59-a59f2d962793 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:24.403503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1910c-3215-4375-aebd-01d11f6b6f0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:24.404780 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1910c-3215-4375-aebd-01d11f6b6f0a service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:24.405085 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1910c-3215-4375-aebd-01d11f6b6f0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:24.405395 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1910c-3215-4375-aebd-01d11f6b6f0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:24.427139 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d1910c-3215-4375-aebd-01d11f6b6f0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:24.429687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d1910c-3215-4375-aebd-01d11f6b6f0a service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:24.442313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1094/2180] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:24:24.987983 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af37d70-93bb-43ae-811e-b4603a4e111a None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:24.989502 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1af37d70-93bb-43ae-811e-b4603a4e111a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:25.002031 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af37d70-93bb-43ae-811e-b4603a4e111a None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:25.009603 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342c56e-21d0-41c6-a403-4b92675a8157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:25.010589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342c56e-21d0-41c6-a403-4b92675a8157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:25.010980 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342c56e-21d0-41c6-a403-4b92675a8157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:25.011365 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342c56e-21d0-41c6-a403-4b92675a8157 admin admin] PATH_INFO: `/v3/projects/b41bf1b3a81a4a90972eaeac2a6225a9` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:25.013205 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342c56e-21d0-41c6-a403-4b92675a8157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b41bf1b3a81a4a90972eaeac2a6225a9)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:25.015305 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342c56e-21d0-41c6-a403-4b92675a8157 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:25.210310 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9342c56e-21d0-41c6-a403-4b92675a8157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b41bf1b3a81a4a90972eaeac2a6225a9', 'request_id': 'req-9342c56e-21d0-41c6-a403-4b92675a8157'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:25.300929 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9342c56e-21d0-41c6-a403-4b92675a8157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b41bf1b3a81a4a90972eaeac2a6225a9', 'request_id': 'req-9342c56e-21d0-41c6-a403-4b92675a8157'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:25.307409 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9342c56e-21d0-41c6-a403-4b92675a8157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b41bf1b3a81a4a90972eaeac2a6225a9', 'request_id': 'req-9342c56e-21d0-41c6-a403-4b92675a8157'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:25.319045 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9342c56e-21d0-41c6-a403-4b92675a8157 admin admin] The token cache is being invalidate because project b41bf1b3a81a4a90972eaeac2a6225a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:24:25.319443 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9342c56e-21d0-41c6-a403-4b92675a8157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:25.320229 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9342c56e-21d0-41c6-a403-4b92675a8157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:25.321822 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1087/2181] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:24:24 2022] DELETE /identity/v3/projects/b41bf1b3a81a4a90972eaeac2a6225a9 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:24:25.325903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1910c-3215-4375-aebd-01d11f6b6f0a service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:25.335765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1910c-3215-4375-aebd-01d11f6b6f0a service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:25.395237 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6019770-13ed-4d2a-97bc-a893fabfdb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:25.395935 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6019770-13ed-4d2a-97bc-a893fabfdb37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:25.396259 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6019770-13ed-4d2a-97bc-a893fabfdb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:25.396542 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6019770-13ed-4d2a-97bc-a893fabfdb37 admin admin] PATH_INFO: `/v3/users/b9952018510a41c8ae58f77526f8d2cf` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:25.397836 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6019770-13ed-4d2a-97bc-a893fabfdb37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9952018510a41c8ae58f77526f8d2cf)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:25.399979 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6019770-13ed-4d2a-97bc-a893fabfdb37 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:25.426944 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:25.644745 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b6019770-13ed-4d2a-97bc-a893fabfdb37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9952018510a41c8ae58f77526f8d2cf'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:25.729074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b6019770-13ed-4d2a-97bc-a893fabfdb37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9952018510a41c8ae58f77526f8d2cf'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:25.745765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b6019770-13ed-4d2a-97bc-a893fabfdb37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9952018510a41c8ae58f77526f8d2cf'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:25.746761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b6019770-13ed-4d2a-97bc-a893fabfdb37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9952018510a41c8ae58f77526f8d2cf'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:25.754843 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b6019770-13ed-4d2a-97bc-a893fabfdb37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9952018510a41c8ae58f77526f8d2cf'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:25.764264 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1095/2182] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:24:25 2022] DELETE /identity/v3/users/b9952018510a41c8ae58f77526f8d2cf => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:26.043582 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342c56e-21d0-41c6-a403-4b92675a8157 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:26.045569 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-9342c56e-21d0-41c6-a403-4b92675a8157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:26.077015 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342c56e-21d0-41c6-a403-4b92675a8157 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:26.156488 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e6033-a6b3-48c2-845e-2ded863154d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:26.157970 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e6033-a6b3-48c2-845e-2ded863154d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:26.158395 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e6033-a6b3-48c2-845e-2ded863154d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:26.159208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e6033-a6b3-48c2-845e-2ded863154d3 admin admin] PATH_INFO: `/v3/users/bd385d761783466bb6a8a1a95e5ea913` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:26.160841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e6033-a6b3-48c2-845e-2ded863154d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd385d761783466bb6a8a1a95e5ea913)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:26.163035 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e6033-a6b3-48c2-845e-2ded863154d3 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:26.165337 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:26.324875 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6019770-13ed-4d2a-97bc-a893fabfdb37 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:26.327167 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b6019770-13ed-4d2a-97bc-a893fabfdb37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:26.348650 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6019770-13ed-4d2a-97bc-a893fabfdb37 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:26.357114 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5675b92c-d0ac-4c51-832b-d7e29e9af2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:26.358157 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675b92c-d0ac-4c51-832b-d7e29e9af2ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:26.358588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675b92c-d0ac-4c51-832b-d7e29e9af2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:26.360133 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5675b92c-d0ac-4c51-832b-d7e29e9af2ed admin admin] PATH_INFO: `/v3/projects/1a7f9e56659a42aca6b19bc2f0d9e225` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:26.373470 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5675b92c-d0ac-4c51-832b-d7e29e9af2ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a7f9e56659a42aca6b19bc2f0d9e225)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:26.373470 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5675b92c-d0ac-4c51-832b-d7e29e9af2ed admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:26.411623 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b60e6033-a6b3-48c2-845e-2ded863154d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd385d761783466bb6a8a1a95e5ea913'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:26.514945 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b60e6033-a6b3-48c2-845e-2ded863154d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd385d761783466bb6a8a1a95e5ea913'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:26.537986 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5675b92c-d0ac-4c51-832b-d7e29e9af2ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a7f9e56659a42aca6b19bc2f0d9e225', 'request_id': 'req-5675b92c-d0ac-4c51-832b-d7e29e9af2ed'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:26.541281 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b60e6033-a6b3-48c2-845e-2ded863154d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd385d761783466bb6a8a1a95e5ea913'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:26.541281 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b60e6033-a6b3-48c2-845e-2ded863154d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd385d761783466bb6a8a1a95e5ea913'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:26.547111 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5675b92c-d0ac-4c51-832b-d7e29e9af2ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a7f9e56659a42aca6b19bc2f0d9e225', 'request_id': 'req-5675b92c-d0ac-4c51-832b-d7e29e9af2ed'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:26.547990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b60e6033-a6b3-48c2-845e-2ded863154d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd385d761783466bb6a8a1a95e5ea913'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:26.555956 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1088/2183] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:24:26 2022] DELETE /identity/v3/users/bd385d761783466bb6a8a1a95e5ea913 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:26.559907 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5675b92c-d0ac-4c51-832b-d7e29e9af2ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a7f9e56659a42aca6b19bc2f0d9e225', 'request_id': 'req-5675b92c-d0ac-4c51-832b-d7e29e9af2ed'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:26.560514 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144cc4d-2e8e-4f52-b611-89b8b672a697 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:26.560803 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144cc4d-2e8e-4f52-b611-89b8b672a697 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:26.561079 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144cc4d-2e8e-4f52-b611-89b8b672a697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:26.601688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-0144cc4d-2e8e-4f52-b611-89b8b672a697 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:26.603857 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-0144cc4d-2e8e-4f52-b611-89b8b672a697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:26.633269 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5675b92c-d0ac-4c51-832b-d7e29e9af2ed admin admin] The token cache is being invalidate because project 1a7f9e56659a42aca6b19bc2f0d9e225 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:24:26.633564 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5675b92c-d0ac-4c51-832b-d7e29e9af2ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:26.634217 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5675b92c-d0ac-4c51-832b-d7e29e9af2ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:26.636421 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1096/2184] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:24:26 2022] DELETE /identity/v3/projects/1a7f9e56659a42aca6b19bc2f0d9e225 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:26.644230 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e1092-4892-4732-bd42-6c6f2a703f72 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:26.644698 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e1092-4892-4732-bd42-6c6f2a703f72 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:26.645126 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310e1092-4892-4732-bd42-6c6f2a703f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:26.719649 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-310e1092-4892-4732-bd42-6c6f2a703f72 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:26.726417 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-310e1092-4892-4732-bd42-6c6f2a703f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:26.726609 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1089/2185] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:24:26.734526 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144cc4d-2e8e-4f52-b611-89b8b672a697 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:26.736268 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-0144cc4d-2e8e-4f52-b611-89b8b672a697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:26.754407 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1097/2186] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:26.756068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c62e32-6a3f-459d-b25f-63bde6d0b2d2 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:26.756377 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c62e32-6a3f-459d-b25f-63bde6d0b2d2 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:26.756652 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c62e32-6a3f-459d-b25f-63bde6d0b2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:26.784850 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-06c62e32-6a3f-459d-b25f-63bde6d0b2d2 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:26.786129 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-06c62e32-6a3f-459d-b25f-63bde6d0b2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:26.802018 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1098/2187] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:26.803768 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c62e32-6a3f-459d-b25f-63bde6d0b2d2 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:26.815223 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c62e32-6a3f-459d-b25f-63bde6d0b2d2 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:26.820852 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580d789-e742-4130-b8be-a2ed90d56962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:26.821494 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580d789-e742-4130-b8be-a2ed90d56962 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:26.821985 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580d789-e742-4130-b8be-a2ed90d56962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:26.822486 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580d789-e742-4130-b8be-a2ed90d56962 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:26.823915 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580d789-e742-4130-b8be-a2ed90d56962 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:24:26.824509 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580d789-e742-4130-b8be-a2ed90d56962 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:26.828909 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f580d789-e742-4130-b8be-a2ed90d56962 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:26.866381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144cc4d-2e8e-4f52-b611-89b8b672a697 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:26.866972 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1099/2188] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:24:26.871656 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580d789-e742-4130-b8be-a2ed90d56962 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:26.873105 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9c281-2b3b-41a2-88e7-7717b4b8f72a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:26.873946 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9c281-2b3b-41a2-88e7-7717b4b8f72a service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:26.874480 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9c281-2b3b-41a2-88e7-7717b4b8f72a service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:26.875005 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9c281-2b3b-41a2-88e7-7717b4b8f72a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:26.884352 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580d789-e742-4130-b8be-a2ed90d56962 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:26.889615 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc9c281-2b3b-41a2-88e7-7717b4b8f72a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:26.891248 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1a504-638e-476a-a091-91059852f5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:26.891624 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc9c281-2b3b-41a2-88e7-7717b4b8f72a service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:26.892172 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1a504-638e-476a-a091-91059852f5f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:26.892834 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1a504-638e-476a-a091-91059852f5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:26.893839 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1a504-638e-476a-a091-91059852f5f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:26.894737 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1a504-638e-476a-a091-91059852f5f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:26.897596 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1a504-638e-476a-a091-91059852f5f8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:26.907493 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1090/2189] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:24:26.978213 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1100/2190] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:24:26 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:24:26.982824 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9c281-2b3b-41a2-88e7-7717b4b8f72a service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:26.995547 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9c281-2b3b-41a2-88e7-7717b4b8f72a service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:27.058798 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f6ba6-3a23-4284-b514-ace90d0f39c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:27.059334 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f6ba6-3a23-4284-b514-ace90d0f39c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:27.059614 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f6ba6-3a23-4284-b514-ace90d0f39c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:27.059889 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600f6ba6-3a23-4284-b514-ace90d0f39c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:27.060560 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f6ba6-3a23-4284-b514-ace90d0f39c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:27.062521 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600f6ba6-3a23-4284-b514-ace90d0f39c4 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:27.199761 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1091/2191] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:24:26 2022] POST /identity/v3/users => generated 288 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:24:27.201190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1a504-638e-476a-a091-91059852f5f8 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:27.219918 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1a504-638e-476a-a091-91059852f5f8 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:27.230458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5784a43-2db8-44d3-9304-03e05a5441e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:27.232476 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5784a43-2db8-44d3-9304-03e05a5441e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:27.235708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5784a43-2db8-44d3-9304-03e05a5441e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:27.235708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5784a43-2db8-44d3-9304-03e05a5441e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:27.235708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5784a43-2db8-44d3-9304-03e05a5441e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:27.239732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5784a43-2db8-44d3-9304-03e05a5441e6 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:27.284394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1101/2192] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:27.287328 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f6ba6-3a23-4284-b514-ace90d0f39c4 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:27.299986 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:27.306682 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600f6ba6-3a23-4284-b514-ace90d0f39c4 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:27.315093 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e5442-b413-4eae-a93b-560bf8ccfb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:27.316313 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e5442-b413-4eae-a93b-560bf8ccfb07 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:27.316746 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e5442-b413-4eae-a93b-560bf8ccfb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:27.317560 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e5442-b413-4eae-a93b-560bf8ccfb07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:27.318508 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e5442-b413-4eae-a93b-560bf8ccfb07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:27.321255 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e5442-b413-4eae-a93b-560bf8ccfb07 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:27.338017 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1092/2193] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:27.339065 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5784a43-2db8-44d3-9304-03e05a5441e6 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:27.353554 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5784a43-2db8-44d3-9304-03e05a5441e6 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:27.359607 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbbade-e265-447f-93b4-50fea0069323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:27.360330 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbbade-e265-447f-93b4-50fea0069323 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:27.360610 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbbade-e265-447f-93b4-50fea0069323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:27.360884 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbbade-e265-447f-93b4-50fea0069323 admin admin] PATH_INFO: `/v3/projects/3936373854644902843e345a86d9cd74/users/fcbae7c8cb734df3bb70946d3cfaf919/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:27.394204 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fbbade-e265-447f-93b4-50fea0069323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3936373854644902843e345a86d9cd74, user_id=fcbae7c8cb734df3bb70946d3cfaf919, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:27.412346 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fbbade-e265-447f-93b4-50fea0069323 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:27.449642 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e5442-b413-4eae-a93b-560bf8ccfb07 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:27.451966 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-9b5e5442-b413-4eae-a93b-560bf8ccfb07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:27.473186 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e5442-b413-4eae-a93b-560bf8ccfb07 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:27.477592 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e022a-cf89-4697-8397-bb19e6c7b317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:27.478255 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e022a-cf89-4697-8397-bb19e6c7b317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:27.478535 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e022a-cf89-4697-8397-bb19e6c7b317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:27.478810 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e022a-cf89-4697-8397-bb19e6c7b317 admin admin] PATH_INFO: `/v3/projects/38f7d46e72e94af784fb08557095e5ca` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:27.479971 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e022a-cf89-4697-8397-bb19e6c7b317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38f7d46e72e94af784fb08557095e5ca)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:27.482672 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e022a-cf89-4697-8397-bb19e6c7b317 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:27.512599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:DELETE=14,keystone:SELECT=82,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:27.519959 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1102/2194] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:24:27 2022] PUT /identity/v3/projects/3936373854644902843e345a86d9cd74/users/fcbae7c8cb734df3bb70946d3cfaf919/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:24:27.521116 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbbade-e265-447f-93b4-50fea0069323 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:27.524771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f5fbbade-e265-447f-93b4-50fea0069323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:27.646563 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d22e022a-cf89-4697-8397-bb19e6c7b317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38f7d46e72e94af784fb08557095e5ca', 'request_id': 'req-d22e022a-cf89-4697-8397-bb19e6c7b317'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:27.665310 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbbade-e265-447f-93b4-50fea0069323 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:27.722612 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d22e022a-cf89-4697-8397-bb19e6c7b317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38f7d46e72e94af784fb08557095e5ca', 'request_id': 'req-d22e022a-cf89-4697-8397-bb19e6c7b317'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:27.730509 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d22e022a-cf89-4697-8397-bb19e6c7b317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38f7d46e72e94af784fb08557095e5ca', 'request_id': 'req-d22e022a-cf89-4697-8397-bb19e6c7b317'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:27.734066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113de42f-b75a-4d4e-9e94-bf65436a7703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:27.734747 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113de42f-b75a-4d4e-9e94-bf65436a7703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:27.735030 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113de42f-b75a-4d4e-9e94-bf65436a7703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:27.735456 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113de42f-b75a-4d4e-9e94-bf65436a7703 admin admin] PATH_INFO: `/v3/users/72ffe5ef0a434f6c8c73de58ef63a2d2` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:27.736901 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113de42f-b75a-4d4e-9e94-bf65436a7703 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72ffe5ef0a434f6c8c73de58ef63a2d2)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:27.738844 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113de42f-b75a-4d4e-9e94-bf65436a7703 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:27.751599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d22e022a-cf89-4697-8397-bb19e6c7b317 admin admin] The token cache is being invalidate because project 38f7d46e72e94af784fb08557095e5ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:24:27.752704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d22e022a-cf89-4697-8397-bb19e6c7b317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:27.754260 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d22e022a-cf89-4697-8397-bb19e6c7b317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:27.760024 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1093/2195] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:24:27 2022] DELETE /identity/v3/projects/38f7d46e72e94af784fb08557095e5ca => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:24:27.761894 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65f92e-a067-4a59-8f98-89729756ea0a None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:27.762349 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65f92e-a067-4a59-8f98-89729756ea0a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:27.762625 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65f92e-a067-4a59-8f98-89729756ea0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:27.797372 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-2e65f92e-a067-4a59-8f98-89729756ea0a None None] MFA Rules not processed for user `fcbae7c8cb734df3bb70946d3cfaf919`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:27.798625 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-2e65f92e-a067-4a59-8f98-89729756ea0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:27.870130 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1094/2196] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:27.870992 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65f92e-a067-4a59-8f98-89729756ea0a None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:27.872306 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-2e65f92e-a067-4a59-8f98-89729756ea0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:27.886462 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65f92e-a067-4a59-8f98-89729756ea0a None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:27.891181 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb597e29-e519-43fa-911b-27cc27c90df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:27.891801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb597e29-e519-43fa-911b-27cc27c90df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:27.892079 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb597e29-e519-43fa-911b-27cc27c90df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:27.892384 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb597e29-e519-43fa-911b-27cc27c90df9 admin admin] PATH_INFO: `/v3/users/57681995ccb44d5691a0e94ed124e8db` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:27.893593 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb597e29-e519-43fa-911b-27cc27c90df9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57681995ccb44d5691a0e94ed124e8db)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:27.895503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb597e29-e519-43fa-911b-27cc27c90df9 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:27.965242 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-113de42f-b75a-4d4e-9e94-bf65436a7703 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72ffe5ef0a434f6c8c73de58ef63a2d2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:28.100633 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-113de42f-b75a-4d4e-9e94-bf65436a7703 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72ffe5ef0a434f6c8c73de58ef63a2d2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:28.118573 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-113de42f-b75a-4d4e-9e94-bf65436a7703 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72ffe5ef0a434f6c8c73de58ef63a2d2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:28.118898 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-fb597e29-e519-43fa-911b-27cc27c90df9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57681995ccb44d5691a0e94ed124e8db'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:28.119458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-113de42f-b75a-4d4e-9e94-bf65436a7703 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72ffe5ef0a434f6c8c73de58ef63a2d2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:28.128632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-113de42f-b75a-4d4e-9e94-bf65436a7703 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72ffe5ef0a434f6c8c73de58ef63a2d2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:28.134805 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1103/2197] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:24:27 2022] DELETE /identity/v3/users/72ffe5ef0a434f6c8c73de58ef63a2d2 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:28.138598 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113de42f-b75a-4d4e-9e94-bf65436a7703 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:28.138598 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-113de42f-b75a-4d4e-9e94-bf65436a7703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:28.196701 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113de42f-b75a-4d4e-9e94-bf65436a7703 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:28.200687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cade5b-ef6e-4af3-896a-077c2e82a50f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:28.201845 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cade5b-ef6e-4af3-896a-077c2e82a50f service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:28.202126 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cade5b-ef6e-4af3-896a-077c2e82a50f service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:28.202410 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cade5b-ef6e-4af3-896a-077c2e82a50f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:28.204220 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c9cade5b-ef6e-4af3-896a-077c2e82a50f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:28.208861 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-fb597e29-e519-43fa-911b-27cc27c90df9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57681995ccb44d5691a0e94ed124e8db'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:28.223530 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-fb597e29-e519-43fa-911b-27cc27c90df9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57681995ccb44d5691a0e94ed124e8db'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:28.224662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-fb597e29-e519-43fa-911b-27cc27c90df9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57681995ccb44d5691a0e94ed124e8db'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:28.232141 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-fb597e29-e519-43fa-911b-27cc27c90df9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57681995ccb44d5691a0e94ed124e8db'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:28.238901 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1095/2198] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:24:27 2022] DELETE /identity/v3/users/57681995ccb44d5691a0e94ed124e8db => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:28.240195 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f846c-a7c1-461e-a1d3-b46efc885ad5 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:28.240487 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f846c-a7c1-461e-a1d3-b46efc885ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:28.240755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f846c-a7c1-461e-a1d3-b46efc885ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:28.261359 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-940f846c-a7c1-461e-a1d3-b46efc885ad5 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:28.262581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-940f846c-a7c1-461e-a1d3-b46efc885ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:28.281680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cade5b-ef6e-4af3-896a-077c2e82a50f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:28.283888 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cade5b-ef6e-4af3-896a-077c2e82a50f service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:28.309487 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1104/2199] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:24:28.351505 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1096/2200] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:28.365711 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cade5b-ef6e-4af3-896a-077c2e82a50f service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:28.367892 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c9cade5b-ef6e-4af3-896a-077c2e82a50f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:28.380812 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:28.441570 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cade5b-ef6e-4af3-896a-077c2e82a50f service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:28.500579 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3cade-636d-4078-a65d-6eb468673d4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:28.501356 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3cade-636d-4078-a65d-6eb468673d4a service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:28.503407 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:28.503819 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3cade-636d-4078-a65d-6eb468673d4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:28.504140 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f3cade-636d-4078-a65d-6eb468673d4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:28.514688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f3cade-636d-4078-a65d-6eb468673d4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:28.516291 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f3cade-636d-4078-a65d-6eb468673d4a service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:28.528221 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1105/2201] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:24:29.117593 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f846c-a7c1-461e-a1d3-b46efc885ad5 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:29.119616 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-940f846c-a7c1-461e-a1d3-b46efc885ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:29.134828 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f846c-a7c1-461e-a1d3-b46efc885ad5 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:29.141516 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e808d47-337f-480e-b01a-332b801ca282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:29.142438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e808d47-337f-480e-b01a-332b801ca282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:29.143530 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e808d47-337f-480e-b01a-332b801ca282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:29.143922 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e808d47-337f-480e-b01a-332b801ca282 admin admin] PATH_INFO: `/v3/projects/d729bf327b664bd9bb3e9c873693d444` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:29.145336 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e808d47-337f-480e-b01a-332b801ca282 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d729bf327b664bd9bb3e9c873693d444)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:29.147521 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e808d47-337f-480e-b01a-332b801ca282 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:29.258072 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9e808d47-337f-480e-b01a-332b801ca282 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd729bf327b664bd9bb3e9c873693d444', 'request_id': 'req-9e808d47-337f-480e-b01a-332b801ca282'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:29.312457 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3cade-636d-4078-a65d-6eb468673d4a service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:29.320300 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c4f3cade-636d-4078-a65d-6eb468673d4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:29.329108 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9e808d47-337f-480e-b01a-332b801ca282 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd729bf327b664bd9bb3e9c873693d444', 'request_id': 'req-9e808d47-337f-480e-b01a-332b801ca282'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:29.338324 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9e808d47-337f-480e-b01a-332b801ca282 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd729bf327b664bd9bb3e9c873693d444', 'request_id': 'req-9e808d47-337f-480e-b01a-332b801ca282'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:29.339217 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f3cade-636d-4078-a65d-6eb468673d4a service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:29.365956 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9e808d47-337f-480e-b01a-332b801ca282 admin admin] The token cache is being invalidate because project d729bf327b664bd9bb3e9c873693d444 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:24:29.368594 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9e808d47-337f-480e-b01a-332b801ca282 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:29.370186 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9e808d47-337f-480e-b01a-332b801ca282 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:29.372165 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1097/2202] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:24:29 2022] DELETE /identity/v3/projects/d729bf327b664bd9bb3e9c873693d444 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:29.376399 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e808d47-337f-480e-b01a-332b801ca282 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:29.379150 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-9e808d47-337f-480e-b01a-332b801ca282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:29.393849 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:29.429183 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf123e30-4c18-4735-9976-30fbd0f0d0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:29.430862 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf123e30-4c18-4735-9976-30fbd0f0d0d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:29.431344 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf123e30-4c18-4735-9976-30fbd0f0d0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:29.431786 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf123e30-4c18-4735-9976-30fbd0f0d0d1 admin admin] PATH_INFO: `/v3/projects/169a78f58e1c45658158d8007dc052b3` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:29.433325 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf123e30-4c18-4735-9976-30fbd0f0d0d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=169a78f58e1c45658158d8007dc052b3)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:29.435312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf123e30-4c18-4735-9976-30fbd0f0d0d1 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:29.503169 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e808d47-337f-480e-b01a-332b801ca282 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:29.508973 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb9432-dc12-40a0-8b84-bc5b0e3e8851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:29.509643 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb9432-dc12-40a0-8b84-bc5b0e3e8851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:29.510048 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb9432-dc12-40a0-8b84-bc5b0e3e8851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:29.510899 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb9432-dc12-40a0-8b84-bc5b0e3e8851 admin admin] PATH_INFO: `/v3/users/102c0e41a572484fb65687059032798f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:29.512529 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb9432-dc12-40a0-8b84-bc5b0e3e8851 admin admin] RBAC: Authorizing `identity:delete_user(user_id=102c0e41a572484fb65687059032798f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:29.528279 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb9432-dc12-40a0-8b84-bc5b0e3e8851 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:29.550857 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:29.574721 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bf123e30-4c18-4735-9976-30fbd0f0d0d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '169a78f58e1c45658158d8007dc052b3', 'request_id': 'req-bf123e30-4c18-4735-9976-30fbd0f0d0d1'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:29.580652 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bf123e30-4c18-4735-9976-30fbd0f0d0d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '169a78f58e1c45658158d8007dc052b3', 'request_id': 'req-bf123e30-4c18-4735-9976-30fbd0f0d0d1'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:29.589544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bf123e30-4c18-4735-9976-30fbd0f0d0d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '169a78f58e1c45658158d8007dc052b3', 'request_id': 'req-bf123e30-4c18-4735-9976-30fbd0f0d0d1'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:29.694721 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bf123e30-4c18-4735-9976-30fbd0f0d0d1 admin admin] The token cache is being invalidate because project 169a78f58e1c45658158d8007dc052b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:24:29.694947 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bf123e30-4c18-4735-9976-30fbd0f0d0d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:29.695557 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-bf123e30-4c18-4735-9976-30fbd0f0d0d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:29.697094 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1106/2203] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:24:29 2022] DELETE /identity/v3/projects/169a78f58e1c45658158d8007dc052b3 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:24:29.701892 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb612b-9256-46c6-b5bb-20c170f37c17 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:29.702261 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb612b-9256-46c6-b5bb-20c170f37c17 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:29.702559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb612b-9256-46c6-b5bb-20c170f37c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:29.727565 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-b3eb612b-9256-46c6-b5bb-20c170f37c17 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:29.729717 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b3eb612b-9256-46c6-b5bb-20c170f37c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:29.791795 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1107/2204] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:24:29.800381 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946935e-4b70-4ba8-8d5e-f5c948a53472 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:29.800669 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946935e-4b70-4ba8-8d5e-f5c948a53472 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:29.801033 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946935e-4b70-4ba8-8d5e-f5c948a53472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:29.822216 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f946935e-4b70-4ba8-8d5e-f5c948a53472 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:29.823421 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f946935e-4b70-4ba8-8d5e-f5c948a53472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:29.832538 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1108/2205] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:24:29.836991 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946935e-4b70-4ba8-8d5e-f5c948a53472 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:29.847006 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946935e-4b70-4ba8-8d5e-f5c948a53472 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:29.852008 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0757e65-7131-409e-b73e-ee519d1e8536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:29.852683 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0757e65-7131-409e-b73e-ee519d1e8536 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:29.852964 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0757e65-7131-409e-b73e-ee519d1e8536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:29.853234 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0757e65-7131-409e-b73e-ee519d1e8536 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:29.853879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0757e65-7131-409e-b73e-ee519d1e8536 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:24:29.854173 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0757e65-7131-409e-b73e-ee519d1e8536 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:29.855752 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0757e65-7131-409e-b73e-ee519d1e8536 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:29.870411 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1109/2206] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:24:29.875200 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0757e65-7131-409e-b73e-ee519d1e8536 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:29.877106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-73cb9432-dc12-40a0-8b84-bc5b0e3e8851 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '102c0e41a572484fb65687059032798f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:29.885550 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0757e65-7131-409e-b73e-ee519d1e8536 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:29.890944 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd9e54-6f1a-41de-baad-ddd0e41f914b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:29.891560 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd9e54-6f1a-41de-baad-ddd0e41f914b admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:29.891837 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd9e54-6f1a-41de-baad-ddd0e41f914b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:29.892121 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd9e54-6f1a-41de-baad-ddd0e41f914b admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:29.892866 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd9e54-6f1a-41de-baad-ddd0e41f914b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:29.894754 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd9e54-6f1a-41de-baad-ddd0e41f914b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:29.976000 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-73cb9432-dc12-40a0-8b84-bc5b0e3e8851 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '102c0e41a572484fb65687059032798f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:29.991097 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1110/2207] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:24:29 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:24:29.995327 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd9e54-6f1a-41de-baad-ddd0e41f914b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:30.005102 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-73cb9432-dc12-40a0-8b84-bc5b0e3e8851 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '102c0e41a572484fb65687059032798f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:30.005861 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-73cb9432-dc12-40a0-8b84-bc5b0e3e8851 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '102c0e41a572484fb65687059032798f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:30.015520 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-73cb9432-dc12-40a0-8b84-bc5b0e3e8851 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '102c0e41a572484fb65687059032798f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:30.024316 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1098/2208] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:24:29 2022] DELETE /identity/v3/users/102c0e41a572484fb65687059032798f => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:30.053568 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:30.120243 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd9e54-6f1a-41de-baad-ddd0e41f914b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:30.221716 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d98ee7-5dbf-4700-8e4c-00579c26824a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:30.222646 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d98ee7-5dbf-4700-8e4c-00579c26824a admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:30.222936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d98ee7-5dbf-4700-8e4c-00579c26824a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:30.223223 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d98ee7-5dbf-4700-8e4c-00579c26824a admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:30.223868 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d98ee7-5dbf-4700-8e4c-00579c26824a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:30.226338 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d98ee7-5dbf-4700-8e4c-00579c26824a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:30.304834 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1111/2209] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:24:29 2022] POST /identity/v3/users => generated 294 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:24:30.308661 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb9432-dc12-40a0-8b84-bc5b0e3e8851 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:30.310178 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-73cb9432-dc12-40a0-8b84-bc5b0e3e8851 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:30.325298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb9432-dc12-40a0-8b84-bc5b0e3e8851 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:30.331895 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0dd1d-64a8-492a-989c-7ff444647b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:30.332737 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0dd1d-64a8-492a-989c-7ff444647b39 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:30.333022 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0dd1d-64a8-492a-989c-7ff444647b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:30.333323 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0dd1d-64a8-492a-989c-7ff444647b39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:30.333934 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0dd1d-64a8-492a-989c-7ff444647b39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:30.335563 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0dd1d-64a8-492a-989c-7ff444647b39 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:30.348548 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1099/2210] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:24:30.352684 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d98ee7-5dbf-4700-8e4c-00579c26824a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:30.369816 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d98ee7-5dbf-4700-8e4c-00579c26824a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:30.376165 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e0373d-9f96-4bc8-8474-d3eb5a61dca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:30.376791 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0373d-9f96-4bc8-8474-d3eb5a61dca3 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:30.377835 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0373d-9f96-4bc8-8474-d3eb5a61dca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:30.378035 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0373d-9f96-4bc8-8474-d3eb5a61dca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:30.378636 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e0373d-9f96-4bc8-8474-d3eb5a61dca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:30.380515 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e0373d-9f96-4bc8-8474-d3eb5a61dca3 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:30.391876 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1112/2211] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:30.397330 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0dd1d-64a8-492a-989c-7ff444647b39 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:30.408302 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0dd1d-64a8-492a-989c-7ff444647b39 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:30.413300 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0547890-0519-4454-a167-439696757487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:30.413964 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0547890-0519-4454-a167-439696757487 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:30.414249 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0547890-0519-4454-a167-439696757487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:30.414710 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0547890-0519-4454-a167-439696757487 admin admin] PATH_INFO: `/v3/projects/cae8f3c77a7e4b3199ec8b57bf7f0e88/users/5fbdc2e5a7674bcba815756e84f81a8a/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:30.432064 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0547890-0519-4454-a167-439696757487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cae8f3c77a7e4b3199ec8b57bf7f0e88, user_id=5fbdc2e5a7674bcba815756e84f81a8a, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:30.434955 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0547890-0519-4454-a167-439696757487 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:30.534612 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1100/2212] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:24:30 2022] PUT /identity/v3/projects/cae8f3c77a7e4b3199ec8b57bf7f0e88/users/5fbdc2e5a7674bcba815756e84f81a8a/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:30.547015 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c9752-43b2-40be-b356-233bd172f90f None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:30.547623 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c9752-43b2-40be-b356-233bd172f90f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:30.547623 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c9752-43b2-40be-b356-233bd172f90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:30.576632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-047c9752-43b2-40be-b356-233bd172f90f None None] MFA Rules not processed for user `5fbdc2e5a7674bcba815756e84f81a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:30.577860 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-047c9752-43b2-40be-b356-233bd172f90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:30.631661 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0547890-0519-4454-a167-439696757487 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:30.634157 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a0547890-0519-4454-a167-439696757487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:30.660568 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1113/2213] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:30 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:30.665927 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c9752-43b2-40be-b356-233bd172f90f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:30.739159 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:30.780064 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0547890-0519-4454-a167-439696757487 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:30.782643 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:30.789159 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0161f5-c59c-41f9-beaa-6c2481a87d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:30.789814 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0161f5-c59c-41f9-beaa-6c2481a87d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:30.790106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0161f5-c59c-41f9-beaa-6c2481a87d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:30.790352 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0161f5-c59c-41f9-beaa-6c2481a87d4a admin admin] PATH_INFO: `/v3/projects/3462ef393fa642ee9e1a9a2dfa58690c` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:30.793442 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0161f5-c59c-41f9-beaa-6c2481a87d4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3462ef393fa642ee9e1a9a2dfa58690c)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:30.799443 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0161f5-c59c-41f9-beaa-6c2481a87d4a admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:30.816869 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c9752-43b2-40be-b356-233bd172f90f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:30.834141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14ccc7-f7f6-4b87-9fea-759f5dd48b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:30.834776 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14ccc7-f7f6-4b87-9fea-759f5dd48b32 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:30.835121 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14ccc7-f7f6-4b87-9fea-759f5dd48b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:30.835375 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf14ccc7-f7f6-4b87-9fea-759f5dd48b32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:30.836126 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf14ccc7-f7f6-4b87-9fea-759f5dd48b32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:30.838174 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf14ccc7-f7f6-4b87-9fea-759f5dd48b32 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:30.949761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1114/2214] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:24:30 2022] POST /identity/v3/projects => generated 389 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:24:30.953976 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14ccc7-f7f6-4b87-9fea-759f5dd48b32 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:30.963293 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ff0161f5-c59c-41f9-beaa-6c2481a87d4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3462ef393fa642ee9e1a9a2dfa58690c', 'request_id': 'req-ff0161f5-c59c-41f9-beaa-6c2481a87d4a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:31.013916 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf14ccc7-f7f6-4b87-9fea-759f5dd48b32 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:31.049886 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ff0161f5-c59c-41f9-beaa-6c2481a87d4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3462ef393fa642ee9e1a9a2dfa58690c', 'request_id': 'req-ff0161f5-c59c-41f9-beaa-6c2481a87d4a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:31.059916 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ff0161f5-c59c-41f9-beaa-6c2481a87d4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3462ef393fa642ee9e1a9a2dfa58690c', 'request_id': 'req-ff0161f5-c59c-41f9-beaa-6c2481a87d4a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:31.078141 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ff0161f5-c59c-41f9-beaa-6c2481a87d4a admin admin] The token cache is being invalidate because project 3462ef393fa642ee9e1a9a2dfa58690c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:24:31.078469 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ff0161f5-c59c-41f9-beaa-6c2481a87d4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:31.079163 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ff0161f5-c59c-41f9-beaa-6c2481a87d4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:31.081821 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1101/2215] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:24:30 2022] DELETE /identity/v3/projects/3462ef393fa642ee9e1a9a2dfa58690c => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:31.088568 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0161f5-c59c-41f9-beaa-6c2481a87d4a admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:31.091495 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ff0161f5-c59c-41f9-beaa-6c2481a87d4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:31.098776 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c917e-79f4-4da4-9ba2-c42fbc559789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:31.099757 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c917e-79f4-4da4-9ba2-c42fbc559789 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:31.103510 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c917e-79f4-4da4-9ba2-c42fbc559789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:31.103510 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c917e-79f4-4da4-9ba2-c42fbc559789 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:31.103510 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c917e-79f4-4da4-9ba2-c42fbc559789 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:31.104567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c917e-79f4-4da4-9ba2-c42fbc559789 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:31.107740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0161f5-c59c-41f9-beaa-6c2481a87d4a admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:31.114134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3f7c9-9d53-4be8-8a08-c415ff9dc44f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:31.114902 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3f7c9-9d53-4be8-8a08-c415ff9dc44f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:31.115259 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3f7c9-9d53-4be8-8a08-c415ff9dc44f admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:31.116205 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3f7c9-9d53-4be8-8a08-c415ff9dc44f admin admin] PATH_INFO: `/v3/users/65647f8d723c4cd9bd3039a9c83fb666` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:31.118191 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3f7c9-9d53-4be8-8a08-c415ff9dc44f admin admin] RBAC: Authorizing `identity:delete_user(user_id=65647f8d723c4cd9bd3039a9c83fb666)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:31.121408 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3f7c9-9d53-4be8-8a08-c415ff9dc44f admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:31.222211 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1115/2216] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:24:30 2022] POST /identity/v3/users => generated 301 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:24:31.227360 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c917e-79f4-4da4-9ba2-c42fbc559789 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:31.238498 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f04c917e-79f4-4da4-9ba2-c42fbc559789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:31.253218 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c917e-79f4-4da4-9ba2-c42fbc559789 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:31.259835 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167f361-efa2-4c9d-9e76-5285f38b2ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:31.260494 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167f361-efa2-4c9d-9e76-5285f38b2ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:31.260783 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167f361-efa2-4c9d-9e76-5285f38b2ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:31.261054 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167f361-efa2-4c9d-9e76-5285f38b2ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:31.261744 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167f361-efa2-4c9d-9e76-5285f38b2ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:31.269671 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167f361-efa2-4c9d-9e76-5285f38b2ed5 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:31.279930 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1116/2217] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:31.284831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167f361-efa2-4c9d-9e76-5285f38b2ed5 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:31.310981 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167f361-efa2-4c9d-9e76-5285f38b2ed5 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:31.323435 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a0655-2e05-4fb0-9492-d04fdc47d0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:31.324132 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a0655-2e05-4fb0-9492-d04fdc47d0cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:31.324422 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a0655-2e05-4fb0-9492-d04fdc47d0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:31.324747 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833a0655-2e05-4fb0-9492-d04fdc47d0cd admin admin] PATH_INFO: `/v3/projects/ad8242de20ef46339ac36d1712567ea4/users/5e80fd29afcb4939bcbbd72e521d01cb/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:31.338315 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d3a3f7c9-9d53-4be8-8a08-c415ff9dc44f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65647f8d723c4cd9bd3039a9c83fb666'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:31.358224 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a0655-2e05-4fb0-9492-d04fdc47d0cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad8242de20ef46339ac36d1712567ea4, user_id=5e80fd29afcb4939bcbbd72e521d01cb, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:31.361260 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833a0655-2e05-4fb0-9492-d04fdc47d0cd admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:31.420356 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d3a3f7c9-9d53-4be8-8a08-c415ff9dc44f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65647f8d723c4cd9bd3039a9c83fb666'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:31.434792 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1117/2218] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:24:31 2022] PUT /identity/v3/projects/ad8242de20ef46339ac36d1712567ea4/users/5e80fd29afcb4939bcbbd72e521d01cb/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:31.438787 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d3a3f7c9-9d53-4be8-8a08-c415ff9dc44f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65647f8d723c4cd9bd3039a9c83fb666'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:31.438936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a0655-2e05-4fb0-9492-d04fdc47d0cd admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:31.441149 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d3a3f7c9-9d53-4be8-8a08-c415ff9dc44f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65647f8d723c4cd9bd3039a9c83fb666'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:31.442334 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-833a0655-2e05-4fb0-9492-d04fdc47d0cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:31.454170 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d3a3f7c9-9d53-4be8-8a08-c415ff9dc44f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65647f8d723c4cd9bd3039a9c83fb666'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:31.461904 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1102/2219] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:24:31 2022] DELETE /identity/v3/users/65647f8d723c4cd9bd3039a9c83fb666 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:24:31.487166 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:31.534528 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833a0655-2e05-4fb0-9492-d04fdc47d0cd admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:31.628337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1021c6ef-68e7-4a92-853d-720a080fe70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:31.629073 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021c6ef-68e7-4a92-853d-720a080fe70f admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:31.629261 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021c6ef-68e7-4a92-853d-720a080fe70f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:31.629540 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021c6ef-68e7-4a92-853d-720a080fe70f admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:31.630202 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1021c6ef-68e7-4a92-853d-720a080fe70f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:31.631873 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1021c6ef-68e7-4a92-853d-720a080fe70f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:31.645985 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1118/2220] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:31 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:24:31.647422 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3f7c9-9d53-4be8-8a08-c415ff9dc44f admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:31.662450 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3f7c9-9d53-4be8-8a08-c415ff9dc44f admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:31.668471 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b57c8e-b4b7-46e3-8d28-482d0a08fc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:31.669159 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b57c8e-b4b7-46e3-8d28-482d0a08fc66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:31.669692 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b57c8e-b4b7-46e3-8d28-482d0a08fc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:31.670107 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b57c8e-b4b7-46e3-8d28-482d0a08fc66 admin admin] PATH_INFO: `/v3/projects/ad8242de20ef46339ac36d1712567ea4/users/5e80fd29afcb4939bcbbd72e521d01cb/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:31.672054 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b57c8e-b4b7-46e3-8d28-482d0a08fc66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad8242de20ef46339ac36d1712567ea4, user_id=5e80fd29afcb4939bcbbd72e521d01cb, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:31.675244 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b57c8e-b4b7-46e3-8d28-482d0a08fc66 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:31.688373 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1103/2221] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:24:31 2022] PUT /identity/v3/projects/ad8242de20ef46339ac36d1712567ea4/users/5e80fd29afcb4939bcbbd72e521d01cb/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:31.701764 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22e7cc-f8dd-434c-b5d2-090975aad0fe None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:31.702063 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22e7cc-f8dd-434c-b5d2-090975aad0fe None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:31.702341 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f22e7cc-f8dd-434c-b5d2-090975aad0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:31.733411 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-0f22e7cc-f8dd-434c-b5d2-090975aad0fe None None] MFA Rules not processed for user `5e80fd29afcb4939bcbbd72e521d01cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:31.734661 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0f22e7cc-f8dd-434c-b5d2-090975aad0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:31.847990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1119/2222] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:31 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:31.860269 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b57c8e-b4b7-46e3-8d28-482d0a08fc66 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:31.862712 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a6b57c8e-b4b7-46e3-8d28-482d0a08fc66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:31.930231 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:31.945602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b57c8e-b4b7-46e3-8d28-482d0a08fc66 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:31.950737 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bd2f5-64dd-46d9-b2d6-ebbfac90d481 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:31.951385 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bd2f5-64dd-46d9-b2d6-ebbfac90d481 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:31.951719 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bd2f5-64dd-46d9-b2d6-ebbfac90d481 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:31.951936 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400bd2f5-64dd-46d9-b2d6-ebbfac90d481 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:31.979337 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400bd2f5-64dd-46d9-b2d6-ebbfac90d481 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:31.980994 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400bd2f5-64dd-46d9-b2d6-ebbfac90d481 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:31.992454 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1104/2223] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:31 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:24:32.032757 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22e7cc-f8dd-434c-b5d2-090975aad0fe None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:32.037643 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0f22e7cc-f8dd-434c-b5d2-090975aad0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:32.125446 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:32.130050 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f22e7cc-f8dd-434c-b5d2-090975aad0fe None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:32.135697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e7055-b03e-4019-8d08-43cc728f165a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:32.136453 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e7055-b03e-4019-8d08-43cc728f165a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:32.136825 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e7055-b03e-4019-8d08-43cc728f165a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:32.137174 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e7055-b03e-4019-8d08-43cc728f165a admin admin] PATH_INFO: `/v3/projects/eab297759d134ed58b91b593ebbf5ad2` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:32.138534 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e7055-b03e-4019-8d08-43cc728f165a admin admin] RBAC: Authorizing `identity:delete_project(project_id=eab297759d134ed58b91b593ebbf5ad2)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:32.140618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e7055-b03e-4019-8d08-43cc728f165a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:32.165897 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bd2f5-64dd-46d9-b2d6-ebbfac90d481 service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:32.177709 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400bd2f5-64dd-46d9-b2d6-ebbfac90d481 service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:32.182186 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8578848-36bc-4b86-9733-0c87c0b6ca1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:32.182801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8578848-36bc-4b86-9733-0c87c0b6ca1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:32.183080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8578848-36bc-4b86-9733-0c87c0b6ca1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:32.183351 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8578848-36bc-4b86-9733-0c87c0b6ca1a admin admin] PATH_INFO: `/v3/users/5fbdc2e5a7674bcba815756e84f81a8a` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:32.184540 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8578848-36bc-4b86-9733-0c87c0b6ca1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fbdc2e5a7674bcba815756e84f81a8a)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:32.186427 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8578848-36bc-4b86-9733-0c87c0b6ca1a admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:32.271860 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-555e7055-b03e-4019-8d08-43cc728f165a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eab297759d134ed58b91b593ebbf5ad2', 'request_id': 'req-555e7055-b03e-4019-8d08-43cc728f165a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:32.279790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-555e7055-b03e-4019-8d08-43cc728f165a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eab297759d134ed58b91b593ebbf5ad2', 'request_id': 'req-555e7055-b03e-4019-8d08-43cc728f165a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:32.291878 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-555e7055-b03e-4019-8d08-43cc728f165a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eab297759d134ed58b91b593ebbf5ad2', 'request_id': 'req-555e7055-b03e-4019-8d08-43cc728f165a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:32.348025 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a8578848-36bc-4b86-9733-0c87c0b6ca1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fbdc2e5a7674bcba815756e84f81a8a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:32.356499 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-555e7055-b03e-4019-8d08-43cc728f165a admin admin] The token cache is being invalidate because project eab297759d134ed58b91b593ebbf5ad2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:24:32.356790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-555e7055-b03e-4019-8d08-43cc728f165a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:32.357412 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-555e7055-b03e-4019-8d08-43cc728f165a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:32.358967 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1120/2224] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:24:32 2022] DELETE /identity/v3/projects/eab297759d134ed58b91b593ebbf5ad2 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:32.364651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68fffd-b5ba-4838-b2b7-c1fbe902bdbd None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:32.365014 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68fffd-b5ba-4838-b2b7-c1fbe902bdbd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:32.365320 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68fffd-b5ba-4838-b2b7-c1fbe902bdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:32.385144 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-dc68fffd-b5ba-4838-b2b7-c1fbe902bdbd None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:32.386347 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-dc68fffd-b5ba-4838-b2b7-c1fbe902bdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:32.430705 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a8578848-36bc-4b86-9733-0c87c0b6ca1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fbdc2e5a7674bcba815756e84f81a8a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:32.443223 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a8578848-36bc-4b86-9733-0c87c0b6ca1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fbdc2e5a7674bcba815756e84f81a8a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:32.443773 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1121/2225] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:24:32.443893 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a8578848-36bc-4b86-9733-0c87c0b6ca1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fbdc2e5a7674bcba815756e84f81a8a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:32.450803 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a8578848-36bc-4b86-9733-0c87c0b6ca1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fbdc2e5a7674bcba815756e84f81a8a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:32.451769 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79c1c0-876a-4028-9529-4d791778eca2 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:32.452066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79c1c0-876a-4028-9529-4d791778eca2 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:32.452402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b79c1c0-876a-4028-9529-4d791778eca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:32.457137 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1105/2226] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:24:32 2022] DELETE /identity/v3/users/5fbdc2e5a7674bcba815756e84f81a8a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:24:32.461498 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd8447-0381-46f8-911b-b010f99aa125 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:32.461780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd8447-0381-46f8-911b-b010f99aa125 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:32.462257 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd8447-0381-46f8-911b-b010f99aa125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:32.476590 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-2b79c1c0-876a-4028-9529-4d791778eca2 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:32.478057 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2b79c1c0-876a-4028-9529-4d791778eca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:32.482110 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-66dd8447-0381-46f8-911b-b010f99aa125 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:32.483304 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-66dd8447-0381-46f8-911b-b010f99aa125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:32.556323 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1122/2227] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:24:32.560207 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79c1c0-876a-4028-9529-4d791778eca2 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:32.566203 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1106/2228] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:24:32.573018 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b79c1c0-876a-4028-9529-4d791778eca2 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:32.578397 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40f4e5-b207-42a3-a3fd-e062a4e71873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:32.579027 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40f4e5-b207-42a3-a3fd-e062a4e71873 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:32.581073 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40f4e5-b207-42a3-a3fd-e062a4e71873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:32.581073 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f40f4e5-b207-42a3-a3fd-e062a4e71873 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:32.581073 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40f4e5-b207-42a3-a3fd-e062a4e71873 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:24:32.581335 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40f4e5-b207-42a3-a3fd-e062a4e71873 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:32.582719 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f40f4e5-b207-42a3-a3fd-e062a4e71873 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:32.592946 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd8447-0381-46f8-911b-b010f99aa125 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:32.594745 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-66dd8447-0381-46f8-911b-b010f99aa125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:32.595372 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1123/2229] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:24:32.600212 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40f4e5-b207-42a3-a3fd-e062a4e71873 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:32.610587 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f40f4e5-b207-42a3-a3fd-e062a4e71873 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:32.617561 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d63d23-ca93-4217-848f-27639e25a2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:32.619826 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d63d23-ca93-4217-848f-27639e25a2af admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:32.620129 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d63d23-ca93-4217-848f-27639e25a2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:32.620422 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d63d23-ca93-4217-848f-27639e25a2af admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:32.621069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d63d23-ca93-4217-848f-27639e25a2af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:32.623087 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d63d23-ca93-4217-848f-27639e25a2af admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:32.652315 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:32.678941 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd8447-0381-46f8-911b-b010f99aa125 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:32.682925 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb58f5d-d6aa-4b54-bda5-e11e2377da53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:32.683619 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb58f5d-d6aa-4b54-bda5-e11e2377da53 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:32.683963 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb58f5d-d6aa-4b54-bda5-e11e2377da53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:32.684369 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb58f5d-d6aa-4b54-bda5-e11e2377da53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:32.694279 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb58f5d-d6aa-4b54-bda5-e11e2377da53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:32.695729 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb58f5d-d6aa-4b54-bda5-e11e2377da53 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:32.700808 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:32.706501 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1107/2230] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:24:32.719813 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1124/2231] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:24:32 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:24:32.725036 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb58f5d-d6aa-4b54-bda5-e11e2377da53 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:32.736693 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb58f5d-d6aa-4b54-bda5-e11e2377da53 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:32.803744 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958705d-6146-47b8-a828-e48167276573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:32.804894 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958705d-6146-47b8-a828-e48167276573 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:32.804894 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958705d-6146-47b8-a828-e48167276573 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:32.805193 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0958705d-6146-47b8-a828-e48167276573 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:32.805841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958705d-6146-47b8-a828-e48167276573 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:32.807787 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0958705d-6146-47b8-a828-e48167276573 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:32.833302 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d63d23-ca93-4217-848f-27639e25a2af admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:32.835039 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-77d63d23-ca93-4217-848f-27639e25a2af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:32.847411 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d63d23-ca93-4217-848f-27639e25a2af admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:32.852032 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c289c91-5f11-4023-8412-f438b1b9c0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:32.852693 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c289c91-5f11-4023-8412-f438b1b9c0a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:32.852981 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c289c91-5f11-4023-8412-f438b1b9c0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:32.853258 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c289c91-5f11-4023-8412-f438b1b9c0a8 admin admin] PATH_INFO: `/v3/users/fcbae7c8cb734df3bb70946d3cfaf919` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:32.854390 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c289c91-5f11-4023-8412-f438b1b9c0a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcbae7c8cb734df3bb70946d3cfaf919)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:32.856326 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c289c91-5f11-4023-8412-f438b1b9c0a8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:32.909601 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1108/2232] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:24:32 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:24:32.910933 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958705d-6146-47b8-a828-e48167276573 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:32.925881 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0958705d-6146-47b8-a828-e48167276573 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:32.931128 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6152b6-7a93-4da2-8d7e-eb83ccd8e612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:32.937344 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6152b6-7a93-4da2-8d7e-eb83ccd8e612 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:32.937344 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6152b6-7a93-4da2-8d7e-eb83ccd8e612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:32.937344 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6152b6-7a93-4da2-8d7e-eb83ccd8e612 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:32.937344 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6152b6-7a93-4da2-8d7e-eb83ccd8e612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:32.937344 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6152b6-7a93-4da2-8d7e-eb83ccd8e612 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:32.945716 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1109/2233] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:32.949904 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6152b6-7a93-4da2-8d7e-eb83ccd8e612 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:32.960232 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6152b6-7a93-4da2-8d7e-eb83ccd8e612 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:32.965602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4561432-afb0-4084-9f63-039117cd65da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:32.965602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4561432-afb0-4084-9f63-039117cd65da admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:32.965917 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4561432-afb0-4084-9f63-039117cd65da admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:32.966128 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4561432-afb0-4084-9f63-039117cd65da admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:32.966750 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4561432-afb0-4084-9f63-039117cd65da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:32.968372 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4561432-afb0-4084-9f63-039117cd65da admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:32.980158 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1110/2234] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:24:32.984408 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4561432-afb0-4084-9f63-039117cd65da admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:32.995198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4561432-afb0-4084-9f63-039117cd65da admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:33.000732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209947a2-699a-4fd2-b5f0-d78beda6a6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:33.001401 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209947a2-699a-4fd2-b5f0-d78beda6a6ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:33.001736 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209947a2-699a-4fd2-b5f0-d78beda6a6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:33.002263 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209947a2-699a-4fd2-b5f0-d78beda6a6ac admin admin] PATH_INFO: `/v3/projects/5883f913ae944c29ab1b993640c3adb5/users/58a4e01e4342406eb537d8be42571d54/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:33.020891 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209947a2-699a-4fd2-b5f0-d78beda6a6ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=5883f913ae944c29ab1b993640c3adb5, user_id=58a4e01e4342406eb537d8be42571d54, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:33.023744 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209947a2-699a-4fd2-b5f0-d78beda6a6ac admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:33.091774 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-3c289c91-5f11-4023-8412-f438b1b9c0a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcbae7c8cb734df3bb70946d3cfaf919'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:33.105720 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1111/2235] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:24:32 2022] PUT /identity/v3/projects/5883f913ae944c29ab1b993640c3adb5/users/58a4e01e4342406eb537d8be42571d54/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:33.122695 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e835fc-026e-4685-8eaf-2d7c73ffb453 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:33.122695 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e835fc-026e-4685-8eaf-2d7c73ffb453 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:33.122951 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e835fc-026e-4685-8eaf-2d7c73ffb453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:33.162755 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-3c289c91-5f11-4023-8412-f438b1b9c0a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcbae7c8cb734df3bb70946d3cfaf919'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:33.178715 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-b3e835fc-026e-4685-8eaf-2d7c73ffb453 None None] MFA Rules not processed for user `58a4e01e4342406eb537d8be42571d54`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:33.180787 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b3e835fc-026e-4685-8eaf-2d7c73ffb453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:33.183246 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-3c289c91-5f11-4023-8412-f438b1b9c0a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcbae7c8cb734df3bb70946d3cfaf919'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:33.184253 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-3c289c91-5f11-4023-8412-f438b1b9c0a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcbae7c8cb734df3bb70946d3cfaf919'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:33.196818 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-3c289c91-5f11-4023-8412-f438b1b9c0a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcbae7c8cb734df3bb70946d3cfaf919'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:33.209698 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1125/2236] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:24:32 2022] DELETE /identity/v3/users/fcbae7c8cb734df3bb70946d3cfaf919 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:24:33.213408 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c289c91-5f11-4023-8412-f438b1b9c0a8 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:33.219797 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3c289c91-5f11-4023-8412-f438b1b9c0a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:33.299803 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c289c91-5f11-4023-8412-f438b1b9c0a8 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:33.309624 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1112/2237] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:33.312022 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d2aa0-cd35-43fe-b6d3-fc8d48d214ff None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:33.312352 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d2aa0-cd35-43fe-b6d3-fc8d48d214ff None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:33.312765 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d2aa0-cd35-43fe-b6d3-fc8d48d214ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:33.320030 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e87bcb-4a65-424c-9313-245d35033518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:33.320694 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e87bcb-4a65-424c-9313-245d35033518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:33.320990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e87bcb-4a65-424c-9313-245d35033518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:33.326400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e87bcb-4a65-424c-9313-245d35033518 admin admin] PATH_INFO: `/v3/projects/cae8f3c77a7e4b3199ec8b57bf7f0e88` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:33.326400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e87bcb-4a65-424c-9313-245d35033518 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cae8f3c77a7e4b3199ec8b57bf7f0e88)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:33.326400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e87bcb-4a65-424c-9313-245d35033518 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:33.355525 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-873d2aa0-cd35-43fe-b6d3-fc8d48d214ff None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:33.356887 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-873d2aa0-cd35-43fe-b6d3-fc8d48d214ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:33.372597 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1113/2238] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:33.378121 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d2aa0-cd35-43fe-b6d3-fc8d48d214ff None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:33.378121 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-873d2aa0-cd35-43fe-b6d3-fc8d48d214ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:33.452858 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d2aa0-cd35-43fe-b6d3-fc8d48d214ff None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:33.472553 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-73e87bcb-4a65-424c-9313-245d35033518 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cae8f3c77a7e4b3199ec8b57bf7f0e88', 'request_id': 'req-73e87bcb-4a65-424c-9313-245d35033518'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:33.480282 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-73e87bcb-4a65-424c-9313-245d35033518 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cae8f3c77a7e4b3199ec8b57bf7f0e88', 'request_id': 'req-73e87bcb-4a65-424c-9313-245d35033518'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:33.490335 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-73e87bcb-4a65-424c-9313-245d35033518 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cae8f3c77a7e4b3199ec8b57bf7f0e88', 'request_id': 'req-73e87bcb-4a65-424c-9313-245d35033518'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:33.525418 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad5e67-e6f8-4879-a17a-7ddc941dc2b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:33.526050 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad5e67-e6f8-4879-a17a-7ddc941dc2b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:33.526331 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad5e67-e6f8-4879-a17a-7ddc941dc2b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:33.526608 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad5e67-e6f8-4879-a17a-7ddc941dc2b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:33.564241 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-73e87bcb-4a65-424c-9313-245d35033518 admin admin] The token cache is being invalidate because project cae8f3c77a7e4b3199ec8b57bf7f0e88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:24:33.565261 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-73e87bcb-4a65-424c-9313-245d35033518 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:33.566513 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-73e87bcb-4a65-424c-9313-245d35033518 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:33.568387 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1126/2239] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:24:33 2022] DELETE /identity/v3/projects/cae8f3c77a7e4b3199ec8b57bf7f0e88 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:33.569393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e87bcb-4a65-424c-9313-245d35033518 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:33.570722 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-73e87bcb-4a65-424c-9313-245d35033518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:33.599914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad5e67-e6f8-4879-a17a-7ddc941dc2b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:33.601421 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ad5e67-e6f8-4879-a17a-7ddc941dc2b9 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:33.611412 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1114/2240] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:24:33.612432 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad5e67-e6f8-4879-a17a-7ddc941dc2b9 service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:33.637966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e87bcb-4a65-424c-9313-245d35033518 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:33.642167 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39e129-5e0e-4fe4-b1e9-751d6a996354 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:33.647925 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39e129-5e0e-4fe4-b1e9-751d6a996354 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:33.647925 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39e129-5e0e-4fe4-b1e9-751d6a996354 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:33.647925 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a39e129-5e0e-4fe4-b1e9-751d6a996354 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:33.647925 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3a39e129-5e0e-4fe4-b1e9-751d6a996354 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:33.691201 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad5e67-e6f8-4879-a17a-7ddc941dc2b9 service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:33.696828 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f06e5f-0b1e-4833-8733-81f5bda9f08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:33.697512 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f06e5f-0b1e-4833-8733-81f5bda9f08a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:33.710133 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f06e5f-0b1e-4833-8733-81f5bda9f08a admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:33.710133 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f06e5f-0b1e-4833-8733-81f5bda9f08a admin admin] PATH_INFO: `/v3/users/5e80fd29afcb4939bcbbd72e521d01cb` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:33.710133 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f06e5f-0b1e-4833-8733-81f5bda9f08a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e80fd29afcb4939bcbbd72e521d01cb)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:33.710133 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f06e5f-0b1e-4833-8733-81f5bda9f08a admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:33.722548 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39e129-5e0e-4fe4-b1e9-751d6a996354 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:33.724687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a39e129-5e0e-4fe4-b1e9-751d6a996354 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:33.734880 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1127/2241] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:24:33.827008 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:INSERT=3,keystone:SELECT=80,keystone:DELETE=17 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:33.876141 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-09f06e5f-0b1e-4833-8733-81f5bda9f08a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e80fd29afcb4939bcbbd72e521d01cb'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:33.952827 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:33.958318 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-09f06e5f-0b1e-4833-8733-81f5bda9f08a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e80fd29afcb4939bcbbd72e521d01cb'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:33.971951 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-09f06e5f-0b1e-4833-8733-81f5bda9f08a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e80fd29afcb4939bcbbd72e521d01cb'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:33.973439 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-09f06e5f-0b1e-4833-8733-81f5bda9f08a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e80fd29afcb4939bcbbd72e521d01cb'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:33.996067 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-09f06e5f-0b1e-4833-8733-81f5bda9f08a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e80fd29afcb4939bcbbd72e521d01cb'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:34.003683 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1115/2242] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:24:33 2022] DELETE /identity/v3/users/5e80fd29afcb4939bcbbd72e521d01cb => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:34.400741 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39e129-5e0e-4fe4-b1e9-751d6a996354 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:34.402306 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3a39e129-5e0e-4fe4-b1e9-751d6a996354 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:34.447526 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a39e129-5e0e-4fe4-b1e9-751d6a996354 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:34.567738 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7fbd6-b959-44bf-8f98-318d51ed9c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:34.568417 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7fbd6-b959-44bf-8f98-318d51ed9c73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:34.568906 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7fbd6-b959-44bf-8f98-318d51ed9c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:34.569218 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7fbd6-b959-44bf-8f98-318d51ed9c73 admin admin] PATH_INFO: `/v3/projects/3936373854644902843e345a86d9cd74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:34.570364 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7fbd6-b959-44bf-8f98-318d51ed9c73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3936373854644902843e345a86d9cd74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:34.572302 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7fbd6-b959-44bf-8f98-318d51ed9c73 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:34.770675 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-93a7fbd6-b959-44bf-8f98-318d51ed9c73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3936373854644902843e345a86d9cd74', 'request_id': 'req-93a7fbd6-b959-44bf-8f98-318d51ed9c73'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:34.777332 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-93a7fbd6-b959-44bf-8f98-318d51ed9c73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3936373854644902843e345a86d9cd74', 'request_id': 'req-93a7fbd6-b959-44bf-8f98-318d51ed9c73'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:34.793754 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-93a7fbd6-b959-44bf-8f98-318d51ed9c73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3936373854644902843e345a86d9cd74', 'request_id': 'req-93a7fbd6-b959-44bf-8f98-318d51ed9c73'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:34.807172 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f06e5f-0b1e-4833-8733-81f5bda9f08a admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:34.809036 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-09f06e5f-0b1e-4833-8733-81f5bda9f08a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:34.829678 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f06e5f-0b1e-4833-8733-81f5bda9f08a admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:34.912543 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-93a7fbd6-b959-44bf-8f98-318d51ed9c73 admin admin] The token cache is being invalidate because project 3936373854644902843e345a86d9cd74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:24:34.913254 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-93a7fbd6-b959-44bf-8f98-318d51ed9c73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:34.914154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-93a7fbd6-b959-44bf-8f98-318d51ed9c73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:34.914609 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a298e5-cfae-4602-aa08-b394cfa66b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:34.915420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a298e5-cfae-4602-aa08-b394cfa66b7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:34.916070 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a298e5-cfae-4602-aa08-b394cfa66b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:34.916205 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1128/2243] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:24:34 2022] DELETE /identity/v3/projects/3936373854644902843e345a86d9cd74 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:34.916752 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a298e5-cfae-4602-aa08-b394cfa66b7f admin admin] PATH_INFO: `/v3/projects/ad8242de20ef46339ac36d1712567ea4` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:34.918342 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a298e5-cfae-4602-aa08-b394cfa66b7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad8242de20ef46339ac36d1712567ea4)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:34.921285 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a298e5-cfae-4602-aa08-b394cfa66b7f admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:34.922174 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc33009-597c-463c-9420-59c031b45b81 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:34.922652 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc33009-597c-463c-9420-59c031b45b81 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:34.923067 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc33009-597c-463c-9420-59c031b45b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:34.965143 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-edc33009-597c-463c-9420-59c031b45b81 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:34.966734 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-edc33009-597c-463c-9420-59c031b45b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:34.982351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1129/2244] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:24:34.989684 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8bea9-a5cc-40f4-95ee-ad21a4ef02a1 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:34.989940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8bea9-a5cc-40f4-95ee-ad21a4ef02a1 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:34.990228 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8bea9-a5cc-40f4-95ee-ad21a4ef02a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:35.045190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-16a8bea9-a5cc-40f4-95ee-ad21a4ef02a1 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:35.048470 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-16a8bea9-a5cc-40f4-95ee-ad21a4ef02a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:35.073228 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e1a298e5-cfae-4602-aa08-b394cfa66b7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad8242de20ef46339ac36d1712567ea4', 'request_id': 'req-e1a298e5-cfae-4602-aa08-b394cfa66b7f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:35.135369 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1130/2245] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:35.138875 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8bea9-a5cc-40f4-95ee-ad21a4ef02a1 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:35.148777 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8bea9-a5cc-40f4-95ee-ad21a4ef02a1 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:35.154210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a3596-8e31-49fc-b873-a7a7c2690845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:35.154895 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a3596-8e31-49fc-b873-a7a7c2690845 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:35.155183 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a3596-8e31-49fc-b873-a7a7c2690845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:35.155525 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490a3596-8e31-49fc-b873-a7a7c2690845 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:35.156200 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a3596-8e31-49fc-b873-a7a7c2690845 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:24:35.156513 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a3596-8e31-49fc-b873-a7a7c2690845 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:35.158132 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490a3596-8e31-49fc-b873-a7a7c2690845 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:35.169154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e1a298e5-cfae-4602-aa08-b394cfa66b7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad8242de20ef46339ac36d1712567ea4', 'request_id': 'req-e1a298e5-cfae-4602-aa08-b394cfa66b7f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:35.172153 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1131/2246] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:24:35.175362 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a3596-8e31-49fc-b873-a7a7c2690845 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:35.179845 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e1a298e5-cfae-4602-aa08-b394cfa66b7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad8242de20ef46339ac36d1712567ea4', 'request_id': 'req-e1a298e5-cfae-4602-aa08-b394cfa66b7f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:35.192674 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e1a298e5-cfae-4602-aa08-b394cfa66b7f admin admin] The token cache is being invalidate because project ad8242de20ef46339ac36d1712567ea4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:24:35.192992 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e1a298e5-cfae-4602-aa08-b394cfa66b7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:35.193631 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e1a298e5-cfae-4602-aa08-b394cfa66b7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:35.195232 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1116/2247] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:24:34 2022] DELETE /identity/v3/projects/ad8242de20ef46339ac36d1712567ea4 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:24:35.197088 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490a3596-8e31-49fc-b873-a7a7c2690845 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:35.200272 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0266c1f-75ae-46a7-9ddf-89a6bd370f0e None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:35.200617 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0266c1f-75ae-46a7-9ddf-89a6bd370f0e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:35.201035 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0266c1f-75ae-46a7-9ddf-89a6bd370f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:35.204986 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb0c02-8f19-419e-b7e5-d8c51b8a13c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:35.206243 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb0c02-8f19-419e-b7e5-d8c51b8a13c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:35.210624 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb0c02-8f19-419e-b7e5-d8c51b8a13c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:35.210624 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccb0c02-8f19-419e-b7e5-d8c51b8a13c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:35.210624 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb0c02-8f19-419e-b7e5-d8c51b8a13c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:35.210624 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccb0c02-8f19-419e-b7e5-d8c51b8a13c9 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:35.230724 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f0266c1f-75ae-46a7-9ddf-89a6bd370f0e None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:35.232023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f0266c1f-75ae-46a7-9ddf-89a6bd370f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:35.246355 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1117/2248] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:24:35.255374 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd14766-2cf0-4dab-a244-ed73138b4fad None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:35.255659 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd14766-2cf0-4dab-a244-ed73138b4fad None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:35.255933 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd14766-2cf0-4dab-a244-ed73138b4fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:35.278297 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-dfd14766-2cf0-4dab-a244-ed73138b4fad None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:35.279529 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-dfd14766-2cf0-4dab-a244-ed73138b4fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:35.289233 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1118/2249] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:24:35.292435 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd14766-2cf0-4dab-a244-ed73138b4fad None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:35.302832 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd14766-2cf0-4dab-a244-ed73138b4fad None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:35.307586 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e72b6-1623-4a45-926e-6566515c44ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:35.308229 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e72b6-1623-4a45-926e-6566515c44ac admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:35.308514 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e72b6-1623-4a45-926e-6566515c44ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:35.309248 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e72b6-1623-4a45-926e-6566515c44ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:35.309750 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e72b6-1623-4a45-926e-6566515c44ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:24:35.310083 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e72b6-1623-4a45-926e-6566515c44ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:35.311732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3e72b6-1623-4a45-926e-6566515c44ac admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:35.324739 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1119/2250] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:24:35.329241 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e72b6-1623-4a45-926e-6566515c44ac admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:35.340977 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3e72b6-1623-4a45-926e-6566515c44ac admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:35.342575 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1132/2251] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:24:35 2022] POST /identity/v3/projects => generated 399 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:24:35.347409 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb0c02-8f19-419e-b7e5-d8c51b8a13c9 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:35.350870 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-cccb0c02-8f19-419e-b7e5-d8c51b8a13c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:35.426242 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92133075-7193-4fe9-b83d-c7c0b967d79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:35.426577 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccb0c02-8f19-419e-b7e5-d8c51b8a13c9 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:35.426912 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92133075-7193-4fe9-b83d-c7c0b967d79e admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:35.427196 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92133075-7193-4fe9-b83d-c7c0b967d79e admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:35.427471 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92133075-7193-4fe9-b83d-c7c0b967d79e admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:35.428224 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92133075-7193-4fe9-b83d-c7c0b967d79e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:35.430306 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92133075-7193-4fe9-b83d-c7c0b967d79e admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:35.432257 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f923ce1-6a08-4d56-94db-ca59bf7f9b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:35.432979 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f923ce1-6a08-4d56-94db-ca59bf7f9b4f admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:35.433271 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f923ce1-6a08-4d56-94db-ca59bf7f9b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:35.433652 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f923ce1-6a08-4d56-94db-ca59bf7f9b4f admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:35.434300 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f923ce1-6a08-4d56-94db-ca59bf7f9b4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:35.436544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f923ce1-6a08-4d56-94db-ca59bf7f9b4f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:35.445258 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:35.530165 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1133/2252] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:24:35 2022] POST /identity/v3/users => generated 300 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:24:35.530535 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1120/2253] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:24:35 2022] POST /identity/v3/projects => generated 367 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:24:35.545493 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f923ce1-6a08-4d56-94db-ca59bf7f9b4f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:35.556413 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92133075-7193-4fe9-b83d-c7c0b967d79e admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:35.557265 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f923ce1-6a08-4d56-94db-ca59bf7f9b4f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:35.634688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92133075-7193-4fe9-b83d-c7c0b967d79e admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:35.635322 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3171c85-c288-4861-841b-741f74ef7733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:35.635322 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3171c85-c288-4861-841b-741f74ef7733 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:35.635322 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3171c85-c288-4861-841b-741f74ef7733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:35.635322 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3171c85-c288-4861-841b-741f74ef7733 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:35.641323 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b9d66-5962-4365-bd7f-efcc8ea6abb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:35.641419 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3171c85-c288-4861-841b-741f74ef7733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:35.641504 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b9d66-5962-4365-bd7f-efcc8ea6abb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:35.641504 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b9d66-5962-4365-bd7f-efcc8ea6abb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:35.641504 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b9d66-5962-4365-bd7f-efcc8ea6abb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:35.641685 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3171c85-c288-4861-841b-741f74ef7733 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:35.641754 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b9d66-5962-4365-bd7f-efcc8ea6abb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:35.641754 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b9d66-5962-4365-bd7f-efcc8ea6abb9 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:35.648289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1134/2254] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:35.653016 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3171c85-c288-4861-841b-741f74ef7733 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:35.663938 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3171c85-c288-4861-841b-741f74ef7733 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:35.668885 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7e0ec-0027-4f6b-83c8-a788ec8c75ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:35.669837 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7e0ec-0027-4f6b-83c8-a788ec8c75ab admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:35.670188 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7e0ec-0027-4f6b-83c8-a788ec8c75ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:35.670651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7e0ec-0027-4f6b-83c8-a788ec8c75ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:35.671361 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b7e0ec-0027-4f6b-83c8-a788ec8c75ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:35.673055 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b7e0ec-0027-4f6b-83c8-a788ec8c75ab admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:35.685239 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1135/2255] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:24:35.696146 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7e0ec-0027-4f6b-83c8-a788ec8c75ab admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:35.706663 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7e0ec-0027-4f6b-83c8-a788ec8c75ab admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:35.711863 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80157df1-9f44-401e-ba6f-c47b2cdec3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:35.712564 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80157df1-9f44-401e-ba6f-c47b2cdec3cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:35.712867 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80157df1-9f44-401e-ba6f-c47b2cdec3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:35.713147 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80157df1-9f44-401e-ba6f-c47b2cdec3cc admin admin] PATH_INFO: `/v3/projects/f36658b07848457aa23250a1bfa45120/users/f4a286bb6e8347478248b1224ff3240e/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:35.732055 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80157df1-9f44-401e-ba6f-c47b2cdec3cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f36658b07848457aa23250a1bfa45120, user_id=f4a286bb6e8347478248b1224ff3240e, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:35.734746 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80157df1-9f44-401e-ba6f-c47b2cdec3cc admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:35.794946 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1121/2256] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:24:35 2022] POST /identity/v3/users => generated 284 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:24:35.795966 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b9d66-5962-4365-bd7f-efcc8ea6abb9 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:35.806658 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b9d66-5962-4365-bd7f-efcc8ea6abb9 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:35.811371 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e8f0b-300e-4bf8-bbd9-9f37fbede8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:35.812216 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e8f0b-300e-4bf8-bbd9-9f37fbede8ab admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:35.812508 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e8f0b-300e-4bf8-bbd9-9f37fbede8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:35.812784 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e8f0b-300e-4bf8-bbd9-9f37fbede8ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:35.813504 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e8f0b-300e-4bf8-bbd9-9f37fbede8ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:35.815106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777e8f0b-300e-4bf8-bbd9-9f37fbede8ab admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:35.825745 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1122/2257] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:24:35.829678 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e8f0b-300e-4bf8-bbd9-9f37fbede8ab admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:35.840166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e8f0b-300e-4bf8-bbd9-9f37fbede8ab admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:35.846901 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa95398-b727-4d17-af04-a1017b47fedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:35.847611 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa95398-b727-4d17-af04-a1017b47fedf admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:35.847797 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa95398-b727-4d17-af04-a1017b47fedf admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:35.848073 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa95398-b727-4d17-af04-a1017b47fedf admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:35.848743 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa95398-b727-4d17-af04-a1017b47fedf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:35.850366 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa95398-b727-4d17-af04-a1017b47fedf admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:35.862743 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1123/2258] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:24:35.866981 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa95398-b727-4d17-af04-a1017b47fedf admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:35.877073 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa95398-b727-4d17-af04-a1017b47fedf admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:35.887605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64207a7f-c1f9-4b13-8b6f-ef2893a069a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:35.889018 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64207a7f-c1f9-4b13-8b6f-ef2893a069a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:35.889325 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64207a7f-c1f9-4b13-8b6f-ef2893a069a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:35.900243 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64207a7f-c1f9-4b13-8b6f-ef2893a069a4 admin admin] PATH_INFO: `/v3/projects/a3b8e906ee1448b4a3a75bff3bae44bc/users/e445ca826c5b478fbdfba80ce8266c73/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:35.900487 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1136/2259] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:24:35 2022] PUT /identity/v3/projects/f36658b07848457aa23250a1bfa45120/users/f4a286bb6e8347478248b1224ff3240e/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:24:35.904243 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1bfb6-f90e-4880-a8fc-c18b05519768 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:35.904533 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1bfb6-f90e-4880-a8fc-c18b05519768 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:35.904809 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1bfb6-f90e-4880-a8fc-c18b05519768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:35.917095 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64207a7f-c1f9-4b13-8b6f-ef2893a069a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3b8e906ee1448b4a3a75bff3bae44bc, user_id=e445ca826c5b478fbdfba80ce8266c73, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:35.920121 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64207a7f-c1f9-4b13-8b6f-ef2893a069a4 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:35.939013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-cfa1bfb6-f90e-4880-a8fc-c18b05519768 None None] MFA Rules not processed for user `f4a286bb6e8347478248b1224ff3240e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:35.941799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-cfa1bfb6-f90e-4880-a8fc-c18b05519768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:35.958413 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:36.038767 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1124/2260] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:24:35 2022] PUT /identity/v3/projects/a3b8e906ee1448b4a3a75bff3bae44bc/users/e445ca826c5b478fbdfba80ce8266c73/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:24:36.043611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1137/2261] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:35 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:36.049468 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf1159-8875-4fd6-ab67-481df2b8b180 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:36.050004 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf1159-8875-4fd6-ab67-481df2b8b180 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:36.050477 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf1159-8875-4fd6-ab67-481df2b8b180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:36.051763 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1bfb6-f90e-4880-a8fc-c18b05519768 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:36.053209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-cfa1bfb6-f90e-4880-a8fc-c18b05519768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:36.082925 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-aedf1159-8875-4fd6-ab67-481df2b8b180 None None] MFA Rules not processed for user `e445ca826c5b478fbdfba80ce8266c73`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:36.084730 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-aedf1159-8875-4fd6-ab67-481df2b8b180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:36.121663 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1bfb6-f90e-4880-a8fc-c18b05519768 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:36.166623 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1125/2262] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:36.171740 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf1159-8875-4fd6-ab67-481df2b8b180 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:36.178398 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72fb56-75c6-4d79-9ca2-5650fe3c8285 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:36.179107 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72fb56-75c6-4d79-9ca2-5650fe3c8285 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:36.179485 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72fb56-75c6-4d79-9ca2-5650fe3c8285 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:36.179815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f72fb56-75c6-4d79-9ca2-5650fe3c8285 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:36.245647 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72fb56-75c6-4d79-9ca2-5650fe3c8285 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:36.247781 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f72fb56-75c6-4d79-9ca2-5650fe3c8285 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:36.249989 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf1159-8875-4fd6-ab67-481df2b8b180 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:36.255006 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311dc861-8c30-43ab-afea-2a57eb60fc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:36.255520 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dc861-8c30-43ab-afea-2a57eb60fc81 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:36.255803 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dc861-8c30-43ab-afea-2a57eb60fc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:36.256078 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dc861-8c30-43ab-afea-2a57eb60fc81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:36.256741 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311dc861-8c30-43ab-afea-2a57eb60fc81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:36.258828 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311dc861-8c30-43ab-afea-2a57eb60fc81 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:36.259359 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1138/2263] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:36 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:24:36.360071 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1126/2264] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:24:36 2022] POST /identity/v3/projects => generated 367 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:24:36.363992 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72fb56-75c6-4d79-9ca2-5650fe3c8285 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:36.382572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f72fb56-75c6-4d79-9ca2-5650fe3c8285 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:36.464015 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31573f1d-9439-4011-bb0f-973c38332d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:36.464958 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31573f1d-9439-4011-bb0f-973c38332d3a admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:36.465426 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31573f1d-9439-4011-bb0f-973c38332d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:36.466422 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31573f1d-9439-4011-bb0f-973c38332d3a admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:36.467127 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31573f1d-9439-4011-bb0f-973c38332d3a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:36.469116 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31573f1d-9439-4011-bb0f-973c38332d3a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:36.580009 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1139/2265] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:24:36 2022] POST /identity/v3/users => generated 290 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:24:36.584546 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311dc861-8c30-43ab-afea-2a57eb60fc81 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:36.606679 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311dc861-8c30-43ab-afea-2a57eb60fc81 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:36.616320 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ec900-1a54-4d1b-88c0-0ae19a28c7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:36.616935 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ec900-1a54-4d1b-88c0-0ae19a28c7ca admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:36.617211 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ec900-1a54-4d1b-88c0-0ae19a28c7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:36.617484 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ec900-1a54-4d1b-88c0-0ae19a28c7ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:36.618123 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ec900-1a54-4d1b-88c0-0ae19a28c7ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:36.620991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ec900-1a54-4d1b-88c0-0ae19a28c7ca admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:36.632341 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1127/2266] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:36.636533 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31573f1d-9439-4011-bb0f-973c38332d3a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:36.647318 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31573f1d-9439-4011-bb0f-973c38332d3a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:36.655243 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fdb02-158f-49b0-a780-5acadc8f3bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:36.656708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fdb02-158f-49b0-a780-5acadc8f3bd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:36.657209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fdb02-158f-49b0-a780-5acadc8f3bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:36.657688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fdb02-158f-49b0-a780-5acadc8f3bd0 admin admin] PATH_INFO: `/v3/projects/a053ff4fe61a4d07ae0fc1288509aa26/users/dbe58a1cef7d459dba9cb0920b19b8a4/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:36.660358 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:36.678547 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01fdb02-158f-49b0-a780-5acadc8f3bd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a053ff4fe61a4d07ae0fc1288509aa26, user_id=dbe58a1cef7d459dba9cb0920b19b8a4, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:36.681326 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01fdb02-158f-49b0-a780-5acadc8f3bd0 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:36.778649 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1140/2267] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:24:36 2022] PUT /identity/v3/projects/a053ff4fe61a4d07ae0fc1288509aa26/users/dbe58a1cef7d459dba9cb0920b19b8a4/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:36.782662 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ec900-1a54-4d1b-88c0-0ae19a28c7ca admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:36.793071 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ec900-1a54-4d1b-88c0-0ae19a28c7ca admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:36.850143 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9df67-2846-44ff-9f38-e36ffb35c275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:36.850781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9df67-2846-44ff-9f38-e36ffb35c275 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:36.850973 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9df67-2846-44ff-9f38-e36ffb35c275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:36.851224 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9df67-2846-44ff-9f38-e36ffb35c275 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:36.851867 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9df67-2846-44ff-9f38-e36ffb35c275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:36.853508 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9df67-2846-44ff-9f38-e36ffb35c275 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:36.864518 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1128/2268] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:36 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:36.866179 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:36.869762 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fdb02-158f-49b0-a780-5acadc8f3bd0 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:36.884794 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fdb02-158f-49b0-a780-5acadc8f3bd0 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:36.889687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df948697-fe32-448d-bd7c-fe3002db3955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:36.890371 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df948697-fe32-448d-bd7c-fe3002db3955 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:36.890649 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df948697-fe32-448d-bd7c-fe3002db3955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:36.890920 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df948697-fe32-448d-bd7c-fe3002db3955 admin admin] PATH_INFO: `/v3/projects/a053ff4fe61a4d07ae0fc1288509aa26/users/dbe58a1cef7d459dba9cb0920b19b8a4/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:36.892884 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df948697-fe32-448d-bd7c-fe3002db3955 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a053ff4fe61a4d07ae0fc1288509aa26, user_id=dbe58a1cef7d459dba9cb0920b19b8a4, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:36.895460 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df948697-fe32-448d-bd7c-fe3002db3955 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:36.905762 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1141/2269] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:24:36 2022] PUT /identity/v3/projects/a053ff4fe61a4d07ae0fc1288509aa26/users/dbe58a1cef7d459dba9cb0920b19b8a4/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:36.916420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20fbe7-e1d4-4c93-8357-e87577d5865e None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:36.916835 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20fbe7-e1d4-4c93-8357-e87577d5865e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:36.917115 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20fbe7-e1d4-4c93-8357-e87577d5865e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:36.941579 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df948697-fe32-448d-bd7c-fe3002db3955 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:36.943389 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-df948697-fe32-448d-bd7c-fe3002db3955 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:36.947107 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-1d20fbe7-e1d4-4c93-8357-e87577d5865e None None] MFA Rules not processed for user `dbe58a1cef7d459dba9cb0920b19b8a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:36.948326 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1d20fbe7-e1d4-4c93-8357-e87577d5865e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:37.011693 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df948697-fe32-448d-bd7c-fe3002db3955 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:37.016538 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e52e6a-ee98-49a3-bcb1-f65e3d6985f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:37.017253 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e52e6a-ee98-49a3-bcb1-f65e3d6985f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:37.017630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e52e6a-ee98-49a3-bcb1-f65e3d6985f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:37.017930 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e52e6a-ee98-49a3-bcb1-f65e3d6985f8 admin admin] PATH_INFO: `/v3/users/58a4e01e4342406eb537d8be42571d54` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:37.020794 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e52e6a-ee98-49a3-bcb1-f65e3d6985f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58a4e01e4342406eb537d8be42571d54)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:37.027213 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e52e6a-ee98-49a3-bcb1-f65e3d6985f8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:37.033539 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1129/2270] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:36 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:37.056752 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20fbe7-e1d4-4c93-8357-e87577d5865e None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:37.112833 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20fbe7-e1d4-4c93-8357-e87577d5865e None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:37.116865 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2921e-3934-4a38-896a-330277ef687c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:37.117480 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2921e-3934-4a38-896a-330277ef687c service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:37.117763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2921e-3934-4a38-896a-330277ef687c service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:37.118040 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2921e-3934-4a38-896a-330277ef687c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:37.130912 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2921e-3934-4a38-896a-330277ef687c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:37.132447 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2921e-3934-4a38-896a-330277ef687c service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:37.144225 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1130/2271] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:37 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:24:37.305426 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e2e52e6a-ee98-49a3-bcb1-f65e3d6985f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58a4e01e4342406eb537d8be42571d54'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:37.369471 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2921e-3934-4a38-896a-330277ef687c service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:37.380465 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2921e-3934-4a38-896a-330277ef687c service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:37.384401 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e867b-513b-45e7-bec7-edf8e59576a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:37.385126 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e867b-513b-45e7-bec7-edf8e59576a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:37.385977 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e867b-513b-45e7-bec7-edf8e59576a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:37.386263 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e867b-513b-45e7-bec7-edf8e59576a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:37.386471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e2e52e6a-ee98-49a3-bcb1-f65e3d6985f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58a4e01e4342406eb537d8be42571d54'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:37.401886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e2e52e6a-ee98-49a3-bcb1-f65e3d6985f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58a4e01e4342406eb537d8be42571d54'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:37.402899 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e2e52e6a-ee98-49a3-bcb1-f65e3d6985f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58a4e01e4342406eb537d8be42571d54'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:37.412935 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e2e52e6a-ee98-49a3-bcb1-f65e3d6985f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58a4e01e4342406eb537d8be42571d54'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:37.422234 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1142/2272] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:24:36 2022] DELETE /identity/v3/users/58a4e01e4342406eb537d8be42571d54 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:37.427350 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bd87a-2822-450b-b5a1-ed7ed371f961 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:37.427693 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bd87a-2822-450b-b5a1-ed7ed371f961 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:37.427969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206bd87a-2822-450b-b5a1-ed7ed371f961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:37.465309 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-206bd87a-2822-450b-b5a1-ed7ed371f961 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:37.471511 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-206bd87a-2822-450b-b5a1-ed7ed371f961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:37.471630 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e867b-513b-45e7-bec7-edf8e59576a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:37.471630 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e867b-513b-45e7-bec7-edf8e59576a2 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:37.484223 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1131/2273] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:24:37.548272 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1143/2274] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:24:37.555998 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e867b-513b-45e7-bec7-edf8e59576a2 service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:37.557534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f27e867b-513b-45e7-bec7-edf8e59576a2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:37.638043 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e867b-513b-45e7-bec7-edf8e59576a2 service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:37.696963 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691e791-b154-4918-bad2-400e3f3dcfc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:37.697586 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691e791-b154-4918-bad2-400e3f3dcfc9 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:37.697867 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691e791-b154-4918-bad2-400e3f3dcfc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:37.698209 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691e791-b154-4918-bad2-400e3f3dcfc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:37.710889 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5691e791-b154-4918-bad2-400e3f3dcfc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:37.712394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5691e791-b154-4918-bad2-400e3f3dcfc9 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:37.721895 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1132/2275] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:24:37.826390 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:37.860838 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:38.208488 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:38.271363 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:38.383224 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206bd87a-2822-450b-b5a1-ed7ed371f961 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:38.384996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-206bd87a-2822-450b-b5a1-ed7ed371f961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:38.399553 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206bd87a-2822-450b-b5a1-ed7ed371f961 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:38.405805 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f57f5c-14f4-426b-bb56-1c9b01c8cc05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:38.406591 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f57f5c-14f4-426b-bb56-1c9b01c8cc05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:38.406950 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f57f5c-14f4-426b-bb56-1c9b01c8cc05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:38.407323 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f57f5c-14f4-426b-bb56-1c9b01c8cc05 admin admin] PATH_INFO: `/v3/projects/5883f913ae944c29ab1b993640c3adb5` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:38.408770 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f57f5c-14f4-426b-bb56-1c9b01c8cc05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5883f913ae944c29ab1b993640c3adb5)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:38.410867 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f57f5c-14f4-426b-bb56-1c9b01c8cc05 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:38.519606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-86f57f5c-14f4-426b-bb56-1c9b01c8cc05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5883f913ae944c29ab1b993640c3adb5', 'request_id': 'req-86f57f5c-14f4-426b-bb56-1c9b01c8cc05'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:38.527982 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-86f57f5c-14f4-426b-bb56-1c9b01c8cc05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5883f913ae944c29ab1b993640c3adb5', 'request_id': 'req-86f57f5c-14f4-426b-bb56-1c9b01c8cc05'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:38.536439 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-86f57f5c-14f4-426b-bb56-1c9b01c8cc05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5883f913ae944c29ab1b993640c3adb5', 'request_id': 'req-86f57f5c-14f4-426b-bb56-1c9b01c8cc05'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:38.611869 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-86f57f5c-14f4-426b-bb56-1c9b01c8cc05 admin admin] The token cache is being invalidate because project 5883f913ae944c29ab1b993640c3adb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:24:38.612758 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-86f57f5c-14f4-426b-bb56-1c9b01c8cc05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:38.617398 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-86f57f5c-14f4-426b-bb56-1c9b01c8cc05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:38.624459 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1144/2276] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:24:38 2022] DELETE /identity/v3/projects/5883f913ae944c29ab1b993640c3adb5 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:38.629762 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7afba-2391-4096-b1b5-7babd81b313f None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:38.630081 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7afba-2391-4096-b1b5-7babd81b313f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:38.630460 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7afba-2391-4096-b1b5-7babd81b313f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:38.666688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-4ed7afba-2391-4096-b1b5-7babd81b313f None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:38.668055 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4ed7afba-2391-4096-b1b5-7babd81b313f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:38.733076 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1133/2277] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:38.741496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9c10e-0a4f-4daa-a68e-c1e16b409712 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:38.741805 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9c10e-0a4f-4daa-a68e-c1e16b409712 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:38.742065 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d9c10e-0a4f-4daa-a68e-c1e16b409712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:38.765256 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-94d9c10e-0a4f-4daa-a68e-c1e16b409712 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:38.767028 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-94d9c10e-0a4f-4daa-a68e-c1e16b409712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:38.781101 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1145/2278] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:38.781945 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7afba-2391-4096-b1b5-7babd81b313f None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:38.797974 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7afba-2391-4096-b1b5-7babd81b313f None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:38.805398 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e594c-59a8-43e8-9b13-9a51769c2809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:38.806311 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e594c-59a8-43e8-9b13-9a51769c2809 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:38.806729 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e594c-59a8-43e8-9b13-9a51769c2809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:38.808785 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:38.809651 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e594c-59a8-43e8-9b13-9a51769c2809 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:38.810318 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e594c-59a8-43e8-9b13-9a51769c2809 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:24:38.810638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e594c-59a8-43e8-9b13-9a51769c2809 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:38.812443 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1e594c-59a8-43e8-9b13-9a51769c2809 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:38.826004 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1134/2279] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:24:38.831948 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9c10e-0a4f-4daa-a68e-c1e16b409712 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:38.843578 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d9c10e-0a4f-4daa-a68e-c1e16b409712 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:38.848719 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322a045-2d72-4fe6-b876-56cf44a44fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:38.849545 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322a045-2d72-4fe6-b876-56cf44a44fbc admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:38.850157 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322a045-2d72-4fe6-b876-56cf44a44fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:38.850586 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322a045-2d72-4fe6-b876-56cf44a44fbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:38.851369 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322a045-2d72-4fe6-b876-56cf44a44fbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:38.853565 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322a045-2d72-4fe6-b876-56cf44a44fbc admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:38.964510 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1146/2280] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:24:38 2022] POST /identity/v3/projects => generated 389 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:24:38.965930 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e594c-59a8-43e8-9b13-9a51769c2809 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:38.974959 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:38.981987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e594c-59a8-43e8-9b13-9a51769c2809 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:39.105268 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e15fa-e4e7-49d5-9d31-203cdb44d6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:39.105883 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e15fa-e4e7-49d5-9d31-203cdb44d6b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:39.106160 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e15fa-e4e7-49d5-9d31-203cdb44d6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:39.106432 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e15fa-e4e7-49d5-9d31-203cdb44d6b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:39.107074 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e15fa-e4e7-49d5-9d31-203cdb44d6b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:39.109130 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e15fa-e4e7-49d5-9d31-203cdb44d6b7 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:39.178271 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1135/2281] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:24:38 2022] POST /identity/v3/users => generated 295 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:24:39.179715 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322a045-2d72-4fe6-b876-56cf44a44fbc admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:39.191091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322a045-2d72-4fe6-b876-56cf44a44fbc admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:39.195885 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a799a73-eb8d-4bf5-9820-fe92da326882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:39.196388 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a799a73-eb8d-4bf5-9820-fe92da326882 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:39.196672 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a799a73-eb8d-4bf5-9820-fe92da326882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:39.196951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a799a73-eb8d-4bf5-9820-fe92da326882 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:39.197602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a799a73-eb8d-4bf5-9820-fe92da326882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:39.202199 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a799a73-eb8d-4bf5-9820-fe92da326882 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:39.210510 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1147/2282] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:39.215349 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e15fa-e4e7-49d5-9d31-203cdb44d6b7 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:39.228138 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e15fa-e4e7-49d5-9d31-203cdb44d6b7 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:39.232797 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996d9501-dff0-4aed-9083-5b1857a71726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:39.233488 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d9501-dff0-4aed-9083-5b1857a71726 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:39.233827 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d9501-dff0-4aed-9083-5b1857a71726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:39.234154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d9501-dff0-4aed-9083-5b1857a71726 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:39.234888 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d9501-dff0-4aed-9083-5b1857a71726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:39.237304 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996d9501-dff0-4aed-9083-5b1857a71726 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:39.253702 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1136/2283] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:39.267471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a799a73-eb8d-4bf5-9820-fe92da326882 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:39.290724 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a799a73-eb8d-4bf5-9820-fe92da326882 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:39.303466 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b99d3f-be83-4430-8cd9-413765ee4f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:39.304209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b99d3f-be83-4430-8cd9-413765ee4f0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:39.304491 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b99d3f-be83-4430-8cd9-413765ee4f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:39.304953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b99d3f-be83-4430-8cd9-413765ee4f0f admin admin] PATH_INFO: `/v3/projects/3b51f424b7bf4a7280ae94a6b25406ca/users/22753b48e1084577bbaa4d1135f02090/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:39.341053 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b99d3f-be83-4430-8cd9-413765ee4f0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b51f424b7bf4a7280ae94a6b25406ca, user_id=22753b48e1084577bbaa4d1135f02090, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:39.348036 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b99d3f-be83-4430-8cd9-413765ee4f0f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:39.353397 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72240cb-1a57-4c7a-9258-13f7f5dd0d4a None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:39.353948 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72240cb-1a57-4c7a-9258-13f7f5dd0d4a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:39.355251 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72240cb-1a57-4c7a-9258-13f7f5dd0d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:39.385722 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-d72240cb-1a57-4c7a-9258-13f7f5dd0d4a None None] MFA Rules not processed for user `2b5f0b0928874046ad7f4d873796d344`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:39.388518 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d72240cb-1a57-4c7a-9258-13f7f5dd0d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:39.433062 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:39.455224 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1137/2284] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:24:39.473833 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1148/2285] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:24:39 2022] PUT /identity/v3/projects/3b51f424b7bf4a7280ae94a6b25406ca/users/22753b48e1084577bbaa4d1135f02090/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:39.484467 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecbd94-d4f4-4bcc-9ba2-0d5af030c60c None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:39.484756 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecbd94-d4f4-4bcc-9ba2-0d5af030c60c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:39.485038 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecbd94-d4f4-4bcc-9ba2-0d5af030c60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:39.514381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-a8ecbd94-d4f4-4bcc-9ba2-0d5af030c60c None None] MFA Rules not processed for user `22753b48e1084577bbaa4d1135f02090`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:39.515691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a8ecbd94-d4f4-4bcc-9ba2-0d5af030c60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:39.591032 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1138/2286] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:39.602936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b99d3f-be83-4430-8cd9-413765ee4f0f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:39.605119 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-85b99d3f-be83-4430-8cd9-413765ee4f0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:39.666122 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b99d3f-be83-4430-8cd9-413765ee4f0f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:39.671053 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04b48a-fade-4d97-8526-647997284c60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:39.671705 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04b48a-fade-4d97-8526-647997284c60 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:39.671990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04b48a-fade-4d97-8526-647997284c60 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:39.672304 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04b48a-fade-4d97-8526-647997284c60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:39.688221 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04b48a-fade-4d97-8526-647997284c60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:39.688221 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04b48a-fade-4d97-8526-647997284c60 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:39.698843 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1149/2287] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:39 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:24:42.513573 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ecbd94-d4f4-4bcc-9ba2-0d5af030c60c None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:42.515067 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a8ecbd94-d4f4-4bcc-9ba2-0d5af030c60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:42.609352 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ecbd94-d4f4-4bcc-9ba2-0d5af030c60c None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:42.618037 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d5641-f668-43dd-beb5-1ec814ba5c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:42.618037 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d5641-f668-43dd-beb5-1ec814ba5c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:42.618343 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d5641-f668-43dd-beb5-1ec814ba5c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:42.618888 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d5641-f668-43dd-beb5-1ec814ba5c52 admin admin] PATH_INFO: `/v3/users/f4a286bb6e8347478248b1224ff3240e` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:42.620404 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d5641-f668-43dd-beb5-1ec814ba5c52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4a286bb6e8347478248b1224ff3240e)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:42.622551 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d5641-f668-43dd-beb5-1ec814ba5c52 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:42.852396 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-7d1d5641-f668-43dd-beb5-1ec814ba5c52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4a286bb6e8347478248b1224ff3240e'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:42.911361 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-7d1d5641-f668-43dd-beb5-1ec814ba5c52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4a286bb6e8347478248b1224ff3240e'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:42.924059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-7d1d5641-f668-43dd-beb5-1ec814ba5c52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4a286bb6e8347478248b1224ff3240e'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:42.925312 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-7d1d5641-f668-43dd-beb5-1ec814ba5c52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4a286bb6e8347478248b1224ff3240e'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:42.929898 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:42.932847 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-7d1d5641-f668-43dd-beb5-1ec814ba5c52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4a286bb6e8347478248b1224ff3240e'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:42.938642 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1139/2288] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:24:42 2022] DELETE /identity/v3/users/f4a286bb6e8347478248b1224ff3240e => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:42.944012 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5216f-9726-4e28-9205-83a50feb5726 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:42.944564 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5216f-9726-4e28-9205-83a50feb5726 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:42.944662 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5216f-9726-4e28-9205-83a50feb5726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:42.964619 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-62a5216f-9726-4e28-9205-83a50feb5726 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:42.965830 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-62a5216f-9726-4e28-9205-83a50feb5726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:43.041111 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1150/2289] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:43.051676 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d5641-f668-43dd-beb5-1ec814ba5c52 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:43.053225 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7d1d5641-f668-43dd-beb5-1ec814ba5c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:43.162422 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d5641-f668-43dd-beb5-1ec814ba5c52 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:43.167300 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a36f2-05bb-4096-92dc-5cc2d44dd1e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:43.168189 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a36f2-05bb-4096-92dc-5cc2d44dd1e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:43.168640 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a36f2-05bb-4096-92dc-5cc2d44dd1e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:43.169020 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534a36f2-05bb-4096-92dc-5cc2d44dd1e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:43.186567 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a36f2-05bb-4096-92dc-5cc2d44dd1e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:43.188130 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534a36f2-05bb-4096-92dc-5cc2d44dd1e1 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:43.203487 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1140/2290] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:24:43.868741 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5216f-9726-4e28-9205-83a50feb5726 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:43.875184 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-62a5216f-9726-4e28-9205-83a50feb5726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:43.891169 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5216f-9726-4e28-9205-83a50feb5726 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:43.900797 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fdfbb-d9ee-48e6-9dcf-043d71688280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:43.902058 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fdfbb-d9ee-48e6-9dcf-043d71688280 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:43.902634 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fdfbb-d9ee-48e6-9dcf-043d71688280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:43.903156 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fdfbb-d9ee-48e6-9dcf-043d71688280 admin admin] PATH_INFO: `/v3/projects/f36658b07848457aa23250a1bfa45120` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:43.905727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fdfbb-d9ee-48e6-9dcf-043d71688280 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f36658b07848457aa23250a1bfa45120)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:43.908366 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fdfbb-d9ee-48e6-9dcf-043d71688280 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:43.934254 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:44.043665 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a05fdfbb-d9ee-48e6-9dcf-043d71688280 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f36658b07848457aa23250a1bfa45120', 'request_id': 'req-a05fdfbb-d9ee-48e6-9dcf-043d71688280'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:44.050806 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a05fdfbb-d9ee-48e6-9dcf-043d71688280 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f36658b07848457aa23250a1bfa45120', 'request_id': 'req-a05fdfbb-d9ee-48e6-9dcf-043d71688280'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:44.058477 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a05fdfbb-d9ee-48e6-9dcf-043d71688280 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f36658b07848457aa23250a1bfa45120', 'request_id': 'req-a05fdfbb-d9ee-48e6-9dcf-043d71688280'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:44.192162 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a05fdfbb-d9ee-48e6-9dcf-043d71688280 admin admin] The token cache is being invalidate because project f36658b07848457aa23250a1bfa45120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:24:44.192488 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a05fdfbb-d9ee-48e6-9dcf-043d71688280 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:44.193336 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a05fdfbb-d9ee-48e6-9dcf-043d71688280 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:44.194892 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1151/2291] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:24:43 2022] DELETE /identity/v3/projects/f36658b07848457aa23250a1bfa45120 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:44.968185 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a36f2-05bb-4096-92dc-5cc2d44dd1e1 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:44.969697 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-534a36f2-05bb-4096-92dc-5cc2d44dd1e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:44.984208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534a36f2-05bb-4096-92dc-5cc2d44dd1e1 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:45.055937 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95f349-5a1e-451e-893c-952cdabb4683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:45.056693 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95f349-5a1e-451e-893c-952cdabb4683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:45.056986 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95f349-5a1e-451e-893c-952cdabb4683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:45.057474 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95f349-5a1e-451e-893c-952cdabb4683 admin admin] PATH_INFO: `/v3/users/e445ca826c5b478fbdfba80ce8266c73` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:45.058617 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95f349-5a1e-451e-893c-952cdabb4683 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e445ca826c5b478fbdfba80ce8266c73)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:45.060721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95f349-5a1e-451e-893c-952cdabb4683 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:45.349553 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-3f95f349-5a1e-451e-893c-952cdabb4683 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e445ca826c5b478fbdfba80ce8266c73'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:45.409411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-3f95f349-5a1e-451e-893c-952cdabb4683 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e445ca826c5b478fbdfba80ce8266c73'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:45.428232 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-3f95f349-5a1e-451e-893c-952cdabb4683 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e445ca826c5b478fbdfba80ce8266c73'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:45.428961 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-3f95f349-5a1e-451e-893c-952cdabb4683 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e445ca826c5b478fbdfba80ce8266c73'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:45.439552 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-3f95f349-5a1e-451e-893c-952cdabb4683 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e445ca826c5b478fbdfba80ce8266c73'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:45.460082 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1141/2292] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:24:44 2022] DELETE /identity/v3/users/e445ca826c5b478fbdfba80ce8266c73 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:45.460619 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57565ba8-2c4a-407c-a1b2-0f0f7262b6dd None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:45.461927 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57565ba8-2c4a-407c-a1b2-0f0f7262b6dd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:45.462431 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57565ba8-2c4a-407c-a1b2-0f0f7262b6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:45.486175 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-57565ba8-2c4a-407c-a1b2-0f0f7262b6dd None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:45.487680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-57565ba8-2c4a-407c-a1b2-0f0f7262b6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:45.555637 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1152/2293] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:45.565550 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95f349-5a1e-451e-893c-952cdabb4683 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:45.567345 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-3f95f349-5a1e-451e-893c-952cdabb4683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:45.589947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:45.641985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95f349-5a1e-451e-893c-952cdabb4683 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:45.646195 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d826b2d-213f-40dd-95c4-ee4f6f86d4c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:45.646814 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d826b2d-213f-40dd-95c4-ee4f6f86d4c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:45.647098 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d826b2d-213f-40dd-95c4-ee4f6f86d4c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:45.647395 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d826b2d-213f-40dd-95c4-ee4f6f86d4c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:45.656772 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d826b2d-213f-40dd-95c4-ee4f6f86d4c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:45.658221 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d826b2d-213f-40dd-95c4-ee4f6f86d4c9 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:45.668065 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1142/2294] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:24:46.238422 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57565ba8-2c4a-407c-a1b2-0f0f7262b6dd None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:46.243217 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-57565ba8-2c4a-407c-a1b2-0f0f7262b6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:46.302127 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57565ba8-2c4a-407c-a1b2-0f0f7262b6dd None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:46.318195 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c6d95-b371-41ab-ab74-3167c38211a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:46.319024 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c6d95-b371-41ab-ab74-3167c38211a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:46.319541 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c6d95-b371-41ab-ab74-3167c38211a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:46.320065 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c6d95-b371-41ab-ab74-3167c38211a2 admin admin] PATH_INFO: `/v3/projects/a3b8e906ee1448b4a3a75bff3bae44bc` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:46.326009 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c6d95-b371-41ab-ab74-3167c38211a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3b8e906ee1448b4a3a75bff3bae44bc)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:46.326009 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c6d95-b371-41ab-ab74-3167c38211a2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:46.439463 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-047c6d95-b371-41ab-ab74-3167c38211a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3b8e906ee1448b4a3a75bff3bae44bc', 'request_id': 'req-047c6d95-b371-41ab-ab74-3167c38211a2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:46.446007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-047c6d95-b371-41ab-ab74-3167c38211a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3b8e906ee1448b4a3a75bff3bae44bc', 'request_id': 'req-047c6d95-b371-41ab-ab74-3167c38211a2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:46.453287 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-047c6d95-b371-41ab-ab74-3167c38211a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3b8e906ee1448b4a3a75bff3bae44bc', 'request_id': 'req-047c6d95-b371-41ab-ab74-3167c38211a2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:46.569808 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-047c6d95-b371-41ab-ab74-3167c38211a2 admin admin] The token cache is being invalidate because project a3b8e906ee1448b4a3a75bff3bae44bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:24:46.570758 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-047c6d95-b371-41ab-ab74-3167c38211a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:46.571666 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-047c6d95-b371-41ab-ab74-3167c38211a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:46.573389 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1153/2295] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:24:46 2022] DELETE /identity/v3/projects/a3b8e906ee1448b4a3a75bff3bae44bc => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:46.577366 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d826b2d-213f-40dd-95c4-ee4f6f86d4c9 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:46.587197 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d826b2d-213f-40dd-95c4-ee4f6f86d4c9 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:46.661428 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d0e8d-07eb-4680-b8b5-565910492db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:46.662092 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d0e8d-07eb-4680-b8b5-565910492db8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:46.662368 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d0e8d-07eb-4680-b8b5-565910492db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:46.662643 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d0e8d-07eb-4680-b8b5-565910492db8 admin admin] PATH_INFO: `/v3/users/dbe58a1cef7d459dba9cb0920b19b8a4` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:46.663850 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d0e8d-07eb-4680-b8b5-565910492db8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbe58a1cef7d459dba9cb0920b19b8a4)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:46.665804 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d0e8d-07eb-4680-b8b5-565910492db8 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:46.670940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a7ded-6eef-432d-8151-600f9e27c8a4 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:46.671264 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a7ded-6eef-432d-8151-600f9e27c8a4 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:46.671551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6a7ded-6eef-432d-8151-600f9e27c8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:46.694138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ab6a7ded-6eef-432d-8151-600f9e27c8a4 None None] MFA Rules not processed for user `0ba7376671a24d35a920e0ec3290472b`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:46.695430 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ab6a7ded-6eef-432d-8151-600f9e27c8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:46.715642 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:46.751833 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1154/2296] 10.222.0.81 () {58 vars in 1009 bytes} [Tue Sep 6 21:24:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:24:46.806929 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a7ded-6eef-432d-8151-600f9e27c8a4 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:46.806929 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ab6a7ded-6eef-432d-8151-600f9e27c8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:46.871985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6d6d0e8d-07eb-4680-b8b5-565910492db8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbe58a1cef7d459dba9cb0920b19b8a4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:46.881985 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6a7ded-6eef-432d-8151-600f9e27c8a4 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:46.887025 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e8785-168d-4f61-a036-7bfece350cfb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0aac45d8b549afafae0a3f623bce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:46.887661 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e8785-168d-4f61-a036-7bfece350cfb service swift] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:46.887917 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e8785-168d-4f61-a036-7bfece350cfb service swift] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:46.888221 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343e8785-168d-4f61-a036-7bfece350cfb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:46.896758 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e8785-168d-4f61-a036-7bfece350cfb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:46.898587 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343e8785-168d-4f61-a036-7bfece350cfb service swift] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:46.906895 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1155/2297] 10.222.0.81 () {60 vars in 1384 bytes} [Tue Sep 6 21:24:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 21:24:46.975091 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6d6d0e8d-07eb-4680-b8b5-565910492db8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbe58a1cef7d459dba9cb0920b19b8a4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:46.988938 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6d6d0e8d-07eb-4680-b8b5-565910492db8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbe58a1cef7d459dba9cb0920b19b8a4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:46.989615 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6d6d0e8d-07eb-4680-b8b5-565910492db8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbe58a1cef7d459dba9cb0920b19b8a4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:46.997063 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-6d6d0e8d-07eb-4680-b8b5-565910492db8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbe58a1cef7d459dba9cb0920b19b8a4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:47.005481 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1143/2298] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:24:46 2022] DELETE /identity/v3/users/dbe58a1cef7d459dba9cb0920b19b8a4 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:47.805011 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e8785-168d-4f61-a036-7bfece350cfb service swift] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:47.806611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-343e8785-168d-4f61-a036-7bfece350cfb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:47.831302 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343e8785-168d-4f61-a036-7bfece350cfb service swift] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:47.958615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d43a7a-600b-406a-82fc-297dbdb5316d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:47.959546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d43a7a-600b-406a-82fc-297dbdb5316d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:47.959922 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d43a7a-600b-406a-82fc-297dbdb5316d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:47.960360 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d43a7a-600b-406a-82fc-297dbdb5316d admin admin] PATH_INFO: `/v3/projects/a053ff4fe61a4d07ae0fc1288509aa26` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:47.961703 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d43a7a-600b-406a-82fc-297dbdb5316d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a053ff4fe61a4d07ae0fc1288509aa26)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:47.964428 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d43a7a-600b-406a-82fc-297dbdb5316d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:48.020553 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f76d0-6fa8-46c4-936b-ef9b3d1ef575 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:48.021145 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f76d0-6fa8-46c4-936b-ef9b3d1ef575 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:48.021248 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f76d0-6fa8-46c4-936b-ef9b3d1ef575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:48.050511 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-439f76d0-6fa8-46c4-936b-ef9b3d1ef575 None None] MFA Rules not processed for user `0ba7376671a24d35a920e0ec3290472b`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:48.054979 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-439f76d0-6fa8-46c4-936b-ef9b3d1ef575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:48.098399 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:48.099498 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d8d43a7a-600b-406a-82fc-297dbdb5316d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a053ff4fe61a4d07ae0fc1288509aa26', 'request_id': 'req-d8d43a7a-600b-406a-82fc-297dbdb5316d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:48.107295 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d8d43a7a-600b-406a-82fc-297dbdb5316d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a053ff4fe61a4d07ae0fc1288509aa26', 'request_id': 'req-d8d43a7a-600b-406a-82fc-297dbdb5316d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:48.118493 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d8d43a7a-600b-406a-82fc-297dbdb5316d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a053ff4fe61a4d07ae0fc1288509aa26', 'request_id': 'req-d8d43a7a-600b-406a-82fc-297dbdb5316d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:48.164180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1144/2299] 10.222.0.81 () {58 vars in 967 bytes} [Tue Sep 6 21:24:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:24:48.176651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:48.179035 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f76d0-6fa8-46c4-936b-ef9b3d1ef575 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:48.181952 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-439f76d0-6fa8-46c4-936b-ef9b3d1ef575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:48.228905 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d8d43a7a-600b-406a-82fc-297dbdb5316d admin admin] The token cache is being invalidate because project a053ff4fe61a4d07ae0fc1288509aa26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:24:48.229111 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d8d43a7a-600b-406a-82fc-297dbdb5316d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:48.229842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d8d43a7a-600b-406a-82fc-297dbdb5316d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:48.234849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1156/2300] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:24:47 2022] DELETE /identity/v3/projects/a053ff4fe61a4d07ae0fc1288509aa26 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:48.236526 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293f282-21b5-444e-90d1-d4f356704e6a None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:48.237322 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293f282-21b5-444e-90d1-d4f356704e6a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:48.237600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8293f282-21b5-444e-90d1-d4f356704e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:48.275978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8293f282-21b5-444e-90d1-d4f356704e6a None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:48.277306 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8293f282-21b5-444e-90d1-d4f356704e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:48.287206 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439f76d0-6fa8-46c4-936b-ef9b3d1ef575 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:48.350821 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1157/2301] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:48.359949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d60e0-0430-40cd-947c-648044f9cd4a None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:48.360469 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d60e0-0430-40cd-947c-648044f9cd4a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:48.360743 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3d60e0-0430-40cd-947c-648044f9cd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:48.385071 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-0e3d60e0-0430-40cd-947c-648044f9cd4a None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:48.386365 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0e3d60e0-0430-40cd-947c-648044f9cd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:48.396916 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1158/2302] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:24:48.411866 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d60e0-0430-40cd-947c-648044f9cd4a None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:48.428844 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a102b-b06d-4c62-891d-ff37fa06fb1e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0aac45d8b549afafae0a3f623bce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:48.429484 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a102b-b06d-4c62-891d-ff37fa06fb1e service swift] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:48.429771 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a102b-b06d-4c62-891d-ff37fa06fb1e service swift] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:48.430057 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a102b-b06d-4c62-891d-ff37fa06fb1e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:48.433434 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3d60e0-0430-40cd-947c-648044f9cd4a None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:48.437628 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-201a102b-b06d-4c62-891d-ff37fa06fb1e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:48.447521 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc6823-5a3b-4a49-8755-22d83c6564c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:48.448303 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc6823-5a3b-4a49-8755-22d83c6564c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:48.448660 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc6823-5a3b-4a49-8755-22d83c6564c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:48.449159 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc6823-5a3b-4a49-8755-22d83c6564c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:48.450516 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc6823-5a3b-4a49-8755-22d83c6564c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:24:48.451077 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc6823-5a3b-4a49-8755-22d83c6564c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:48.460722 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc6823-5a3b-4a49-8755-22d83c6564c1 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:48.484275 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1159/2303] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:24:48.488572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc6823-5a3b-4a49-8755-22d83c6564c1 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:48.499366 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc6823-5a3b-4a49-8755-22d83c6564c1 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:48.506337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fc5d4-4832-48bb-9527-04982d21c51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:48.507138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fc5d4-4832-48bb-9527-04982d21c51b admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:48.507448 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fc5d4-4832-48bb-9527-04982d21c51b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:48.507844 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fc5d4-4832-48bb-9527-04982d21c51b admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:48.509035 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fc5d4-4832-48bb-9527-04982d21c51b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:48.513396 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fc5d4-4832-48bb-9527-04982d21c51b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:48.561869 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a102b-b06d-4c62-891d-ff37fa06fb1e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:48.563495 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a102b-b06d-4c62-891d-ff37fa06fb1e service swift] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:48.572965 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1145/2304] 10.222.0.81 () {60 vars in 1384 bytes} [Tue Sep 6 21:24:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 21:24:48.611999 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1160/2305] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:24:48 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:24:48.612916 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a102b-b06d-4c62-891d-ff37fa06fb1e service swift] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:48.630004 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a102b-b06d-4c62-891d-ff37fa06fb1e service swift] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:48.639953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97da509-be1b-4240-b3b2-3b53afbd848e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:48.640447 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97da509-be1b-4240-b3b2-3b53afbd848e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:48.640794 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97da509-be1b-4240-b3b2-3b53afbd848e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:48.663372 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a97da509-be1b-4240-b3b2-3b53afbd848e None None] MFA Rules not processed for user `f3fabba09a4746328dcee545ff38cf78`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:48.664724 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a97da509-be1b-4240-b3b2-3b53afbd848e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:48.696482 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9f968-c8c8-45bb-9229-35d7e2cd03fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:48.697196 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9f968-c8c8-45bb-9229-35d7e2cd03fe admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:48.697673 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9f968-c8c8-45bb-9229-35d7e2cd03fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:48.698228 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b9f968-c8c8-45bb-9229-35d7e2cd03fe admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:48.698586 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9f968-c8c8-45bb-9229-35d7e2cd03fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:48.700775 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b9f968-c8c8-45bb-9229-35d7e2cd03fe admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:48.737648 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1161/2306] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:24:48.843921 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1146/2307] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:24:48 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:24:48.849188 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97da509-be1b-4240-b3b2-3b53afbd848e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:48.861005 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97da509-be1b-4240-b3b2-3b53afbd848e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:48.865722 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561117df-7007-4c1c-844a-e742ac3a77f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:48.868413 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561117df-7007-4c1c-844a-e742ac3a77f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:48.868413 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561117df-7007-4c1c-844a-e742ac3a77f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:48.868413 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561117df-7007-4c1c-844a-e742ac3a77f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:48.868413 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561117df-7007-4c1c-844a-e742ac3a77f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:48.869567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561117df-7007-4c1c-844a-e742ac3a77f1 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:48.879279 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1162/2308] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:48.883348 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9f968-c8c8-45bb-9229-35d7e2cd03fe admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:48.893735 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b9f968-c8c8-45bb-9229-35d7e2cd03fe admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:48.898403 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c3591-b63c-491a-aea8-7039f06a76db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:48.899011 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c3591-b63c-491a-aea8-7039f06a76db admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:48.899289 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c3591-b63c-491a-aea8-7039f06a76db admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:48.899562 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c3591-b63c-491a-aea8-7039f06a76db admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:48.900286 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c3591-b63c-491a-aea8-7039f06a76db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:48.901902 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c3591-b63c-491a-aea8-7039f06a76db admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:48.912787 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1147/2309] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:48.917892 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561117df-7007-4c1c-844a-e742ac3a77f1 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:48.929682 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561117df-7007-4c1c-844a-e742ac3a77f1 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:48.934663 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03758e-535b-4d29-bc4c-097b210e2715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:48.935339 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03758e-535b-4d29-bc4c-097b210e2715 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:48.935625 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03758e-535b-4d29-bc4c-097b210e2715 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:48.935903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e03758e-535b-4d29-bc4c-097b210e2715 admin admin] PATH_INFO: `/v3/projects/4a171a1512924f29a68df5e198599490/users/9a136ef365fb4344bb532a03be78f009/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:48.955177 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e03758e-535b-4d29-bc4c-097b210e2715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a171a1512924f29a68df5e198599490, user_id=9a136ef365fb4344bb532a03be78f009, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:48.958482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e03758e-535b-4d29-bc4c-097b210e2715 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:49.054664 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1163/2310] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:24:48 2022] PUT /identity/v3/projects/4a171a1512924f29a68df5e198599490/users/9a136ef365fb4344bb532a03be78f009/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:49.074811 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5add586-f775-4f01-ae10-fdef04768b2e None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:49.075474 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5add586-f775-4f01-ae10-fdef04768b2e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:49.075721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5add586-f775-4f01-ae10-fdef04768b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:49.106503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c5add586-f775-4f01-ae10-fdef04768b2e None None] MFA Rules not processed for user `9a136ef365fb4344bb532a03be78f009`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:49.107741 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c5add586-f775-4f01-ae10-fdef04768b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:49.172958 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1148/2311] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:24:49.184642 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03758e-535b-4d29-bc4c-097b210e2715 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:49.186402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9e03758e-535b-4d29-bc4c-097b210e2715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:49.209358 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:49.222328 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:49.286986 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e03758e-535b-4d29-bc4c-097b210e2715 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:49.290753 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc2368-49b9-4f24-81b1-af7a43c2d004 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:49.291378 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc2368-49b9-4f24-81b1-af7a43c2d004 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:49.291662 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc2368-49b9-4f24-81b1-af7a43c2d004 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:49.291939 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc2368-49b9-4f24-81b1-af7a43c2d004 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:49.306957 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc2368-49b9-4f24-81b1-af7a43c2d004 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:49.313007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc2368-49b9-4f24-81b1-af7a43c2d004 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:49.319019 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1164/2312] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:24:49.376932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573fa9a-d48c-45f1-9f12-7e3e9d2a152d None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:49.377491 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573fa9a-d48c-45f1-9f12-7e3e9d2a152d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:49.378068 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573fa9a-d48c-45f1-9f12-7e3e9d2a152d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:49.397485 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-1573fa9a-d48c-45f1-9f12-7e3e9d2a152d None None] MFA Rules not processed for user `0ba7376671a24d35a920e0ec3290472b`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:49.398948 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1573fa9a-d48c-45f1-9f12-7e3e9d2a152d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:49.473357 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1149/2313] 10.222.0.81 () {58 vars in 1009 bytes} [Tue Sep 6 21:24:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:49.495002 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc2368-49b9-4f24-81b1-af7a43c2d004 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:49.496517 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e4cc2368-49b9-4f24-81b1-af7a43c2d004 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:49.593319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc2368-49b9-4f24-81b1-af7a43c2d004 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:49.607962 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3262b95-0c5f-4cdd-9772-82e7dff17a3a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0aac45d8b549afafae0a3f623bce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:49.609289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3262b95-0c5f-4cdd-9772-82e7dff17a3a service swift] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:49.609708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3262b95-0c5f-4cdd-9772-82e7dff17a3a service swift] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:49.610001 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3262b95-0c5f-4cdd-9772-82e7dff17a3a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:49.633810 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3262b95-0c5f-4cdd-9772-82e7dff17a3a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:49.635529 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3262b95-0c5f-4cdd-9772-82e7dff17a3a service swift] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:49.652591 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1165/2314] 10.222.0.81 () {60 vars in 1384 bytes} [Tue Sep 6 21:24:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 21:24:50.419203 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8976b96-5b90-4909-ba86-8d9d5eca7a20 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:50.419972 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8976b96-5b90-4909-ba86-8d9d5eca7a20 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:50.420078 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8976b96-5b90-4909-ba86-8d9d5eca7a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:50.443285 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-d8976b96-5b90-4909-ba86-8d9d5eca7a20 None None] MFA Rules not processed for user `0ba7376671a24d35a920e0ec3290472b`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:50.444579 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d8976b96-5b90-4909-ba86-8d9d5eca7a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:50.456335 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1150/2315] 10.222.0.81 () {58 vars in 967 bytes} [Tue Sep 6 21:24:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:24:50.467238 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3262b95-0c5f-4cdd-9772-82e7dff17a3a service swift] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:50.481994 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3262b95-0c5f-4cdd-9772-82e7dff17a3a service swift] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:50.501995 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b3575-0edc-4589-b3f6-2e81abe42b5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0aac45d8b549afafae0a3f623bce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:50.503410 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b3575-0edc-4589-b3f6-2e81abe42b5a service swift] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:50.503693 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b3575-0edc-4589-b3f6-2e81abe42b5a service swift] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:50.503972 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5b3575-0edc-4589-b3f6-2e81abe42b5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:50.520577 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b3575-0edc-4589-b3f6-2e81abe42b5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:50.522829 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5b3575-0edc-4589-b3f6-2e81abe42b5a service swift] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:50.533618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1166/2316] 10.222.0.81 () {60 vars in 1384 bytes} [Tue Sep 6 21:24:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 21:24:50.648013 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654fd0b-73d4-40cf-8256-c3528fd3bc0e None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:50.648534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654fd0b-73d4-40cf-8256-c3528fd3bc0e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:50.648815 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654fd0b-73d4-40cf-8256-c3528fd3bc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:50.686808 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f654fd0b-73d4-40cf-8256-c3528fd3bc0e None None] MFA Rules not processed for user `0ba7376671a24d35a920e0ec3290472b`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:50.688283 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f654fd0b-73d4-40cf-8256-c3528fd3bc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:50.697199 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1151/2317] 10.222.0.81 () {58 vars in 1009 bytes} [Tue Sep 6 21:24:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:50.711919 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b3575-0edc-4589-b3f6-2e81abe42b5a service swift] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:50.723434 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5b3575-0edc-4589-b3f6-2e81abe42b5a service swift] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:50.728586 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945872d7-1616-4ace-880f-7098a7f53abf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0aac45d8b549afafae0a3f623bce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:50.729252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945872d7-1616-4ace-880f-7098a7f53abf service swift] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:50.738202 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945872d7-1616-4ace-880f-7098a7f53abf service swift] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:50.738202 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945872d7-1616-4ace-880f-7098a7f53abf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:50.739221 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945872d7-1616-4ace-880f-7098a7f53abf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:50.741691 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945872d7-1616-4ace-880f-7098a7f53abf service swift] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:50.750384 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1167/2318] 10.222.0.81 () {60 vars in 1384 bytes} [Tue Sep 6 21:24:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 21:24:53.728272 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654fd0b-73d4-40cf-8256-c3528fd3bc0e None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:53.729792 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f654fd0b-73d4-40cf-8256-c3528fd3bc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:53.774253 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:53.822195 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654fd0b-73d4-40cf-8256-c3528fd3bc0e None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:53.830204 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b480a-9690-4575-9fb9-cc3215c6a6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:53.831686 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b480a-9690-4575-9fb9-cc3215c6a6bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:53.832890 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b480a-9690-4575-9fb9-cc3215c6a6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:53.833169 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b480a-9690-4575-9fb9-cc3215c6a6bc admin admin] PATH_INFO: `/v3/users/22753b48e1084577bbaa4d1135f02090` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:53.834552 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b480a-9690-4575-9fb9-cc3215c6a6bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=22753b48e1084577bbaa4d1135f02090)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:53.836784 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b480a-9690-4575-9fb9-cc3215c6a6bc admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:54.063245 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-bf4b480a-9690-4575-9fb9-cc3215c6a6bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22753b48e1084577bbaa4d1135f02090'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:54.128135 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-bf4b480a-9690-4575-9fb9-cc3215c6a6bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22753b48e1084577bbaa4d1135f02090'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:54.155373 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-bf4b480a-9690-4575-9fb9-cc3215c6a6bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22753b48e1084577bbaa4d1135f02090'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:54.156517 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-bf4b480a-9690-4575-9fb9-cc3215c6a6bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22753b48e1084577bbaa4d1135f02090'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:54.186699 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-bf4b480a-9690-4575-9fb9-cc3215c6a6bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22753b48e1084577bbaa4d1135f02090'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:54.187372 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945872d7-1616-4ace-880f-7098a7f53abf service swift] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:54.190167 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-945872d7-1616-4ace-880f-7098a7f53abf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:54.194726 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1152/2319] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:24:53 2022] DELETE /identity/v3/users/22753b48e1084577bbaa4d1135f02090 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:54.201681 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76573ae-3103-4358-9ad1-61af386981ce None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:54.202562 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76573ae-3103-4358-9ad1-61af386981ce None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:54.203017 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76573ae-3103-4358-9ad1-61af386981ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:54.213770 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945872d7-1616-4ace-880f-7098a7f53abf service swift] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:54.236301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c76573ae-3103-4358-9ad1-61af386981ce None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:54.238810 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c76573ae-3103-4358-9ad1-61af386981ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:54.328058 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1153/2320] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:54.335586 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76573ae-3103-4358-9ad1-61af386981ce None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:54.337132 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c76573ae-3103-4358-9ad1-61af386981ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:54.369841 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d819c1-31e0-4fb5-bd46-7e00cf837467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:54.371248 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d819c1-31e0-4fb5-bd46-7e00cf837467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:54.371248 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d819c1-31e0-4fb5-bd46-7e00cf837467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:54.371658 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d819c1-31e0-4fb5-bd46-7e00cf837467 admin admin] PATH_INFO: `/v3/users/7e90da0230e649ff9f36f057c251a553` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:54.375932 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d819c1-31e0-4fb5-bd46-7e00cf837467 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e90da0230e649ff9f36f057c251a553)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:54.398850 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d819c1-31e0-4fb5-bd46-7e00cf837467 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:54.466947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:54.472280 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76573ae-3103-4358-9ad1-61af386981ce None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:54.478127 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7b965-4df2-4dfd-afab-da53f654be7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:54.478753 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7b965-4df2-4dfd-afab-da53f654be7e service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:54.479034 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7b965-4df2-4dfd-afab-da53f654be7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:54.479384 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7b965-4df2-4dfd-afab-da53f654be7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:54.511099 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7b965-4df2-4dfd-afab-da53f654be7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:54.514992 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7b965-4df2-4dfd-afab-da53f654be7e service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:54.558067 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1154/2321] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:24:54.594160 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:54.778905 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-67d819c1-31e0-4fb5-bd46-7e00cf837467 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e90da0230e649ff9f36f057c251a553'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:54.893807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-67d819c1-31e0-4fb5-bd46-7e00cf837467 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e90da0230e649ff9f36f057c251a553'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:54.955811 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-67d819c1-31e0-4fb5-bd46-7e00cf837467 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e90da0230e649ff9f36f057c251a553'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:54.958393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-67d819c1-31e0-4fb5-bd46-7e00cf837467 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e90da0230e649ff9f36f057c251a553'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:54.970087 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-67d819c1-31e0-4fb5-bd46-7e00cf837467 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e90da0230e649ff9f36f057c251a553'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:54.978072 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1168/2322] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:24:54 2022] DELETE /identity/v3/users/7e90da0230e649ff9f36f057c251a553 => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:24:54.982184 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73484c0-e458-4bc7-9d44-017217a1277e None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:54.982702 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73484c0-e458-4bc7-9d44-017217a1277e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:54.982805 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73484c0-e458-4bc7-9d44-017217a1277e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:55.018127 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-d73484c0-e458-4bc7-9d44-017217a1277e None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:55.019978 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d73484c0-e458-4bc7-9d44-017217a1277e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:55.128156 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1155/2323] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:55.137030 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d819c1-31e0-4fb5-bd46-7e00cf837467 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:55.138853 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-67d819c1-31e0-4fb5-bd46-7e00cf837467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:55.245129 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d819c1-31e0-4fb5-bd46-7e00cf837467 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:55.251437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60262db1-b49e-4800-9c60-59fbfee9845a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:55.251437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60262db1-b49e-4800-9c60-59fbfee9845a service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:55.251437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60262db1-b49e-4800-9c60-59fbfee9845a service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:55.252022 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60262db1-b49e-4800-9c60-59fbfee9845a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:55.264968 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60262db1-b49e-4800-9c60-59fbfee9845a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:55.266833 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60262db1-b49e-4800-9c60-59fbfee9845a service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:55.285797 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73484c0-e458-4bc7-9d44-017217a1277e None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:55.290341 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d73484c0-e458-4bc7-9d44-017217a1277e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:55.306207 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1169/2324] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:24:55.316806 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73484c0-e458-4bc7-9d44-017217a1277e None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:55.332969 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dad459-7eaf-4da7-a1d2-efe56dab2918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:55.334170 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dad459-7eaf-4da7-a1d2-efe56dab2918 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:55.334958 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dad459-7eaf-4da7-a1d2-efe56dab2918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:55.335704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dad459-7eaf-4da7-a1d2-efe56dab2918 admin admin] PATH_INFO: `/v3/projects/3b51f424b7bf4a7280ae94a6b25406ca` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:55.337702 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dad459-7eaf-4da7-a1d2-efe56dab2918 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b51f424b7bf4a7280ae94a6b25406ca)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:55.339734 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dad459-7eaf-4da7-a1d2-efe56dab2918 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:55.496280 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-11dad459-7eaf-4da7-a1d2-efe56dab2918 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b51f424b7bf4a7280ae94a6b25406ca', 'request_id': 'req-11dad459-7eaf-4da7-a1d2-efe56dab2918'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:55.933781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-11dad459-7eaf-4da7-a1d2-efe56dab2918 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b51f424b7bf4a7280ae94a6b25406ca', 'request_id': 'req-11dad459-7eaf-4da7-a1d2-efe56dab2918'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:55.940201 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-11dad459-7eaf-4da7-a1d2-efe56dab2918 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b51f424b7bf4a7280ae94a6b25406ca', 'request_id': 'req-11dad459-7eaf-4da7-a1d2-efe56dab2918'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:55.952712 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-11dad459-7eaf-4da7-a1d2-efe56dab2918 admin admin] The token cache is being invalidate because project 3b51f424b7bf4a7280ae94a6b25406ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:24:55.953003 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-11dad459-7eaf-4da7-a1d2-efe56dab2918 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:55.953799 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-11dad459-7eaf-4da7-a1d2-efe56dab2918 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:55.957642 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1156/2325] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:24:55 2022] DELETE /identity/v3/projects/3b51f424b7bf4a7280ae94a6b25406ca => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:55.962905 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b48f33-047e-4777-b943-02e10b65bb7c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:55.963185 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b48f33-047e-4777-b943-02e10b65bb7c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:55.963465 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b48f33-047e-4777-b943-02e10b65bb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:56.045047 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f6b48f33-047e-4777-b943-02e10b65bb7c None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:56.046724 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f6b48f33-047e-4777-b943-02e10b65bb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:56.052009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dad459-7eaf-4da7-a1d2-efe56dab2918 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:56.054840 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-11dad459-7eaf-4da7-a1d2-efe56dab2918 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:56.211813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dad459-7eaf-4da7-a1d2-efe56dab2918 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:56.213461 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1170/2326] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:56.218775 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44016e9b-fbd3-4e73-a528-b8bd3367cdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:56.226288 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44016e9b-fbd3-4e73-a528-b8bd3367cdce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:56.226288 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44016e9b-fbd3-4e73-a528-b8bd3367cdce admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:56.226288 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44016e9b-fbd3-4e73-a528-b8bd3367cdce admin admin] PATH_INFO: `/v3/projects/ffcce2fc82cd408098314577d292de54` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:56.226288 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44016e9b-fbd3-4e73-a528-b8bd3367cdce admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffcce2fc82cd408098314577d292de54)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:56.226668 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960c8df-c0eb-4d59-9b68-e08646ef78c5 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:56.226668 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960c8df-c0eb-4d59-9b68-e08646ef78c5 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:56.226668 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960c8df-c0eb-4d59-9b68-e08646ef78c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:56.226895 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44016e9b-fbd3-4e73-a528-b8bd3367cdce admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:56.261806 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-b960c8df-c0eb-4d59-9b68-e08646ef78c5 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:56.264392 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b960c8df-c0eb-4d59-9b68-e08646ef78c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:56.281257 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:56.301343 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1171/2327] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:24:56.305831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960c8df-c0eb-4d59-9b68-e08646ef78c5 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:56.317865 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b960c8df-c0eb-4d59-9b68-e08646ef78c5 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:56.327665 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddff54-5c3d-4894-ae96-5f4471a943f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:56.328455 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddff54-5c3d-4894-ae96-5f4471a943f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:56.328812 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddff54-5c3d-4894-ae96-5f4471a943f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:56.329152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddff54-5c3d-4894-ae96-5f4471a943f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:56.329986 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddff54-5c3d-4894-ae96-5f4471a943f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:24:56.330990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddff54-5c3d-4894-ae96-5f4471a943f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:56.334070 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ddff54-5c3d-4894-ae96-5f4471a943f9 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:56.355858 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1172/2328] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:24:56.357390 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddff54-5c3d-4894-ae96-5f4471a943f9 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:56.391239 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddff54-5c3d-4894-ae96-5f4471a943f9 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:56.399583 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a86ee5-afb5-447e-9617-4465fe7fd414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:56.400271 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a86ee5-afb5-447e-9617-4465fe7fd414 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:56.400567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a86ee5-afb5-447e-9617-4465fe7fd414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:56.400842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a86ee5-afb5-447e-9617-4465fe7fd414 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:56.401494 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a86ee5-afb5-447e-9617-4465fe7fd414 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:56.404349 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a86ee5-afb5-447e-9617-4465fe7fd414 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:56.448927 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-44016e9b-fbd3-4e73-a528-b8bd3367cdce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffcce2fc82cd408098314577d292de54', 'request_id': 'req-44016e9b-fbd3-4e73-a528-b8bd3367cdce'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:56.547213 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-44016e9b-fbd3-4e73-a528-b8bd3367cdce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffcce2fc82cd408098314577d292de54', 'request_id': 'req-44016e9b-fbd3-4e73-a528-b8bd3367cdce'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:56.557574 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-44016e9b-fbd3-4e73-a528-b8bd3367cdce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffcce2fc82cd408098314577d292de54', 'request_id': 'req-44016e9b-fbd3-4e73-a528-b8bd3367cdce'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:56.564462 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1173/2329] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:24:56 2022] POST /identity/v3/projects => generated 381 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:24:56.568733 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a86ee5-afb5-447e-9617-4465fe7fd414 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:56.584152 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-44016e9b-fbd3-4e73-a528-b8bd3367cdce admin admin] The token cache is being invalidate because project ffcce2fc82cd408098314577d292de54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:24:56.584152 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-44016e9b-fbd3-4e73-a528-b8bd3367cdce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:56.588917 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-44016e9b-fbd3-4e73-a528-b8bd3367cdce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:56.588917 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1157/2330] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:24:56 2022] DELETE /identity/v3/projects/ffcce2fc82cd408098314577d292de54 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:24:56.592741 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:56.688477 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a86ee5-afb5-447e-9617-4465fe7fd414 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:56.703058 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d58dd7-7f1d-404b-a234-ae4bdbd24c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:56.703709 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d58dd7-7f1d-404b-a234-ae4bdbd24c8b admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:56.704534 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d58dd7-7f1d-404b-a234-ae4bdbd24c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:56.704913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d58dd7-7f1d-404b-a234-ae4bdbd24c8b admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:56.706344 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d58dd7-7f1d-404b-a234-ae4bdbd24c8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:56.709953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d58dd7-7f1d-404b-a234-ae4bdbd24c8b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:56.803437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1174/2331] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:24:56 2022] POST /identity/v3/users => generated 291 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:24:56.807548 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44016e9b-fbd3-4e73-a528-b8bd3367cdce admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:56.809741 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-44016e9b-fbd3-4e73-a528-b8bd3367cdce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:56.939581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44016e9b-fbd3-4e73-a528-b8bd3367cdce admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:56.951342 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a439bb3-c791-4841-8624-f6f708a43879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:56.954323 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a439bb3-c791-4841-8624-f6f708a43879 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:56.954323 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a439bb3-c791-4841-8624-f6f708a43879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:56.954323 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a439bb3-c791-4841-8624-f6f708a43879 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:56.956472 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a439bb3-c791-4841-8624-f6f708a43879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:56.959170 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a439bb3-c791-4841-8624-f6f708a43879 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:56.972629 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1158/2332] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:24:56.976693 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d58dd7-7f1d-404b-a234-ae4bdbd24c8b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:56.993360 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d58dd7-7f1d-404b-a234-ae4bdbd24c8b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:56.998798 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90264425-daf7-439a-b9ba-d91710a70084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:56.999692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90264425-daf7-439a-b9ba-d91710a70084 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:56.999981 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90264425-daf7-439a-b9ba-d91710a70084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:57.000310 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90264425-daf7-439a-b9ba-d91710a70084 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:57.000986 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90264425-daf7-439a-b9ba-d91710a70084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:57.003460 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90264425-daf7-439a-b9ba-d91710a70084 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:57.020303 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1175/2333] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:24:57.023789 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a439bb3-c791-4841-8624-f6f708a43879 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:57.042108 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a439bb3-c791-4841-8624-f6f708a43879 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:57.050495 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14f4bc-e8b7-4f9a-a992-8d41176fdab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:57.051224 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14f4bc-e8b7-4f9a-a992-8d41176fdab0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:57.051534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14f4bc-e8b7-4f9a-a992-8d41176fdab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:57.052672 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f14f4bc-e8b7-4f9a-a992-8d41176fdab0 admin admin] PATH_INFO: `/v3/projects/eb083183cfa84507a77eb79c5a77e22a/users/10857cba2e9741d5ac0db85d1f52d083/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:57.080119 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14f4bc-e8b7-4f9a-a992-8d41176fdab0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb083183cfa84507a77eb79c5a77e22a, user_id=10857cba2e9741d5ac0db85d1f52d083, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:57.083390 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f14f4bc-e8b7-4f9a-a992-8d41176fdab0 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:57.168127 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1159/2334] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:24:57 2022] PUT /identity/v3/projects/eb083183cfa84507a77eb79c5a77e22a/users/10857cba2e9741d5ac0db85d1f52d083/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:24:57.172222 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d098d6-ab45-49fa-b397-5e3ad766ee7d None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:57.172606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d098d6-ab45-49fa-b397-5e3ad766ee7d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:57.173003 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d098d6-ab45-49fa-b397-5e3ad766ee7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:57.225444 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-97d098d6-ab45-49fa-b397-5e3ad766ee7d None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:57.227259 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-97d098d6-ab45-49fa-b397-5e3ad766ee7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:57.308173 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1176/2335] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:24:57.316411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14f4bc-e8b7-4f9a-a992-8d41176fdab0 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:57.318352 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7f14f4bc-e8b7-4f9a-a992-8d41176fdab0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:57.402608 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d098d6-ab45-49fa-b397-5e3ad766ee7d None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:57.406721 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-97d098d6-ab45-49fa-b397-5e3ad766ee7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:57.422694 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d098d6-ab45-49fa-b397-5e3ad766ee7d None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:57.423262 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f14f4bc-e8b7-4f9a-a992-8d41176fdab0 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:57.428210 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9722b46f-5a28-46b7-a3d7-a91df67f40c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:57.429264 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722b46f-5a28-46b7-a3d7-a91df67f40c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:57.436557 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722b46f-5a28-46b7-a3d7-a91df67f40c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:57.436557 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9722b46f-5a28-46b7-a3d7-a91df67f40c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:57.436778 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db9ccf-7672-4455-9159-eed9725205e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:57.436778 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db9ccf-7672-4455-9159-eed9725205e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:57.436778 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db9ccf-7672-4455-9159-eed9725205e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:57.436778 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db9ccf-7672-4455-9159-eed9725205e9 admin admin] PATH_INFO: `/v3/users/9a136ef365fb4344bb532a03be78f009` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:57.437087 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db9ccf-7672-4455-9159-eed9725205e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a136ef365fb4344bb532a03be78f009)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:57.437087 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0db9ccf-7672-4455-9159-eed9725205e9 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:57.446924 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722b46f-5a28-46b7-a3d7-a91df67f40c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:57.448817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9722b46f-5a28-46b7-a3d7-a91df67f40c6 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:57.461773 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1160/2336] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:24:57.695376 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f0db9ccf-7672-4455-9159-eed9725205e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a136ef365fb4344bb532a03be78f009'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:57.785766 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f0db9ccf-7672-4455-9159-eed9725205e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a136ef365fb4344bb532a03be78f009'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:57.805441 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f0db9ccf-7672-4455-9159-eed9725205e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a136ef365fb4344bb532a03be78f009'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:57.807095 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f0db9ccf-7672-4455-9159-eed9725205e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a136ef365fb4344bb532a03be78f009'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:57.819413 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f0db9ccf-7672-4455-9159-eed9725205e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a136ef365fb4344bb532a03be78f009'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:57.822096 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:57.828140 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1177/2337] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:24:57 2022] DELETE /identity/v3/users/9a136ef365fb4344bb532a03be78f009 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:24:57.841970 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a482221-8573-4b53-8ae9-308c29490685 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:57.845949 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a482221-8573-4b53-8ae9-308c29490685 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:57.846412 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a482221-8573-4b53-8ae9-308c29490685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:57.877162 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-0a482221-8573-4b53-8ae9-308c29490685 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:57.879539 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-0a482221-8573-4b53-8ae9-308c29490685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:57.916628 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:24:57.984040 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1161/2338] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:57.994635 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db9ccf-7672-4455-9159-eed9725205e9 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:57.996631 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f0db9ccf-7672-4455-9159-eed9725205e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:58.070102 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db9ccf-7672-4455-9159-eed9725205e9 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:58.073934 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b1fc0e-cd51-40dd-9f16-92080c38f669 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:58.074498 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1fc0e-cd51-40dd-9f16-92080c38f669 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:58.074781 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1fc0e-cd51-40dd-9f16-92080c38f669 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:58.075062 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b1fc0e-cd51-40dd-9f16-92080c38f669 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:58.098263 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b1fc0e-cd51-40dd-9f16-92080c38f669 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:58.102248 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b1fc0e-cd51-40dd-9f16-92080c38f669 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:58.114402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1178/2339] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:24:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:24:58.773878 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a482221-8573-4b53-8ae9-308c29490685 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:58.779175 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-0a482221-8573-4b53-8ae9-308c29490685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:58.832690 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a482221-8573-4b53-8ae9-308c29490685 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:58.835403 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7d7f1-ed7c-4122-89c4-2026b020cdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:58.836301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7d7f1-ed7c-4122-89c4-2026b020cdb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:58.836565 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7d7f1-ed7c-4122-89c4-2026b020cdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:58.837127 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7d7f1-ed7c-4122-89c4-2026b020cdb2 admin admin] PATH_INFO: `/v3/projects/4a171a1512924f29a68df5e198599490` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:58.838511 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7d7f1-ed7c-4122-89c4-2026b020cdb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a171a1512924f29a68df5e198599490)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:58.840906 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7d7f1-ed7c-4122-89c4-2026b020cdb2 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:59.012832 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-faa7d7f1-ed7c-4122-89c4-2026b020cdb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a171a1512924f29a68df5e198599490', 'request_id': 'req-faa7d7f1-ed7c-4122-89c4-2026b020cdb2'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:59.106650 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-faa7d7f1-ed7c-4122-89c4-2026b020cdb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a171a1512924f29a68df5e198599490', 'request_id': 'req-faa7d7f1-ed7c-4122-89c4-2026b020cdb2'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:59.114178 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-faa7d7f1-ed7c-4122-89c4-2026b020cdb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a171a1512924f29a68df5e198599490', 'request_id': 'req-faa7d7f1-ed7c-4122-89c4-2026b020cdb2'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:59.149184 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-faa7d7f1-ed7c-4122-89c4-2026b020cdb2 admin admin] The token cache is being invalidate because project 4a171a1512924f29a68df5e198599490 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:24:59.151684 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-faa7d7f1-ed7c-4122-89c4-2026b020cdb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:59.156643 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-faa7d7f1-ed7c-4122-89c4-2026b020cdb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:24:59.159887 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1162/2340] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:24:58 2022] DELETE /identity/v3/projects/4a171a1512924f29a68df5e198599490 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:24:59.164692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd51f61-af43-4860-8f1a-899cdd864aac None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:59.165717 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd51f61-af43-4860-8f1a-899cdd864aac None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:59.166224 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd51f61-af43-4860-8f1a-899cdd864aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:59.190340 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-dcd51f61-af43-4860-8f1a-899cdd864aac None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:59.201984 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-dcd51f61-af43-4860-8f1a-899cdd864aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:59.310432 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1179/2341] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:59.312533 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a6085-b2bd-4089-8c7e-1df7f08fbca2 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:59.312928 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a6085-b2bd-4089-8c7e-1df7f08fbca2 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:59.313312 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a6085-b2bd-4089-8c7e-1df7f08fbca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:59.340383 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-460a6085-b2bd-4089-8c7e-1df7f08fbca2 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:24:59.341839 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-460a6085-b2bd-4089-8c7e-1df7f08fbca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:24:59.356781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1163/2342] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:24:59.360986 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd51f61-af43-4860-8f1a-899cdd864aac None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:59.371533 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd51f61-af43-4860-8f1a-899cdd864aac None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:59.377081 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50abef71-df69-4622-b7f9-5be1ec9c1ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:59.377894 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abef71-df69-4622-b7f9-5be1ec9c1ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:59.378418 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abef71-df69-4622-b7f9-5be1ec9c1ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:59.378992 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abef71-df69-4622-b7f9-5be1ec9c1ea3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:59.379802 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50abef71-df69-4622-b7f9-5be1ec9c1ea3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:24:59.380389 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50abef71-df69-4622-b7f9-5be1ec9c1ea3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:59.382354 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50abef71-df69-4622-b7f9-5be1ec9c1ea3 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:59.403589 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1180/2343] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:24:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:24:59.411323 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a6085-b2bd-4089-8c7e-1df7f08fbca2 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:59.421726 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a6085-b2bd-4089-8c7e-1df7f08fbca2 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:59.427479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74babe2-cbe5-4a22-a893-8d31bffafdaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:59.428495 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74babe2-cbe5-4a22-a893-8d31bffafdaf admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:59.428921 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74babe2-cbe5-4a22-a893-8d31bffafdaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:59.429340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74babe2-cbe5-4a22-a893-8d31bffafdaf admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:59.444952 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74babe2-cbe5-4a22-a893-8d31bffafdaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:59.450285 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74babe2-cbe5-4a22-a893-8d31bffafdaf admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:59.653650 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1164/2344] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:24:59 2022] POST /identity/v3/projects => generated 375 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:24:59.658121 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50abef71-df69-4622-b7f9-5be1ec9c1ea3 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:59.672175 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50abef71-df69-4622-b7f9-5be1ec9c1ea3 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:59.762321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6adc14-dfa1-4de0-9955-16b0c93b9014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:59.765778 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6adc14-dfa1-4de0-9955-16b0c93b9014 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:59.765778 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6adc14-dfa1-4de0-9955-16b0c93b9014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:59.765778 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6adc14-dfa1-4de0-9955-16b0c93b9014 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:59.765778 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6adc14-dfa1-4de0-9955-16b0c93b9014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:59.766467 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6adc14-dfa1-4de0-9955-16b0c93b9014 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:59.862411 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1181/2345] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:24:59 2022] POST /identity/v3/users => generated 288 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:24:59.866548 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74babe2-cbe5-4a22-a893-8d31bffafdaf admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:59.883206 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74babe2-cbe5-4a22-a893-8d31bffafdaf admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:59.907313 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a8b20-7736-47ff-8acc-86717de7205b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:59.909559 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a8b20-7736-47ff-8acc-86717de7205b admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:59.910026 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a8b20-7736-47ff-8acc-86717de7205b admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:59.911402 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1a8b20-7736-47ff-8acc-86717de7205b admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:59.914816 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a8b20-7736-47ff-8acc-86717de7205b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:59.920337 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1a8b20-7736-47ff-8acc-86717de7205b admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:59.933581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1165/2346] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:24:59.937449 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6adc14-dfa1-4de0-9955-16b0c93b9014 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:24:59.951619 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6adc14-dfa1-4de0-9955-16b0c93b9014 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:24:59.959350 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe93384-d604-4989-a315-09b26878a5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:24:59.960005 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe93384-d604-4989-a315-09b26878a5b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:24:59.960320 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe93384-d604-4989-a315-09b26878a5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:24:59.960595 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe93384-d604-4989-a315-09b26878a5b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:24:59.961258 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe93384-d604-4989-a315-09b26878a5b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:24:59.962858 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe93384-d604-4989-a315-09b26878a5b2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:24:59.977785 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1182/2347] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:25:00.073372 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a8b20-7736-47ff-8acc-86717de7205b admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:25:00.086336 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1a8b20-7736-47ff-8acc-86717de7205b admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:25:00.091029 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978faf4-5bea-4548-a1d1-c6d058a93e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:25:00.091689 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978faf4-5bea-4548-a1d1-c6d058a93e52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:00.091974 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978faf4-5bea-4548-a1d1-c6d058a93e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:00.092281 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978faf4-5bea-4548-a1d1-c6d058a93e52 admin admin] PATH_INFO: `/v3/projects/5a21129893f946758f168878f0699e20/users/c3c4e299430148e7ace2d2d9874e0d81/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:00.110630 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978faf4-5bea-4548-a1d1-c6d058a93e52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a21129893f946758f168878f0699e20, user_id=c3c4e299430148e7ace2d2d9874e0d81, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:25:00.113893 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978faf4-5bea-4548-a1d1-c6d058a93e52 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:25:00.410343 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1166/2348] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:25:00 2022] PUT /identity/v3/projects/5a21129893f946758f168878f0699e20/users/c3c4e299430148e7ace2d2d9874e0d81/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:25:00.481970 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47970a-fa42-4fb0-9487-e439c0fb33e8 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:00.482932 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47970a-fa42-4fb0-9487-e439c0fb33e8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:00.483504 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47970a-fa42-4fb0-9487-e439c0fb33e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:00.504169 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:25:00.600711 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-fb47970a-fa42-4fb0-9487-e439c0fb33e8 None None] MFA Rules not processed for user `c3c4e299430148e7ace2d2d9874e0d81`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:25:00.606754 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fb47970a-fa42-4fb0-9487-e439c0fb33e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:25:00.764339 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1183/2349] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:25:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:25:00.780677 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978faf4-5bea-4548-a1d1-c6d058a93e52 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:25:00.783602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8978faf4-5bea-4548-a1d1-c6d058a93e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:25:00.917191 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:25:00.947516 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978faf4-5bea-4548-a1d1-c6d058a93e52 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:25:00.952474 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640c528-2a3f-4731-8309-b473bad0dcf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:25:00.953293 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640c528-2a3f-4731-8309-b473bad0dcf2 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:00.953745 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640c528-2a3f-4731-8309-b473bad0dcf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:00.954183 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5640c528-2a3f-4731-8309-b473bad0dcf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:00.976127 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5640c528-2a3f-4731-8309-b473bad0dcf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:25:00.977598 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5640c528-2a3f-4731-8309-b473bad0dcf2 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:25:01.000201 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1167/2350] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:25:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:25:06.831534 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc062eb-25b7-433b-a876-6b1bd9c580dc None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:06.831992 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc062eb-25b7-433b-a876-6b1bd9c580dc None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:06.832117 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc062eb-25b7-433b-a876-6b1bd9c580dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:06.873713 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-fcc062eb-25b7-433b-a876-6b1bd9c580dc None None] MFA Rules not processed for user `10857cba2e9741d5ac0db85d1f52d083`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:25:06.875245 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fcc062eb-25b7-433b-a876-6b1bd9c580dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:25:06.964439 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1184/2351] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:25:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:25:06.969656 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640c528-2a3f-4731-8309-b473bad0dcf2 service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:25:06.971223 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5640c528-2a3f-4731-8309-b473bad0dcf2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:25:07.092477 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5640c528-2a3f-4731-8309-b473bad0dcf2 service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:25:07.098088 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ad978-bb9d-4687-b3f7-500b7f2db6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:25:07.099024 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ad978-bb9d-4687-b3f7-500b7f2db6dc admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:07.099357 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ad978-bb9d-4687-b3f7-500b7f2db6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:07.100000 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ad978-bb9d-4687-b3f7-500b7f2db6dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:07.108681 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ad978-bb9d-4687-b3f7-500b7f2db6dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:25:07.108681 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ad978-bb9d-4687-b3f7-500b7f2db6dc admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:25:07.222795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1168/2352] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:25:06 2022] POST /identity/v3/projects => generated 385 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:25:07.226606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc062eb-25b7-433b-a876-6b1bd9c580dc None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:25:07.246410 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc062eb-25b7-433b-a876-6b1bd9c580dc None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:25:07.367870 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c005072-8776-4371-97f5-31032f0604af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:25:07.368567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c005072-8776-4371-97f5-31032f0604af admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:07.368847 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c005072-8776-4371-97f5-31032f0604af admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:07.369121 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c005072-8776-4371-97f5-31032f0604af admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:07.369765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c005072-8776-4371-97f5-31032f0604af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:25:07.371721 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c005072-8776-4371-97f5-31032f0604af admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:25:07.495912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1185/2353] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:25:07 2022] POST /identity/v3/users => generated 299 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:25:07.502462 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ad978-bb9d-4687-b3f7-500b7f2db6dc admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:25:07.521236 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ad978-bb9d-4687-b3f7-500b7f2db6dc admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:25:07.529949 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee9592-7e8f-4a9c-b5e7-811cbe3574c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:25:07.531263 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee9592-7e8f-4a9c-b5e7-811cbe3574c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:07.531609 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee9592-7e8f-4a9c-b5e7-811cbe3574c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:07.531921 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee9592-7e8f-4a9c-b5e7-811cbe3574c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:07.532628 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee9592-7e8f-4a9c-b5e7-811cbe3574c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:25:07.535226 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eee9592-7e8f-4a9c-b5e7-811cbe3574c0 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:25:07.575872 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1169/2354] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:25:07.580864 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c005072-8776-4371-97f5-31032f0604af admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:25:07.593313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c005072-8776-4371-97f5-31032f0604af admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:25:07.601196 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2f922-658f-4e8a-acc3-7f4e1a68fd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:25:07.602404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2f922-658f-4e8a-acc3-7f4e1a68fd15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:07.607050 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2f922-658f-4e8a-acc3-7f4e1a68fd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:07.607594 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a2f922-658f-4e8a-acc3-7f4e1a68fd15 admin admin] PATH_INFO: `/v3/projects/95e73638c9614b34af2732920eef5849/users/420afc2d5ceb4069956cc64a66b899b4/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:07.624026 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:25:07.628345 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2f922-658f-4e8a-acc3-7f4e1a68fd15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95e73638c9614b34af2732920eef5849, user_id=420afc2d5ceb4069956cc64a66b899b4, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:25:07.631305 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a2f922-658f-4e8a-acc3-7f4e1a68fd15 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:25:07.763666 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1186/2355] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:25:07 2022] PUT /identity/v3/projects/95e73638c9614b34af2732920eef5849/users/420afc2d5ceb4069956cc64a66b899b4/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:25:07.768172 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee9592-7e8f-4a9c-b5e7-811cbe3574c0 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:25:07.789948 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee9592-7e8f-4a9c-b5e7-811cbe3574c0 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:25:07.958977 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b98d85-3cb5-4176-979b-5e4ad2121575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:25:07.959624 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b98d85-3cb5-4176-979b-5e4ad2121575 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:07.962191 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b98d85-3cb5-4176-979b-5e4ad2121575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:07.962485 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b98d85-3cb5-4176-979b-5e4ad2121575 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:07.963158 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b98d85-3cb5-4176-979b-5e4ad2121575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:25:07.971447 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b98d85-3cb5-4176-979b-5e4ad2121575 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:25:08.008318 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1170/2356] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:25:08.014313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2f922-658f-4e8a-acc3-7f4e1a68fd15 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:25:08.043974 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a2f922-658f-4e8a-acc3-7f4e1a68fd15 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:25:08.074468 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e13615-1d8e-41c5-953c-414e2d000776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:25:08.075209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e13615-1d8e-41c5-953c-414e2d000776 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:08.075493 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e13615-1d8e-41c5-953c-414e2d000776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:08.075767 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e13615-1d8e-41c5-953c-414e2d000776 admin admin] PATH_INFO: `/v3/projects/95e73638c9614b34af2732920eef5849/users/420afc2d5ceb4069956cc64a66b899b4/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:08.077862 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e13615-1d8e-41c5-953c-414e2d000776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95e73638c9614b34af2732920eef5849, user_id=420afc2d5ceb4069956cc64a66b899b4, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:25:08.080694 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e13615-1d8e-41c5-953c-414e2d000776 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:25:08.103437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1187/2357] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:25:08 2022] PUT /identity/v3/projects/95e73638c9614b34af2732920eef5849/users/420afc2d5ceb4069956cc64a66b899b4/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:25:10.152848 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b724b7-f1cc-4166-bb23-cc4cb28cacc5 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:10.153867 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b724b7-f1cc-4166-bb23-cc4cb28cacc5 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:10.154371 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b724b7-f1cc-4166-bb23-cc4cb28cacc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:10.195378 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c3b724b7-f1cc-4166-bb23-cc4cb28cacc5 None None] MFA Rules not processed for user `0ba7376671a24d35a920e0ec3290472b`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:25:10.197787 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c3b724b7-f1cc-4166-bb23-cc4cb28cacc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:25:10.278411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:25:10.299396 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1171/2358] 10.222.0.81 () {58 vars in 1009 bytes} [Tue Sep 6 21:25:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:25:10.314450 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e13615-1d8e-41c5-953c-414e2d000776 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:25:10.317550 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-32e13615-1d8e-41c5-953c-414e2d000776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:25:10.479835 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e13615-1d8e-41c5-953c-414e2d000776 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:25:10.505904 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79083769-ae54-4258-a8e0-76b3aa1ac005 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0aac45d8b549afafae0a3f623bce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:25:10.506459 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79083769-ae54-4258-a8e0-76b3aa1ac005 service swift] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:10.506738 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79083769-ae54-4258-a8e0-76b3aa1ac005 service swift] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:10.507551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79083769-ae54-4258-a8e0-76b3aa1ac005 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:10.530687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79083769-ae54-4258-a8e0-76b3aa1ac005 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:25:10.534386 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79083769-ae54-4258-a8e0-76b3aa1ac005 service swift] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:25:10.572903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1188/2359] 10.222.0.81 () {60 vars in 1384 bytes} [Tue Sep 6 21:25:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 21:25:16.758225 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b592c38-625a-48c1-8602-4fe5b40dd0db None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:16.759088 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b592c38-625a-48c1-8602-4fe5b40dd0db None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:16.759088 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b592c38-625a-48c1-8602-4fe5b40dd0db None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:16.761036 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1172/2360] 10.222.0.81 () {54 vars in 921 bytes} [Tue Sep 6 21:25:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:25:16.767770 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ccf42-6b16-4e3b-b197-362365fb84a4 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:16.768390 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ccf42-6b16-4e3b-b197-362365fb84a4 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:16.768390 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ccf42-6b16-4e3b-b197-362365fb84a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:16.804633 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-fe1ccf42-6b16-4e3b-b197-362365fb84a4 None None] MFA Rules not processed for user `4441d8fea57f401a96fb8cbd2b501059`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:25:16.806183 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fe1ccf42-6b16-4e3b-b197-362365fb84a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:25:16.924674 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1189/2361] 10.222.0.81 () {58 vars in 1018 bytes} [Tue Sep 6 21:25:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:25:16.941382 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b592c38-625a-48c1-8602-4fe5b40dd0db None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:25:16.943441 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-3b592c38-625a-48c1-8602-4fe5b40dd0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:25:17.031615 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b592c38-625a-48c1-8602-4fe5b40dd0db None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:25:17.036928 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cfb059-f095-4a86-848e-663da46197fa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ba30d9c40641bf8abb580a219b5352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:25:17.039274 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfb059-f095-4a86-848e-663da46197fa service glance] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:17.039637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfb059-f095-4a86-848e-663da46197fa service glance] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:17.040044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cfb059-f095-4a86-848e-663da46197fa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:17.062149 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cfb059-f095-4a86-848e-663da46197fa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:25:17.064242 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cfb059-f095-4a86-848e-663da46197fa service glance] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:25:17.078942 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1173/2362] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:25:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:25:17.325583 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad02b6-cda4-41ad-a22e-6bb82a085c15 None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:17.329413 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad02b6-cda4-41ad-a22e-6bb82a085c15 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:17.329413 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad02b6-cda4-41ad-a22e-6bb82a085c15 None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:17.329413 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1190/2363] 10.222.0.81 () {54 vars in 921 bytes} [Tue Sep 6 21:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:25:17.338571 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396020a-cae8-4e89-8b51-2e1b72db719e None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:17.339423 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396020a-cae8-4e89-8b51-2e1b72db719e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:17.339812 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b396020a-cae8-4e89-8b51-2e1b72db719e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:17.386978 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-b396020a-cae8-4e89-8b51-2e1b72db719e None None] MFA Rules not processed for user `c9aebd6c7ef24f42949918c99a72722d`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:25:17.389399 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b396020a-cae8-4e89-8b51-2e1b72db719e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:25:17.500026 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8940e-1888-497f-93e2-8780c43b3976 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:17.500708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8940e-1888-497f-93e2-8780c43b3976 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:17.501001 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8940e-1888-497f-93e2-8780c43b3976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:17.554661 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-57a8940e-1888-497f-93e2-8780c43b3976 None None] MFA Rules not processed for user `420afc2d5ceb4069956cc64a66b899b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:25:17.556544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-57a8940e-1888-497f-93e2-8780c43b3976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:25:17.582882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1174/2364] 10.222.0.81 () {58 vars in 1018 bytes} [Tue Sep 6 21:25:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:25:17.598764 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b396020a-cae8-4e89-8b51-2e1b72db719e None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:25:17.603328 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b396020a-cae8-4e89-8b51-2e1b72db719e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:25:17.627809 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b396020a-cae8-4e89-8b51-2e1b72db719e None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:25:17.633864 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2bcb10-d965-4135-95f8-149e6f2f3b79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:25:17.635233 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bcb10-d965-4135-95f8-149e6f2f3b79 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:17.636085 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bcb10-d965-4135-95f8-149e6f2f3b79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:17.636228 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bcb10-d965-4135-95f8-149e6f2f3b79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:17.645714 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:25:17.690038 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1191/2365] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:25:17 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:25:17.690684 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2bcb10-d965-4135-95f8-149e6f2f3b79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:25:17.693154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8940e-1888-497f-93e2-8780c43b3976 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:25:17.694097 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2bcb10-d965-4135-95f8-149e6f2f3b79 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:25:17.719156 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1175/2366] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:25:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:25:17.725353 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8940e-1888-497f-93e2-8780c43b3976 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:25:17.725353 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea47fbd-8f15-454c-82fd-c83242ea0b00 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ba30d9c40641bf8abb580a219b5352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:25:17.725353 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea47fbd-8f15-454c-82fd-c83242ea0b00 service glance] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:17.725353 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea47fbd-8f15-454c-82fd-c83242ea0b00 service glance] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:17.725707 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea47fbd-8f15-454c-82fd-c83242ea0b00 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:17.796494 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea47fbd-8f15-454c-82fd-c83242ea0b00 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:25:17.797605 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea47fbd-8f15-454c-82fd-c83242ea0b00 service glance] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:25:17.811612 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1192/2367] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:25:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:25:17.835881 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e8a39-2470-45d9-a16a-f82afba2b5dc None None] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:17.836502 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e8a39-2470-45d9-a16a-f82afba2b5dc None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:17.836502 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e8a39-2470-45d9-a16a-f82afba2b5dc None None] PATH_INFO: `/` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:17.837802 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1176/2368] 10.222.0.81 () {54 vars in 921 bytes} [Tue Sep 6 21:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:25:17.850614 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cd30f-a37b-4417-a8a4-354a4a002bcf None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:17.851183 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cd30f-a37b-4417-a8a4-354a4a002bcf None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:17.851713 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cd30f-a37b-4417-a8a4-354a4a002bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:17.895618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-031cd30f-a37b-4417-a8a4-354a4a002bcf None None] MFA Rules not processed for user `4441d8fea57f401a96fb8cbd2b501059`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:25:17.897484 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-031cd30f-a37b-4417-a8a4-354a4a002bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:25:17.924254 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1193/2369] 10.222.0.81 () {58 vars in 1018 bytes} [Tue Sep 6 21:25:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:25:17.935932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e8a39-2470-45d9-a16a-f82afba2b5dc None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:25:17.956627 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e8a39-2470-45d9-a16a-f82afba2b5dc None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:25:17.961171 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e40ec3-dc4f-4aff-af0f-5c2877c5baa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:25:17.962206 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e40ec3-dc4f-4aff-af0f-5c2877c5baa9 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:17.962810 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e40ec3-dc4f-4aff-af0f-5c2877c5baa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:17.963088 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e40ec3-dc4f-4aff-af0f-5c2877c5baa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:17.975470 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e40ec3-dc4f-4aff-af0f-5c2877c5baa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:25:17.977015 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e40ec3-dc4f-4aff-af0f-5c2877c5baa9 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:25:17.991841 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1177/2370] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:25:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:25:18.292311 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0b470-c79e-4996-88a2-afb807cf6ad2 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:18.292443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0b470-c79e-4996-88a2-afb807cf6ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:18.292669 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0b470-c79e-4996-88a2-afb807cf6ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:18.330856 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f7e0b470-c79e-4996-88a2-afb807cf6ad2 None None] MFA Rules not processed for user `0ba7376671a24d35a920e0ec3290472b`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:25:18.332642 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f7e0b470-c79e-4996-88a2-afb807cf6ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:25:18.342416 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1194/2371] 10.222.0.81 () {58 vars in 1009 bytes} [Tue Sep 6 21:25:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:25:18.370051 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e40ec3-dc4f-4aff-af0f-5c2877c5baa9 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:25:18.383995 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e40ec3-dc4f-4aff-af0f-5c2877c5baa9 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:25:18.389721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c8771-7d46-48d9-9d30-ef11ca095418 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0aac45d8b549afafae0a3f623bce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:25:18.390644 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c8771-7d46-48d9-9d30-ef11ca095418 service swift] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:18.391172 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c8771-7d46-48d9-9d30-ef11ca095418 service swift] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:18.391610 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c8771-7d46-48d9-9d30-ef11ca095418 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:18.401926 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c8771-7d46-48d9-9d30-ef11ca095418 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:25:18.403527 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c8771-7d46-48d9-9d30-ef11ca095418 service swift] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:25:18.413276 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1178/2372] 10.222.0.81 () {60 vars in 1384 bytes} [Tue Sep 6 21:25:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 21:25:19.174236 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0b470-c79e-4996-88a2-afb807cf6ad2 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:25:19.409350 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0b470-c79e-4996-88a2-afb807cf6ad2 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:25:19.416305 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8399cb01-c6e5-43d5-a52b-943996c0d77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:25:19.417089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399cb01-c6e5-43d5-a52b-943996c0d77e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:19.417850 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399cb01-c6e5-43d5-a52b-943996c0d77e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:19.418236 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399cb01-c6e5-43d5-a52b-943996c0d77e admin admin] PATH_INFO: `/v3/users/c3c4e299430148e7ace2d2d9874e0d81` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:19.419877 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8399cb01-c6e5-43d5-a52b-943996c0d77e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3c4e299430148e7ace2d2d9874e0d81)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:25:19.422328 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8399cb01-c6e5-43d5-a52b-943996c0d77e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:25:19.658087 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8399cb01-c6e5-43d5-a52b-943996c0d77e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3c4e299430148e7ace2d2d9874e0d81'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:25:19.749887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8399cb01-c6e5-43d5-a52b-943996c0d77e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3c4e299430148e7ace2d2d9874e0d81'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:25:19.772951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8399cb01-c6e5-43d5-a52b-943996c0d77e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3c4e299430148e7ace2d2d9874e0d81'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:25:19.775471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8399cb01-c6e5-43d5-a52b-943996c0d77e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3c4e299430148e7ace2d2d9874e0d81'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:25:19.777054 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:25:19.835778 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8399cb01-c6e5-43d5-a52b-943996c0d77e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3c4e299430148e7ace2d2d9874e0d81'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:25:19.862595 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1195/2373] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:25:19 2022] DELETE /identity/v3/users/c3c4e299430148e7ace2d2d9874e0d81 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:25:19.864975 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c7f69-eeb3-4478-acca-4f1f177d0def None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:19.865806 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c7f69-eeb3-4478-acca-4f1f177d0def None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:19.866250 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c7f69-eeb3-4478-acca-4f1f177d0def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:19.907103 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-539c7f69-eeb3-4478-acca-4f1f177d0def None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:25:19.910059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-539c7f69-eeb3-4478-acca-4f1f177d0def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:25:20.030612 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1179/2374] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:25:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:25:20.038965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8399cb01-c6e5-43d5-a52b-943996c0d77e admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:25:20.040530 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8399cb01-c6e5-43d5-a52b-943996c0d77e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:25:20.347261 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8399cb01-c6e5-43d5-a52b-943996c0d77e admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:25:20.363912 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6d8f4-4f7e-4682-93b0-c5f95e2ee902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:25:20.364723 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6d8f4-4f7e-4682-93b0-c5f95e2ee902 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:20.365131 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6d8f4-4f7e-4682-93b0-c5f95e2ee902 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:20.365501 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6d8f4-4f7e-4682-93b0-c5f95e2ee902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:20.383588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec6d8f4-4f7e-4682-93b0-c5f95e2ee902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:25:20.385681 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec6d8f4-4f7e-4682-93b0-c5f95e2ee902 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:25:20.399836 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1196/2375] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:25:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:25:21.290507 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c7f69-eeb3-4478-acca-4f1f177d0def None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:25:21.293118 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-539c7f69-eeb3-4478-acca-4f1f177d0def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:25:21.318771 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c7f69-eeb3-4478-acca-4f1f177d0def None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:25:21.326520 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45edd75a-a6bf-4b8f-82e5-676ca9ab0e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:25:21.327412 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edd75a-a6bf-4b8f-82e5-676ca9ab0e11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:21.327879 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edd75a-a6bf-4b8f-82e5-676ca9ab0e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:21.328587 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45edd75a-a6bf-4b8f-82e5-676ca9ab0e11 admin admin] PATH_INFO: `/v3/projects/5a21129893f946758f168878f0699e20` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:21.329945 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edd75a-a6bf-4b8f-82e5-676ca9ab0e11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a21129893f946758f168878f0699e20)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:25:21.332239 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45edd75a-a6bf-4b8f-82e5-676ca9ab0e11 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:25:21.338588 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:25:21.512868 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-45edd75a-a6bf-4b8f-82e5-676ca9ab0e11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a21129893f946758f168878f0699e20', 'request_id': 'req-45edd75a-a6bf-4b8f-82e5-676ca9ab0e11'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:25:21.585265 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-45edd75a-a6bf-4b8f-82e5-676ca9ab0e11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a21129893f946758f168878f0699e20', 'request_id': 'req-45edd75a-a6bf-4b8f-82e5-676ca9ab0e11'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:25:21.593472 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-45edd75a-a6bf-4b8f-82e5-676ca9ab0e11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a21129893f946758f168878f0699e20', 'request_id': 'req-45edd75a-a6bf-4b8f-82e5-676ca9ab0e11'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:25:21.608984 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-45edd75a-a6bf-4b8f-82e5-676ca9ab0e11 admin admin] The token cache is being invalidate because project 5a21129893f946758f168878f0699e20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:25:21.610140 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-45edd75a-a6bf-4b8f-82e5-676ca9ab0e11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:25:21.610469 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-45edd75a-a6bf-4b8f-82e5-676ca9ab0e11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:25:21.632459 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1180/2376] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:25:21 2022] DELETE /identity/v3/projects/5a21129893f946758f168878f0699e20 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:25:30.393243 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=31 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:25:31.603368 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=23,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:25:31.945452 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb06ac-b8af-4189-bf3e-92cdbd319420 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:31.946018 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb06ac-b8af-4189-bf3e-92cdbd319420 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:31.946111 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bb06ac-b8af-4189-bf3e-92cdbd319420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:31.971696 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a1bb06ac-b8af-4189-bf3e-92cdbd319420 None None] MFA Rules not processed for user `10857cba2e9741d5ac0db85d1f52d083`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:25:31.973226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a1bb06ac-b8af-4189-bf3e-92cdbd319420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:25:32.043907 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5aea7-6437-4717-b515-0fa0d5fe024b None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:32.047752 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5aea7-6437-4717-b515-0fa0d5fe024b None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:32.047752 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf5aea7-6437-4717-b515-0fa0d5fe024b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:32.078289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1197/2377] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:25:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:25:32.078531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-8bf5aea7-6437-4717-b515-0fa0d5fe024b None None] MFA Rules not processed for user `0ba7376671a24d35a920e0ec3290472b`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:25:32.078531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8bf5aea7-6437-4717-b515-0fa0d5fe024b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:25:32.156412 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1181/2378] 10.222.0.81 () {58 vars in 1009 bytes} [Tue Sep 6 21:25:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:25:32.167273 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb06ac-b8af-4189-bf3e-92cdbd319420 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:25:32.170330 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a1bb06ac-b8af-4189-bf3e-92cdbd319420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:25:32.257970 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bb06ac-b8af-4189-bf3e-92cdbd319420 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:25:32.263126 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e0707-fbcb-4511-b98f-77feae7f5211 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0aac45d8b549afafae0a3f623bce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:25:32.263753 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e0707-fbcb-4511-b98f-77feae7f5211 service swift] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:32.264040 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e0707-fbcb-4511-b98f-77feae7f5211 service swift] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:32.264409 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621e0707-fbcb-4511-b98f-77feae7f5211 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:32.276734 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e0707-fbcb-4511-b98f-77feae7f5211 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:25:32.278466 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621e0707-fbcb-4511-b98f-77feae7f5211 service swift] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:25:32.288513 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1198/2379] 10.222.0.81 () {60 vars in 1384 bytes} [Tue Sep 6 21:25:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 21:25:37.056459 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa40c72-1673-49ee-80ac-bc7e492f553f None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:37.056915 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa40c72-1673-49ee-80ac-bc7e492f553f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:37.057172 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa40c72-1673-49ee-80ac-bc7e492f553f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:37.088646 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-faa40c72-1673-49ee-80ac-bc7e492f553f None None] MFA Rules not processed for user `0ba7376671a24d35a920e0ec3290472b`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:25:37.090257 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-faa40c72-1673-49ee-80ac-bc7e492f553f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:25:37.102691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1182/2380] 10.222.0.81 () {58 vars in 967 bytes} [Tue Sep 6 21:25:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:25:37.130018 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e0707-fbcb-4511-b98f-77feae7f5211 service swift] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:25:37.147599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621e0707-fbcb-4511-b98f-77feae7f5211 service swift] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:25:37.154634 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a235d647-a688-416e-99d1-4293b77d5637 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0aac45d8b549afafae0a3f623bce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:25:37.155351 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235d647-a688-416e-99d1-4293b77d5637 service swift] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:37.155697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235d647-a688-416e-99d1-4293b77d5637 service swift] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:37.156039 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a235d647-a688-416e-99d1-4293b77d5637 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:37.166700 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235d647-a688-416e-99d1-4293b77d5637 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:25:37.169861 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a235d647-a688-416e-99d1-4293b77d5637 service swift] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:25:37.183289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1199/2381] 10.222.0.81 () {60 vars in 1384 bytes} [Tue Sep 6 21:25:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 21:25:43.761448 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa40c72-1673-49ee-80ac-bc7e492f553f None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:25:43.763536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-faa40c72-1673-49ee-80ac-bc7e492f553f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:25:43.834766 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa40c72-1673-49ee-80ac-bc7e492f553f None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:25:43.839781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569966ca-d80d-4f38-b74f-38348c1e4652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:25:43.840567 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569966ca-d80d-4f38-b74f-38348c1e4652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:43.840967 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569966ca-d80d-4f38-b74f-38348c1e4652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:43.841370 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569966ca-d80d-4f38-b74f-38348c1e4652 admin admin] PATH_INFO: `/v3/users/2b5f0b0928874046ad7f4d873796d344` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:43.842627 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569966ca-d80d-4f38-b74f-38348c1e4652 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b5f0b0928874046ad7f4d873796d344)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:25:43.845398 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569966ca-d80d-4f38-b74f-38348c1e4652 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:25:44.079789 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-569966ca-d80d-4f38-b74f-38348c1e4652 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b5f0b0928874046ad7f4d873796d344'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:25:44.172561 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-569966ca-d80d-4f38-b74f-38348c1e4652 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b5f0b0928874046ad7f4d873796d344'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:25:44.185420 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-569966ca-d80d-4f38-b74f-38348c1e4652 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b5f0b0928874046ad7f4d873796d344'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:25:44.186127 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-569966ca-d80d-4f38-b74f-38348c1e4652 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b5f0b0928874046ad7f4d873796d344'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:25:44.193897 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-569966ca-d80d-4f38-b74f-38348c1e4652 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b5f0b0928874046ad7f4d873796d344'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:25:44.207166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1183/2382] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:25:43 2022] DELETE /identity/v3/users/2b5f0b0928874046ad7f4d873796d344 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:25:44.207451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db82ed6-5e8c-44e5-b656-198041ba2cbe None None] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:44.207451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db82ed6-5e8c-44e5-b656-198041ba2cbe None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:44.207451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db82ed6-5e8c-44e5-b656-198041ba2cbe None None] PATH_INFO: `/` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:44.207451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1200/2383] 10.222.0.81 () {54 vars in 961 bytes} [Tue Sep 6 21:25:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 06 21:25:44.211776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf52a96-a8fc-4bb0-9ace-da98859eadf4 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:44.212189 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf52a96-a8fc-4bb0-9ace-da98859eadf4 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:44.212540 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf52a96-a8fc-4bb0-9ace-da98859eadf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:44.233952 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-1cf52a96-a8fc-4bb0-9ace-da98859eadf4 None None] MFA Rules not processed for user `c3295306746f4552837f1bb12b2c500f`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:25:44.236016 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1cf52a96-a8fc-4bb0-9ace-da98859eadf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:25:44.256861 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:25:44.288816 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db82ed6-5e8c-44e5-b656-198041ba2cbe None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:25:44.290826 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8db82ed6-5e8c-44e5-b656-198041ba2cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:25:44.314025 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1184/2384] 10.222.0.81 () {58 vars in 1058 bytes} [Tue Sep 6 21:25:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:25:44.322155 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf52a96-a8fc-4bb0-9ace-da98859eadf4 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:25:44.336528 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf52a96-a8fc-4bb0-9ace-da98859eadf4 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:25:44.337677 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145a3aa-6ad3-4641-9a9e-4dc10867a9d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3295306746f4552837f1bb12b2c500f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:25:44.338647 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145a3aa-6ad3-4641-9a9e-4dc10867a9d7 service placement] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:44.338647 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145a3aa-6ad3-4641-9a9e-4dc10867a9d7 service placement] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:44.338869 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145a3aa-6ad3-4641-9a9e-4dc10867a9d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:44.340748 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f145a3aa-6ad3-4641-9a9e-4dc10867a9d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:25:44.352509 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145a3aa-6ad3-4641-9a9e-4dc10867a9d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:25:44.354782 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145a3aa-6ad3-4641-9a9e-4dc10867a9d7 service placement] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:25:44.365161 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1185/2385] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:25:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:25:44.375634 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db82ed6-5e8c-44e5-b656-198041ba2cbe None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:25:44.381553 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15464952-468c-47f0-b47d-5f570206f4c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3295306746f4552837f1bb12b2c500f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:25:44.382362 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15464952-468c-47f0-b47d-5f570206f4c7 service placement] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:44.382829 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15464952-468c-47f0-b47d-5f570206f4c7 service placement] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:44.383208 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15464952-468c-47f0-b47d-5f570206f4c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:44.392575 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15464952-468c-47f0-b47d-5f570206f4c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:25:44.394211 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15464952-468c-47f0-b47d-5f570206f4c7 service placement] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:25:44.404011 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1201/2386] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:25:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:25:44.511669 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145a3aa-6ad3-4641-9a9e-4dc10867a9d7 service placement] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:25:44.513127 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f145a3aa-6ad3-4641-9a9e-4dc10867a9d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:25:44.580882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145a3aa-6ad3-4641-9a9e-4dc10867a9d7 service placement] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:25:44.585558 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ce119-9884-4982-98c7-350a415f27c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:25:44.586189 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ce119-9884-4982-98c7-350a415f27c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:44.586591 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ce119-9884-4982-98c7-350a415f27c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:44.586817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ce119-9884-4982-98c7-350a415f27c5 admin admin] PATH_INFO: `/v3/projects/fdc4cec936994a9d90d60247faf4f7c0` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:44.587997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ce119-9884-4982-98c7-350a415f27c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdc4cec936994a9d90d60247faf4f7c0)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:25:44.590102 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ce119-9884-4982-98c7-350a415f27c5 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:25:44.750349 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-653ce119-9884-4982-98c7-350a415f27c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdc4cec936994a9d90d60247faf4f7c0', 'request_id': 'req-653ce119-9884-4982-98c7-350a415f27c5'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:25:44.862648 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-653ce119-9884-4982-98c7-350a415f27c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdc4cec936994a9d90d60247faf4f7c0', 'request_id': 'req-653ce119-9884-4982-98c7-350a415f27c5'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:25:44.869451 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-653ce119-9884-4982-98c7-350a415f27c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdc4cec936994a9d90d60247faf4f7c0', 'request_id': 'req-653ce119-9884-4982-98c7-350a415f27c5'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:25:44.881225 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-653ce119-9884-4982-98c7-350a415f27c5 admin admin] The token cache is being invalidate because project fdc4cec936994a9d90d60247faf4f7c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:25:44.881353 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-653ce119-9884-4982-98c7-350a415f27c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:25:44.881964 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-653ce119-9884-4982-98c7-350a415f27c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:25:44.887590 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1186/2387] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:25:44 2022] DELETE /identity/v3/projects/fdc4cec936994a9d90d60247faf4f7c0 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:25:44.889839 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbcd9b-a73a-47c7-a101-dd7d8419b794 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:44.890244 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbcd9b-a73a-47c7-a101-dd7d8419b794 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:44.891415 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbbcd9b-a73a-47c7-a101-dd7d8419b794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:44.912789 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-5dbbcd9b-a73a-47c7-a101-dd7d8419b794 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:25:44.914073 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5dbbcd9b-a73a-47c7-a101-dd7d8419b794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:25:44.920573 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:25:44.976044 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1202/2388] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:25:44.987859 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6826c3a-6e77-42f7-986e-66eda5f17ffc None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:44.988211 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6826c3a-6e77-42f7-986e-66eda5f17ffc None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:44.988491 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6826c3a-6e77-42f7-986e-66eda5f17ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:45.008330 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-d6826c3a-6e77-42f7-986e-66eda5f17ffc None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:25:45.009647 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d6826c3a-6e77-42f7-986e-66eda5f17ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:25:45.018098 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1187/2389] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:25:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:25:45.022353 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbcd9b-a73a-47c7-a101-dd7d8419b794 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:25:45.035075 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbbcd9b-a73a-47c7-a101-dd7d8419b794 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:25:45.039754 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cac302-0cfb-4755-bd16-046b446c0f5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:25:45.040403 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cac302-0cfb-4755-bd16-046b446c0f5a admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:45.040688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cac302-0cfb-4755-bd16-046b446c0f5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:45.040974 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cac302-0cfb-4755-bd16-046b446c0f5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:45.041620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cac302-0cfb-4755-bd16-046b446c0f5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:25:45.041928 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cac302-0cfb-4755-bd16-046b446c0f5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:25:45.044313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cac302-0cfb-4755-bd16-046b446c0f5a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:25:45.056775 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1203/2390] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:25:45.061216 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6826c3a-6e77-42f7-986e-66eda5f17ffc None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:25:45.072121 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6826c3a-6e77-42f7-986e-66eda5f17ffc None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:25:45.082400 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc08992-9bec-40ce-a2d3-2194c5d74112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:25:45.083014 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc08992-9bec-40ce-a2d3-2194c5d74112 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:45.083294 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc08992-9bec-40ce-a2d3-2194c5d74112 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:45.083565 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc08992-9bec-40ce-a2d3-2194c5d74112 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:45.084308 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc08992-9bec-40ce-a2d3-2194c5d74112 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:25:45.090207 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc08992-9bec-40ce-a2d3-2194c5d74112 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:25:45.193475 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1188/2391] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:25:45 2022] POST /identity/v3/projects => generated 363 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:25:45.205584 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cac302-0cfb-4755-bd16-046b446c0f5a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:25:45.215511 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cac302-0cfb-4755-bd16-046b446c0f5a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:25:45.282222 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62489e-9df5-4ee7-9f98-1b12f669b8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:25:45.283381 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62489e-9df5-4ee7-9f98-1b12f669b8ba admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:45.283658 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62489e-9df5-4ee7-9f98-1b12f669b8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:45.283930 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62489e-9df5-4ee7-9f98-1b12f669b8ba admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:45.284595 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62489e-9df5-4ee7-9f98-1b12f669b8ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:25:45.286626 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd62489e-9df5-4ee7-9f98-1b12f669b8ba admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:25:45.385063 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1204/2392] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:25:45 2022] POST /identity/v3/users => generated 282 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:25:45.389467 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc08992-9bec-40ce-a2d3-2194c5d74112 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:25:45.395989 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:25:45.402182 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc08992-9bec-40ce-a2d3-2194c5d74112 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:25:45.407019 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a3e90-4b76-4acc-84c7-2a097d7eddb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:25:45.411742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a3e90-4b76-4acc-84c7-2a097d7eddb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:45.411742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a3e90-4b76-4acc-84c7-2a097d7eddb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:45.411742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a3e90-4b76-4acc-84c7-2a097d7eddb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:45.411742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a3e90-4b76-4acc-84c7-2a097d7eddb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:25:45.411742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a3e90-4b76-4acc-84c7-2a097d7eddb2 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:25:45.421222 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1189/2393] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:25:45.425366 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62489e-9df5-4ee7-9f98-1b12f669b8ba admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:25:45.436543 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62489e-9df5-4ee7-9f98-1b12f669b8ba admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:25:45.446209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7391ee-dc4b-4435-9c8a-2b87432a2791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:25:45.446209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7391ee-dc4b-4435-9c8a-2b87432a2791 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:45.446209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7391ee-dc4b-4435-9c8a-2b87432a2791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:45.446209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7391ee-dc4b-4435-9c8a-2b87432a2791 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:45.446598 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7391ee-dc4b-4435-9c8a-2b87432a2791 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:25:45.446598 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7391ee-dc4b-4435-9c8a-2b87432a2791 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:25:45.458372 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1205/2394] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:25:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:25:45.462469 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a3e90-4b76-4acc-84c7-2a097d7eddb2 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:25:45.472348 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a3e90-4b76-4acc-84c7-2a097d7eddb2 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:25:45.477054 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5cc6f-7c71-4d14-b906-23d41a34c425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:25:45.477703 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5cc6f-7c71-4d14-b906-23d41a34c425 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:45.477988 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5cc6f-7c71-4d14-b906-23d41a34c425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:45.478266 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5cc6f-7c71-4d14-b906-23d41a34c425 admin admin] PATH_INFO: `/v3/projects/5f83009d754e4d39928f5d54b6c1f7b7/users/d7dca662b57940b9b11c1b9971ef7426/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:45.493801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5cc6f-7c71-4d14-b906-23d41a34c425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f83009d754e4d39928f5d54b6c1f7b7, user_id=d7dca662b57940b9b11c1b9971ef7426, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:25:45.496524 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5cc6f-7c71-4d14-b906-23d41a34c425 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:25:45.551701 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1190/2395] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:25:45 2022] PUT /identity/v3/projects/5f83009d754e4d39928f5d54b6c1f7b7/users/d7dca662b57940b9b11c1b9971ef7426/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:25:45.563031 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30de37-0dd3-44e0-897f-f3e6958ca068 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:45.563323 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30de37-0dd3-44e0-897f-f3e6958ca068 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:45.564130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30de37-0dd3-44e0-897f-f3e6958ca068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:45.598073 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ea30de37-0dd3-44e0-897f-f3e6958ca068 None None] MFA Rules not processed for user `d7dca662b57940b9b11c1b9971ef7426`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:25:45.599394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ea30de37-0dd3-44e0-897f-f3e6958ca068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:25:45.670114 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1206/2396] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:25:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:25:45.682587 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5cc6f-7c71-4d14-b906-23d41a34c425 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:25:45.684676 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f6e5cc6f-7c71-4d14-b906-23d41a34c425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:25:45.745096 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5cc6f-7c71-4d14-b906-23d41a34c425 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:25:45.748803 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa536245-716e-4f05-ad60-101c6cb479b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:25:45.749408 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa536245-716e-4f05-ad60-101c6cb479b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:45.749690 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa536245-716e-4f05-ad60-101c6cb479b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:45.749968 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa536245-716e-4f05-ad60-101c6cb479b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:45.758756 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa536245-716e-4f05-ad60-101c6cb479b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:25:45.760208 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa536245-716e-4f05-ad60-101c6cb479b5 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:25:45.768931 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1191/2397] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:25:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:25:46.788442 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0c1a1-44e8-408c-9572-f69458fe96d1 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:46.788975 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0c1a1-44e8-408c-9572-f69458fe96d1 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:46.789233 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0c1a1-44e8-408c-9572-f69458fe96d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:46.805888 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:25:46.812730 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-b1d0c1a1-44e8-408c-9572-f69458fe96d1 None None] MFA Rules not processed for user `0ba7376671a24d35a920e0ec3290472b`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:25:46.814556 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b1d0c1a1-44e8-408c-9572-f69458fe96d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:25:46.871197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1207/2398] 10.222.0.81 () {58 vars in 1009 bytes} [Tue Sep 6 21:25:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:25:46.913405 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa536245-716e-4f05-ad60-101c6cb479b5 service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:25:46.915163 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-aa536245-716e-4f05-ad60-101c6cb479b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:25:47.006432 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa536245-716e-4f05-ad60-101c6cb479b5 service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:25:47.011992 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a46ed1-f4a7-4cd7-81ee-e79041da959c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0aac45d8b549afafae0a3f623bce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:25:47.028257 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a46ed1-f4a7-4cd7-81ee-e79041da959c service swift] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:47.028257 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a46ed1-f4a7-4cd7-81ee-e79041da959c service swift] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:47.028257 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a46ed1-f4a7-4cd7-81ee-e79041da959c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:47.028257 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a46ed1-f4a7-4cd7-81ee-e79041da959c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:25:47.028257 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a46ed1-f4a7-4cd7-81ee-e79041da959c service swift] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:25:47.033759 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1192/2399] 10.222.0.81 () {60 vars in 1384 bytes} [Tue Sep 6 21:25:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 21:25:56.948483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=22 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:25:57.030832 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=72,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:25:57.788793 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4b4b0-41c1-4761-a539-fed8b5a3503e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:57.789306 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4b4b0-41c1-4761-a539-fed8b5a3503e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:57.789867 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e4b4b0-41c1-4761-a539-fed8b5a3503e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:57.810273 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-79e4b4b0-41c1-4761-a539-fed8b5a3503e None None] MFA Rules not processed for user `0ba7376671a24d35a920e0ec3290472b`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:25:57.811522 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-79e4b4b0-41c1-4761-a539-fed8b5a3503e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:25:57.818906 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1208/2400] 10.222.0.81 () {58 vars in 967 bytes} [Tue Sep 6 21:25:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:25:57.831849 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a46ed1-f4a7-4cd7-81ee-e79041da959c service swift] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:25:57.843330 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a46ed1-f4a7-4cd7-81ee-e79041da959c service swift] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:25:57.849375 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77313c86-c42e-473a-ade0-63542f2c22f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0aac45d8b549afafae0a3f623bce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:25:57.849979 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77313c86-c42e-473a-ade0-63542f2c22f8 service swift] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:25:57.850261 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77313c86-c42e-473a-ade0-63542f2c22f8 service swift] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:25:57.850533 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77313c86-c42e-473a-ade0-63542f2c22f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:25:57.858847 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77313c86-c42e-473a-ade0-63542f2c22f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:25:57.860563 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77313c86-c42e-473a-ade0-63542f2c22f8 service swift] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:25:57.868596 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1193/2401] 10.222.0.81 () {60 vars in 1384 bytes} [Tue Sep 6 21:25:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 21:26:07.804614 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:26:07.865447 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=6 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:26:14.314061 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4b4b0-41c1-4761-a539-fed8b5a3503e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:26:14.315477 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-79e4b4b0-41c1-4761-a539-fed8b5a3503e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:26:14.371707 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e4b4b0-41c1-4761-a539-fed8b5a3503e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:26:14.375267 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83393044-2586-475f-bef1-cbee8d7e86eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:26:14.375875 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83393044-2586-475f-bef1-cbee8d7e86eb service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:26:14.376186 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83393044-2586-475f-bef1-cbee8d7e86eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:26:14.376461 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83393044-2586-475f-bef1-cbee8d7e86eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:26:14.378271 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-83393044-2586-475f-bef1-cbee8d7e86eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:26:14.440259 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83393044-2586-475f-bef1-cbee8d7e86eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:26:14.441663 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83393044-2586-475f-bef1-cbee8d7e86eb service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:26:14.451042 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1209/2402] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:26:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:26:23.508381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77313c86-c42e-473a-ade0-63542f2c22f8 service swift] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:26:23.576995 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77313c86-c42e-473a-ade0-63542f2c22f8 service swift] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:26:23.581574 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b51b20-7341-4cfd-8bd7-02e59e631a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:26:23.582184 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b51b20-7341-4cfd-8bd7-02e59e631a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:26:23.583093 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b51b20-7341-4cfd-8bd7-02e59e631a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:26:23.583448 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b51b20-7341-4cfd-8bd7-02e59e631a3b admin admin] PATH_INFO: `/v3/users/d7dca662b57940b9b11c1b9971ef7426` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:26:23.584666 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b51b20-7341-4cfd-8bd7-02e59e631a3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7dca662b57940b9b11c1b9971ef7426)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:26:23.586515 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b51b20-7341-4cfd-8bd7-02e59e631a3b admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:26:23.761751 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f4b51b20-7341-4cfd-8bd7-02e59e631a3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7dca662b57940b9b11c1b9971ef7426'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:26:23.827309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f4b51b20-7341-4cfd-8bd7-02e59e631a3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7dca662b57940b9b11c1b9971ef7426'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:26:23.840028 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f4b51b20-7341-4cfd-8bd7-02e59e631a3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7dca662b57940b9b11c1b9971ef7426'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:26:23.840681 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f4b51b20-7341-4cfd-8bd7-02e59e631a3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7dca662b57940b9b11c1b9971ef7426'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:26:23.847476 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f4b51b20-7341-4cfd-8bd7-02e59e631a3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7dca662b57940b9b11c1b9971ef7426'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:26:23.853695 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1194/2403] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:26:23 2022] DELETE /identity/v3/users/d7dca662b57940b9b11c1b9971ef7426 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:26:23.858419 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af1b20-8f27-4b89-8081-6a272cc809fd None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:26:23.858895 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af1b20-8f27-4b89-8081-6a272cc809fd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:26:23.858990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af1b20-8f27-4b89-8081-6a272cc809fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:26:23.878772 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-44af1b20-8f27-4b89-8081-6a272cc809fd None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:26:23.880684 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-44af1b20-8f27-4b89-8081-6a272cc809fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:26:23.939251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1210/2404] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:26:23.949580 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b51b20-7341-4cfd-8bd7-02e59e631a3b admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:26:23.951024 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f4b51b20-7341-4cfd-8bd7-02e59e631a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:26:24.006696 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b51b20-7341-4cfd-8bd7-02e59e631a3b admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:26:24.010320 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cb244d-cce0-461d-ba01-2e6d43aa348d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:26:24.010909 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb244d-cce0-461d-ba01-2e6d43aa348d service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:26:24.011187 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb244d-cce0-461d-ba01-2e6d43aa348d service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:26:24.011459 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cb244d-cce0-461d-ba01-2e6d43aa348d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:26:24.020158 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb244d-cce0-461d-ba01-2e6d43aa348d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:26:24.021589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cb244d-cce0-461d-ba01-2e6d43aa348d service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:26:24.030804 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1195/2405] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:26:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:26:25.082398 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af1b20-8f27-4b89-8081-6a272cc809fd None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:26:25.083926 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-44af1b20-8f27-4b89-8081-6a272cc809fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:26:25.095886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af1b20-8f27-4b89-8081-6a272cc809fd None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:26:25.101200 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c8d08-1aed-4c4b-9d5f-ca9b16d1f87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:26:25.101846 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c8d08-1aed-4c4b-9d5f-ca9b16d1f87c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:26:25.102141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c8d08-1aed-4c4b-9d5f-ca9b16d1f87c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:26:25.102424 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c8d08-1aed-4c4b-9d5f-ca9b16d1f87c admin admin] PATH_INFO: `/v3/projects/5f83009d754e4d39928f5d54b6c1f7b7` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:26:25.103821 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c8d08-1aed-4c4b-9d5f-ca9b16d1f87c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f83009d754e4d39928f5d54b6c1f7b7)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:26:25.105780 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c8d08-1aed-4c4b-9d5f-ca9b16d1f87c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:26:25.215477 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:26:25.218411 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e62c8d08-1aed-4c4b-9d5f-ca9b16d1f87c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f83009d754e4d39928f5d54b6c1f7b7', 'request_id': 'req-e62c8d08-1aed-4c4b-9d5f-ca9b16d1f87c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:26:25.224364 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e62c8d08-1aed-4c4b-9d5f-ca9b16d1f87c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f83009d754e4d39928f5d54b6c1f7b7', 'request_id': 'req-e62c8d08-1aed-4c4b-9d5f-ca9b16d1f87c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:26:25.230462 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e62c8d08-1aed-4c4b-9d5f-ca9b16d1f87c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f83009d754e4d39928f5d54b6c1f7b7', 'request_id': 'req-e62c8d08-1aed-4c4b-9d5f-ca9b16d1f87c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:26:25.308754 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e62c8d08-1aed-4c4b-9d5f-ca9b16d1f87c admin admin] The token cache is being invalidate because project 5f83009d754e4d39928f5d54b6c1f7b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:26:25.309039 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e62c8d08-1aed-4c4b-9d5f-ca9b16d1f87c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:26:25.309657 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e62c8d08-1aed-4c4b-9d5f-ca9b16d1f87c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:26:25.311137 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1211/2406] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:26:25 2022] DELETE /identity/v3/projects/5f83009d754e4d39928f5d54b6c1f7b7 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:26:25.316216 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718593c-dc71-47cf-bb97-241837311a41 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:26:25.316718 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718593c-dc71-47cf-bb97-241837311a41 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:26:25.316820 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718593c-dc71-47cf-bb97-241837311a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:26:25.336470 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-0718593c-dc71-47cf-bb97-241837311a41 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:26:25.337683 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-0718593c-dc71-47cf-bb97-241837311a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:26:25.355010 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:26:25.397797 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1196/2407] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:26:25.405827 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32e628-2861-4aed-9528-e480a5668386 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:26:25.406109 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32e628-2861-4aed-9528-e480a5668386 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:26:25.406384 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be32e628-2861-4aed-9528-e480a5668386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:26:25.428319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-be32e628-2861-4aed-9528-e480a5668386 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:26:25.429582 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-be32e628-2861-4aed-9528-e480a5668386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:26:25.437716 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1212/2408] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:26:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:26:25.441942 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718593c-dc71-47cf-bb97-241837311a41 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:26:25.451488 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718593c-dc71-47cf-bb97-241837311a41 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:26:25.456006 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7399f-5268-4f7b-8ade-c72c9af1ea28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:26:25.456640 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7399f-5268-4f7b-8ade-c72c9af1ea28 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:26:25.456919 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7399f-5268-4f7b-8ade-c72c9af1ea28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:26:25.457190 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7399f-5268-4f7b-8ade-c72c9af1ea28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:26:25.458324 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7399f-5268-4f7b-8ade-c72c9af1ea28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:26:25.458625 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7399f-5268-4f7b-8ade-c72c9af1ea28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:26:25.460237 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7399f-5268-4f7b-8ade-c72c9af1ea28 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:26:25.471561 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1197/2409] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:26:25.476337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32e628-2861-4aed-9528-e480a5668386 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:26:25.485462 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be32e628-2861-4aed-9528-e480a5668386 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:26:25.490222 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ecbea-ead5-4654-b012-de85da57018d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:26:25.490812 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ecbea-ead5-4654-b012-de85da57018d admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:26:25.491088 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ecbea-ead5-4654-b012-de85da57018d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:26:25.491357 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ecbea-ead5-4654-b012-de85da57018d admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:26:25.491989 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ecbea-ead5-4654-b012-de85da57018d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:26:25.493923 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ecbea-ead5-4654-b012-de85da57018d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:26:25.579720 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1213/2410] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:26:25 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:26:25.583960 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7399f-5268-4f7b-8ade-c72c9af1ea28 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:26:25.594272 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7399f-5268-4f7b-8ade-c72c9af1ea28 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:26:25.652249 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91855932-cf5f-4843-a5da-90f7581fa0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:26:25.652877 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91855932-cf5f-4843-a5da-90f7581fa0aa admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:26:25.653154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91855932-cf5f-4843-a5da-90f7581fa0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:26:25.653423 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91855932-cf5f-4843-a5da-90f7581fa0aa admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:26:25.654043 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91855932-cf5f-4843-a5da-90f7581fa0aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:26:25.656025 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91855932-cf5f-4843-a5da-90f7581fa0aa admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:26:25.737765 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1198/2411] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:26:25 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:26:25.741937 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ecbea-ead5-4654-b012-de85da57018d admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:26:25.752402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ecbea-ead5-4654-b012-de85da57018d admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:26:25.757949 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc82cb2-3088-4e0c-b89a-6cea22db0c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:26:25.758567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc82cb2-3088-4e0c-b89a-6cea22db0c22 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:26:25.758853 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc82cb2-3088-4e0c-b89a-6cea22db0c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:26:25.759130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc82cb2-3088-4e0c-b89a-6cea22db0c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:26:25.759782 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc82cb2-3088-4e0c-b89a-6cea22db0c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:26:25.762643 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc82cb2-3088-4e0c-b89a-6cea22db0c22 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:26:25.773533 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1214/2412] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:26:25.777611 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91855932-cf5f-4843-a5da-90f7581fa0aa admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:26:25.788012 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91855932-cf5f-4843-a5da-90f7581fa0aa admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:26:25.792704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578e61a1-865e-4143-9697-7679192485dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:26:25.793331 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e61a1-865e-4143-9697-7679192485dd admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:26:25.793611 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e61a1-865e-4143-9697-7679192485dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:26:25.793884 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578e61a1-865e-4143-9697-7679192485dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:26:25.794546 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e61a1-865e-4143-9697-7679192485dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:26:25.796512 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578e61a1-865e-4143-9697-7679192485dd admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:26:25.807082 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1199/2413] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:26:25.811185 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc82cb2-3088-4e0c-b89a-6cea22db0c22 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:26:25.821670 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc82cb2-3088-4e0c-b89a-6cea22db0c22 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:26:25.826519 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd542c-9e16-4ac4-9464-b9c5118daa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:26:25.827191 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd542c-9e16-4ac4-9464-b9c5118daa28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:26:25.827500 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd542c-9e16-4ac4-9464-b9c5118daa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:26:25.827794 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd542c-9e16-4ac4-9464-b9c5118daa28 admin admin] PATH_INFO: `/v3/projects/2f102a44af284806b5ea0d483d3dd4b7/users/b0c0bea470b44b26a2c26640a4dccc2f/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:26:25.843625 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd542c-9e16-4ac4-9464-b9c5118daa28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f102a44af284806b5ea0d483d3dd4b7, user_id=b0c0bea470b44b26a2c26640a4dccc2f, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:26:25.846308 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd542c-9e16-4ac4-9464-b9c5118daa28 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:26:25.932528 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1215/2414] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:26:25 2022] PUT /identity/v3/projects/2f102a44af284806b5ea0d483d3dd4b7/users/b0c0bea470b44b26a2c26640a4dccc2f/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:26:25.944542 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe36d6-0aba-4c18-953a-165d7361b8b6 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:26:25.944828 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe36d6-0aba-4c18-953a-165d7361b8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:26:25.945103 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe36d6-0aba-4c18-953a-165d7361b8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:26:25.973828 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-3bfe36d6-0aba-4c18-953a-165d7361b8b6 None None] MFA Rules not processed for user `b0c0bea470b44b26a2c26640a4dccc2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:26:25.975089 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-3bfe36d6-0aba-4c18-953a-165d7361b8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:26:26.045090 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1200/2415] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:26:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:26:26.056703 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd542c-9e16-4ac4-9464-b9c5118daa28 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:26:26.058517 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a2dd542c-9e16-4ac4-9464-b9c5118daa28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:26:26.116653 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd542c-9e16-4ac4-9464-b9c5118daa28 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:26:26.120334 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fcec8-5d10-4f74-a934-c6a5b100d538 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:26:26.120944 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fcec8-5d10-4f74-a934-c6a5b100d538 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:26:26.121230 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fcec8-5d10-4f74-a934-c6a5b100d538 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:26:26.121505 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fcec8-5d10-4f74-a934-c6a5b100d538 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:26:26.129766 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3fcec8-5d10-4f74-a934-c6a5b100d538 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:26:26.131226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3fcec8-5d10-4f74-a934-c6a5b100d538 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:26:26.140068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1216/2416] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:26:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:26:26.165921 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe36d6-0aba-4c18-953a-165d7361b8b6 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:26:26.184712 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:26:26.228757 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe36d6-0aba-4c18-953a-165d7361b8b6 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:26:26.233418 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1ed19-50e2-4a8d-bd20-900eb0474c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:26:26.234056 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1ed19-50e2-4a8d-bd20-900eb0474c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:26:26.234348 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1ed19-50e2-4a8d-bd20-900eb0474c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:26:26.234812 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1ed19-50e2-4a8d-bd20-900eb0474c2d admin admin] PATH_INFO: `/v3/users/b0c0bea470b44b26a2c26640a4dccc2f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:26:26.236355 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1ed19-50e2-4a8d-bd20-900eb0474c2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0c0bea470b44b26a2c26640a4dccc2f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:26:26.238271 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1ed19-50e2-4a8d-bd20-900eb0474c2d admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:26:26.380173 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-c3c1ed19-50e2-4a8d-bd20-900eb0474c2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0c0bea470b44b26a2c26640a4dccc2f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:26:26.440668 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-c3c1ed19-50e2-4a8d-bd20-900eb0474c2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0c0bea470b44b26a2c26640a4dccc2f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:26:26.456057 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-c3c1ed19-50e2-4a8d-bd20-900eb0474c2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0c0bea470b44b26a2c26640a4dccc2f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:26:26.457325 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-c3c1ed19-50e2-4a8d-bd20-900eb0474c2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0c0bea470b44b26a2c26640a4dccc2f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:26:26.469853 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-c3c1ed19-50e2-4a8d-bd20-900eb0474c2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0c0bea470b44b26a2c26640a4dccc2f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:26:26.477846 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1201/2417] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:26:26 2022] DELETE /identity/v3/users/b0c0bea470b44b26a2c26640a4dccc2f => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:26:26.482340 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95797f-d470-451c-b539-54f843ddf6df None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:26:26.485259 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95797f-d470-451c-b539-54f843ddf6df None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:26:26.485259 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab95797f-d470-451c-b539-54f843ddf6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:26:26.501345 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ab95797f-d470-451c-b539-54f843ddf6df None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:26:26.502681 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ab95797f-d470-451c-b539-54f843ddf6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:26:26.561956 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1217/2418] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:26:26.572585 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1ed19-50e2-4a8d-bd20-900eb0474c2d admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:26:26.574019 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c3c1ed19-50e2-4a8d-bd20-900eb0474c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:26:26.631752 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1ed19-50e2-4a8d-bd20-900eb0474c2d admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:26:26.635405 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1398d-e288-43a9-bca5-3f92ba948511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:26:26.636015 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1398d-e288-43a9-bca5-3f92ba948511 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:26:26.636322 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1398d-e288-43a9-bca5-3f92ba948511 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:26:26.636601 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1398d-e288-43a9-bca5-3f92ba948511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:26:26.646088 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1398d-e288-43a9-bca5-3f92ba948511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:26:26.650296 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1398d-e288-43a9-bca5-3f92ba948511 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:26:26.656898 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1202/2419] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:26:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:26:27.069532 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95797f-d470-451c-b539-54f843ddf6df None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:26:27.070964 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ab95797f-d470-451c-b539-54f843ddf6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:26:27.084175 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab95797f-d470-451c-b539-54f843ddf6df None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:26:27.091796 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54521031-e775-4065-90a9-dc62a83d1813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:26:27.091796 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54521031-e775-4065-90a9-dc62a83d1813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:26:27.091796 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54521031-e775-4065-90a9-dc62a83d1813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:26:27.091796 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54521031-e775-4065-90a9-dc62a83d1813 admin admin] PATH_INFO: `/v3/projects/2f102a44af284806b5ea0d483d3dd4b7` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:26:27.092316 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54521031-e775-4065-90a9-dc62a83d1813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f102a44af284806b5ea0d483d3dd4b7)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:26:27.094019 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54521031-e775-4065-90a9-dc62a83d1813 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:26:27.103636 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:26:27.231873 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-54521031-e775-4065-90a9-dc62a83d1813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f102a44af284806b5ea0d483d3dd4b7', 'request_id': 'req-54521031-e775-4065-90a9-dc62a83d1813'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:26:27.238584 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-54521031-e775-4065-90a9-dc62a83d1813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f102a44af284806b5ea0d483d3dd4b7', 'request_id': 'req-54521031-e775-4065-90a9-dc62a83d1813'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:26:27.255313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-54521031-e775-4065-90a9-dc62a83d1813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f102a44af284806b5ea0d483d3dd4b7', 'request_id': 'req-54521031-e775-4065-90a9-dc62a83d1813'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:26:27.267537 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e228e-f774-44db-b4b1-811f71e5bb64 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:26:27.267824 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e228e-f774-44db-b4b1-811f71e5bb64 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:26:27.268128 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37e228e-f774-44db-b4b1-811f71e5bb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:26:27.287498 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-e37e228e-f774-44db-b4b1-811f71e5bb64 None None] MFA Rules not processed for user `f3fabba09a4746328dcee545ff38cf78`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:26:27.288724 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e37e228e-f774-44db-b4b1-811f71e5bb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:26:27.321853 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:26:27.324035 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-54521031-e775-4065-90a9-dc62a83d1813 admin admin] The token cache is being invalidate because project 2f102a44af284806b5ea0d483d3dd4b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:26:27.324298 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-54521031-e775-4065-90a9-dc62a83d1813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:26:27.324926 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-54521031-e775-4065-90a9-dc62a83d1813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:26:27.326655 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1218/2420] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:26:27 2022] DELETE /identity/v3/projects/2f102a44af284806b5ea0d483d3dd4b7 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:26:27.344908 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1203/2421] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:26:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:26:37.320736 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:26:37.438665 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=7 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:26:51.829123 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d342c-5cc2-46d9-aef2-f659aa6b796a None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:26:51.829693 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d342c-5cc2-46d9-aef2-f659aa6b796a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:26:51.829791 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d342c-5cc2-46d9-aef2-f659aa6b796a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:26:51.849641 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-802d342c-5cc2-46d9-aef2-f659aa6b796a None None] MFA Rules not processed for user `7f06e823c4ad4725896e7452eecfcc4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:26:51.850868 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-802d342c-5cc2-46d9-aef2-f659aa6b796a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:26:51.906932 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1219/2422] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:26:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:27:01.898246 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=25 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:27:02.334991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fef96-ee5f-40a1-990d-746da3f0fa81 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:02.335599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fef96-ee5f-40a1-990d-746da3f0fa81 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:02.335599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fef96-ee5f-40a1-990d-746da3f0fa81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:02.355626 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-c67fef96-ee5f-40a1-990d-746da3f0fa81 None None] MFA Rules not processed for user `7ad886fd7cd445a18918965391eade77`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:27:02.356870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c67fef96-ee5f-40a1-990d-746da3f0fa81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:27:02.417796 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1204/2423] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:27:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:27:12.409316 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=25 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:27:38.055101 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d342c-5cc2-46d9-aef2-f659aa6b796a None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:38.056543 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-802d342c-5cc2-46d9-aef2-f659aa6b796a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:27:38.114050 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d342c-5cc2-46d9-aef2-f659aa6b796a None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:38.119176 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16e38d-90ae-404a-b3e2-bde4236e3efb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:38.119793 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16e38d-90ae-404a-b3e2-bde4236e3efb service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:38.120066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16e38d-90ae-404a-b3e2-bde4236e3efb service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:38.120485 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16e38d-90ae-404a-b3e2-bde4236e3efb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:38.122234 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-bc16e38d-90ae-404a-b3e2-bde4236e3efb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:27:38.189957 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16e38d-90ae-404a-b3e2-bde4236e3efb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:38.191319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc16e38d-90ae-404a-b3e2-bde4236e3efb service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:38.202201 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1220/2424] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:27:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:27:40.252361 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fef96-ee5f-40a1-990d-746da3f0fa81 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:40.254444 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-c67fef96-ee5f-40a1-990d-746da3f0fa81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:27:40.271462 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fef96-ee5f-40a1-990d-746da3f0fa81 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:40.275637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7313dd21-b690-41a5-870e-3c0036f26156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:40.276345 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313dd21-b690-41a5-870e-3c0036f26156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:40.276619 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313dd21-b690-41a5-870e-3c0036f26156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:40.276895 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7313dd21-b690-41a5-870e-3c0036f26156 admin admin] PATH_INFO: `/v3/users/f3fabba09a4746328dcee545ff38cf78` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:40.278027 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313dd21-b690-41a5-870e-3c0036f26156 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3fabba09a4746328dcee545ff38cf78)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:40.279941 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7313dd21-b690-41a5-870e-3c0036f26156 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:40.464794 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-7313dd21-b690-41a5-870e-3c0036f26156 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3fabba09a4746328dcee545ff38cf78'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:27:40.537035 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-7313dd21-b690-41a5-870e-3c0036f26156 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3fabba09a4746328dcee545ff38cf78'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:27:40.550697 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-7313dd21-b690-41a5-870e-3c0036f26156 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3fabba09a4746328dcee545ff38cf78'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:27:40.551372 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-7313dd21-b690-41a5-870e-3c0036f26156 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3fabba09a4746328dcee545ff38cf78'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:27:40.558565 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-7313dd21-b690-41a5-870e-3c0036f26156 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3fabba09a4746328dcee545ff38cf78'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:27:40.564609 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1205/2425] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:27:40 2022] DELETE /identity/v3/users/f3fabba09a4746328dcee545ff38cf78 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:27:40.797695 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16e38d-90ae-404a-b3e2-bde4236e3efb service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:40.809520 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16e38d-90ae-404a-b3e2-bde4236e3efb service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:40.877736 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cfc937-b427-493f-ba83-f3dc9885de1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:40.878437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfc937-b427-493f-ba83-f3dc9885de1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:40.878727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfc937-b427-493f-ba83-f3dc9885de1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:40.879007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cfc937-b427-493f-ba83-f3dc9885de1c admin admin] PATH_INFO: `/v3/projects/9d7eb586a5284df5b9bc2e10f80b98db` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:40.880167 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cfc937-b427-493f-ba83-f3dc9885de1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d7eb586a5284df5b9bc2e10f80b98db)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:40.882664 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cfc937-b427-493f-ba83-f3dc9885de1c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:40.982449 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-08cfc937-b427-493f-ba83-f3dc9885de1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d7eb586a5284df5b9bc2e10f80b98db', 'request_id': 'req-08cfc937-b427-493f-ba83-f3dc9885de1c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:27:40.984463 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:27:40.988186 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-08cfc937-b427-493f-ba83-f3dc9885de1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d7eb586a5284df5b9bc2e10f80b98db', 'request_id': 'req-08cfc937-b427-493f-ba83-f3dc9885de1c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:27:40.994241 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-08cfc937-b427-493f-ba83-f3dc9885de1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d7eb586a5284df5b9bc2e10f80b98db', 'request_id': 'req-08cfc937-b427-493f-ba83-f3dc9885de1c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:27:41.078245 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-08cfc937-b427-493f-ba83-f3dc9885de1c admin admin] The token cache is being invalidate because project 9d7eb586a5284df5b9bc2e10f80b98db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:27:41.078495 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-08cfc937-b427-493f-ba83-f3dc9885de1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:27:41.079100 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-08cfc937-b427-493f-ba83-f3dc9885de1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:27:41.080661 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1221/2426] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:27:40 2022] DELETE /identity/v3/projects/9d7eb586a5284df5b9bc2e10f80b98db => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:27:41.086162 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302edb6-eb0b-431a-9b79-fb6d01f2bf14 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:41.086454 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302edb6-eb0b-431a-9b79-fb6d01f2bf14 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:41.086734 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7302edb6-eb0b-431a-9b79-fb6d01f2bf14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:41.106625 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-7302edb6-eb0b-431a-9b79-fb6d01f2bf14 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:27:41.107825 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7302edb6-eb0b-431a-9b79-fb6d01f2bf14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:27:41.165524 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1206/2427] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:27:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:27:41.173328 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc4a0e-8d99-47f4-be9d-3b809e53263c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:41.173618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc4a0e-8d99-47f4-be9d-3b809e53263c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:41.173895 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc4a0e-8d99-47f4-be9d-3b809e53263c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:41.194584 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-35cc4a0e-8d99-47f4-be9d-3b809e53263c None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:27:41.196011 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-35cc4a0e-8d99-47f4-be9d-3b809e53263c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:27:41.203936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1222/2428] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:27:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:27:41.208479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302edb6-eb0b-431a-9b79-fb6d01f2bf14 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:41.220446 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7302edb6-eb0b-431a-9b79-fb6d01f2bf14 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:41.231133 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38615e1d-6345-4d94-bfa0-2e4360360186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:41.231760 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38615e1d-6345-4d94-bfa0-2e4360360186 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:41.232047 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38615e1d-6345-4d94-bfa0-2e4360360186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:41.238510 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38615e1d-6345-4d94-bfa0-2e4360360186 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:41.238510 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38615e1d-6345-4d94-bfa0-2e4360360186 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:27:41.238510 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38615e1d-6345-4d94-bfa0-2e4360360186 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:41.238510 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38615e1d-6345-4d94-bfa0-2e4360360186 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:41.247636 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1207/2429] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:27:41.252063 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc4a0e-8d99-47f4-be9d-3b809e53263c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:41.262036 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc4a0e-8d99-47f4-be9d-3b809e53263c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:41.266819 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595443b3-a60f-48ad-8d5b-d57b60032f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:41.267431 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595443b3-a60f-48ad-8d5b-d57b60032f4f admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:41.267712 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595443b3-a60f-48ad-8d5b-d57b60032f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:41.267987 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595443b3-a60f-48ad-8d5b-d57b60032f4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:41.268659 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595443b3-a60f-48ad-8d5b-d57b60032f4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:41.270557 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595443b3-a60f-48ad-8d5b-d57b60032f4f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:41.360580 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1223/2430] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:27:41 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:27:41.364732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38615e1d-6345-4d94-bfa0-2e4360360186 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:41.375706 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38615e1d-6345-4d94-bfa0-2e4360360186 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:41.435820 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c87a8-8adc-4513-a86d-2beaccddd91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:41.436532 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c87a8-8adc-4513-a86d-2beaccddd91a admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:41.436738 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c87a8-8adc-4513-a86d-2beaccddd91a admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:41.437019 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6c87a8-8adc-4513-a86d-2beaccddd91a admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:41.437644 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c87a8-8adc-4513-a86d-2beaccddd91a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:41.439586 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6c87a8-8adc-4513-a86d-2beaccddd91a admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:41.448047 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:27:41.525163 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1208/2431] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:27:41 2022] POST /identity/v3/users => generated 293 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:27:41.529244 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595443b3-a60f-48ad-8d5b-d57b60032f4f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:41.539703 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595443b3-a60f-48ad-8d5b-d57b60032f4f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:41.544401 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2f479-8710-44a9-b6a6-e014cd18956b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:41.545258 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2f479-8710-44a9-b6a6-e014cd18956b admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:41.545534 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2f479-8710-44a9-b6a6-e014cd18956b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:41.545814 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e2f479-8710-44a9-b6a6-e014cd18956b admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:41.546475 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e2f479-8710-44a9-b6a6-e014cd18956b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:41.548050 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e2f479-8710-44a9-b6a6-e014cd18956b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:41.558763 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1224/2432] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:27:41.562856 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c87a8-8adc-4513-a86d-2beaccddd91a admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:41.573636 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6c87a8-8adc-4513-a86d-2beaccddd91a admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:41.578808 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c7192-1885-4154-9851-2d2a25d823d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:41.579409 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c7192-1885-4154-9851-2d2a25d823d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:41.579690 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c7192-1885-4154-9851-2d2a25d823d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:41.579964 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c7192-1885-4154-9851-2d2a25d823d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:41.580636 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c7192-1885-4154-9851-2d2a25d823d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:41.582226 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c7192-1885-4154-9851-2d2a25d823d6 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:41.592829 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1209/2433] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:27:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:27:41.597114 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2f479-8710-44a9-b6a6-e014cd18956b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:41.607133 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e2f479-8710-44a9-b6a6-e014cd18956b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:41.611842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f525c5-92a9-4277-9ec9-6a91d09c3688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:41.612468 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f525c5-92a9-4277-9ec9-6a91d09c3688 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:41.612744 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f525c5-92a9-4277-9ec9-6a91d09c3688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:41.613016 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f525c5-92a9-4277-9ec9-6a91d09c3688 admin admin] PATH_INFO: `/v3/projects/4c64b23a34ac47fc8b059a524b2cfed8/users/830af85867da4467980f1a7f9206f519/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:41.627917 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f525c5-92a9-4277-9ec9-6a91d09c3688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c64b23a34ac47fc8b059a524b2cfed8, user_id=830af85867da4467980f1a7f9206f519, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:41.630562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f525c5-92a9-4277-9ec9-6a91d09c3688 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:41.696881 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1225/2434] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:27:41 2022] PUT /identity/v3/projects/4c64b23a34ac47fc8b059a524b2cfed8/users/830af85867da4467980f1a7f9206f519/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:27:41.707135 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed9480-5f36-4f1c-811d-1c03afd0cdb7 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:41.707427 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed9480-5f36-4f1c-811d-1c03afd0cdb7 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:41.707754 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deed9480-5f36-4f1c-811d-1c03afd0cdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:41.736644 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-deed9480-5f36-4f1c-811d-1c03afd0cdb7 None None] MFA Rules not processed for user `830af85867da4467980f1a7f9206f519`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:27:41.737860 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-deed9480-5f36-4f1c-811d-1c03afd0cdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:27:41.807095 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1210/2435] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:27:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:27:41.818692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f525c5-92a9-4277-9ec9-6a91d09c3688 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:41.821006 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-17f525c5-92a9-4277-9ec9-6a91d09c3688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:27:41.895653 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f525c5-92a9-4277-9ec9-6a91d09c3688 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:41.901439 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca66f193-60ad-4c29-8414-1d716b056a7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:41.902055 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66f193-60ad-4c29-8414-1d716b056a7f service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:41.902338 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66f193-60ad-4c29-8414-1d716b056a7f service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:41.902615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca66f193-60ad-4c29-8414-1d716b056a7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:41.910457 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca66f193-60ad-4c29-8414-1d716b056a7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:41.912058 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca66f193-60ad-4c29-8414-1d716b056a7f service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:41.921714 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1226/2436] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:27:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:27:48.107926 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed9480-5f36-4f1c-811d-1c03afd0cdb7 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:48.170630 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deed9480-5f36-4f1c-811d-1c03afd0cdb7 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:48.175167 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be604ea-3bb2-4720-a875-7e282caacb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:48.175801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be604ea-3bb2-4720-a875-7e282caacb11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:48.176082 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be604ea-3bb2-4720-a875-7e282caacb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:48.176385 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be604ea-3bb2-4720-a875-7e282caacb11 admin admin] PATH_INFO: `/v3/users/830af85867da4467980f1a7f9206f519` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:48.177510 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be604ea-3bb2-4720-a875-7e282caacb11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=830af85867da4467980f1a7f9206f519)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:48.179954 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be604ea-3bb2-4720-a875-7e282caacb11 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:48.348279 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9be604ea-3bb2-4720-a875-7e282caacb11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '830af85867da4467980f1a7f9206f519'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:27:48.421970 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9be604ea-3bb2-4720-a875-7e282caacb11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '830af85867da4467980f1a7f9206f519'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:27:48.433986 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:27:48.435305 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9be604ea-3bb2-4720-a875-7e282caacb11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '830af85867da4467980f1a7f9206f519'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:27:48.435982 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9be604ea-3bb2-4720-a875-7e282caacb11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '830af85867da4467980f1a7f9206f519'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:27:48.442862 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9be604ea-3bb2-4720-a875-7e282caacb11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '830af85867da4467980f1a7f9206f519'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:27:48.450005 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1211/2437] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:27:48 2022] DELETE /identity/v3/users/830af85867da4467980f1a7f9206f519 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:27:48.454600 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fdf4de-dbba-408b-8d2b-1f1b5c90251b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:48.455120 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fdf4de-dbba-408b-8d2b-1f1b5c90251b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:48.455237 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fdf4de-dbba-408b-8d2b-1f1b5c90251b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:48.474592 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-25fdf4de-dbba-408b-8d2b-1f1b5c90251b None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:27:48.475812 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-25fdf4de-dbba-408b-8d2b-1f1b5c90251b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:27:48.542456 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1227/2438] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:27:48.555645 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be604ea-3bb2-4720-a875-7e282caacb11 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:48.557114 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-9be604ea-3bb2-4720-a875-7e282caacb11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:27:48.618223 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be604ea-3bb2-4720-a875-7e282caacb11 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:48.622112 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9453254-e007-48ad-9d6d-31398fce537d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:48.622726 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9453254-e007-48ad-9d6d-31398fce537d service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:48.623003 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9453254-e007-48ad-9d6d-31398fce537d service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:48.623274 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9453254-e007-48ad-9d6d-31398fce537d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:48.633003 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9453254-e007-48ad-9d6d-31398fce537d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:48.634428 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9453254-e007-48ad-9d6d-31398fce537d service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:48.644057 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1212/2439] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:27:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:27:49.072244 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fdf4de-dbba-408b-8d2b-1f1b5c90251b None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:49.073686 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-25fdf4de-dbba-408b-8d2b-1f1b5c90251b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:27:49.082076 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:27:49.087917 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fdf4de-dbba-408b-8d2b-1f1b5c90251b None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:49.092801 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5518c-6695-4007-bbe1-fa97809ec885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:49.093451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5518c-6695-4007-bbe1-fa97809ec885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:49.093737 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5518c-6695-4007-bbe1-fa97809ec885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:49.094017 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5518c-6695-4007-bbe1-fa97809ec885 admin admin] PATH_INFO: `/v3/projects/4c64b23a34ac47fc8b059a524b2cfed8` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:49.095956 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5518c-6695-4007-bbe1-fa97809ec885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c64b23a34ac47fc8b059a524b2cfed8)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:49.097125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5518c-6695-4007-bbe1-fa97809ec885 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:49.214800 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6db5518c-6695-4007-bbe1-fa97809ec885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c64b23a34ac47fc8b059a524b2cfed8', 'request_id': 'req-6db5518c-6695-4007-bbe1-fa97809ec885'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:27:49.220221 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6db5518c-6695-4007-bbe1-fa97809ec885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c64b23a34ac47fc8b059a524b2cfed8', 'request_id': 'req-6db5518c-6695-4007-bbe1-fa97809ec885'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:27:49.228570 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6db5518c-6695-4007-bbe1-fa97809ec885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c64b23a34ac47fc8b059a524b2cfed8', 'request_id': 'req-6db5518c-6695-4007-bbe1-fa97809ec885'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:27:49.332828 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6db5518c-6695-4007-bbe1-fa97809ec885 admin admin] The token cache is being invalidate because project 4c64b23a34ac47fc8b059a524b2cfed8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:27:49.333052 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6db5518c-6695-4007-bbe1-fa97809ec885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:27:49.333652 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6db5518c-6695-4007-bbe1-fa97809ec885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:27:49.335732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1228/2440] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:27:49 2022] DELETE /identity/v3/projects/4c64b23a34ac47fc8b059a524b2cfed8 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:27:49.340853 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814664d-38ab-43c3-9eec-fee477c4a64f None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:49.341484 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814664d-38ab-43c3-9eec-fee477c4a64f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:49.341484 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f814664d-38ab-43c3-9eec-fee477c4a64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:49.361405 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f814664d-38ab-43c3-9eec-fee477c4a64f None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:27:49.362600 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f814664d-38ab-43c3-9eec-fee477c4a64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:27:49.424872 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1213/2441] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:27:49.432865 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233dbcb-f1aa-479d-8491-1a009a558d55 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:49.433241 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233dbcb-f1aa-479d-8491-1a009a558d55 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:49.433620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b233dbcb-f1aa-479d-8491-1a009a558d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:49.453717 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-b233dbcb-f1aa-479d-8491-1a009a558d55 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:27:49.454938 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b233dbcb-f1aa-479d-8491-1a009a558d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:27:49.463715 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1229/2442] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:27:49.468031 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814664d-38ab-43c3-9eec-fee477c4a64f None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:49.478202 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f814664d-38ab-43c3-9eec-fee477c4a64f None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:49.482744 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd47d7-bd04-42e1-a2ec-043f7469dc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:49.483336 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd47d7-bd04-42e1-a2ec-043f7469dc38 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:49.483614 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd47d7-bd04-42e1-a2ec-043f7469dc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:49.483887 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcd47d7-bd04-42e1-a2ec-043f7469dc38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:49.484552 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd47d7-bd04-42e1-a2ec-043f7469dc38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:27:49.484854 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd47d7-bd04-42e1-a2ec-043f7469dc38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:49.486470 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcd47d7-bd04-42e1-a2ec-043f7469dc38 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:49.498460 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1214/2443] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:27:49.503185 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233dbcb-f1aa-479d-8491-1a009a558d55 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:49.513445 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b233dbcb-f1aa-479d-8491-1a009a558d55 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:49.518613 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752b481-0bca-4335-9406-bb60f7244192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:49.519242 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752b481-0bca-4335-9406-bb60f7244192 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:49.519514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752b481-0bca-4335-9406-bb60f7244192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:49.519763 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752b481-0bca-4335-9406-bb60f7244192 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:49.520459 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752b481-0bca-4335-9406-bb60f7244192 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:49.523077 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752b481-0bca-4335-9406-bb60f7244192 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:49.625946 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1230/2444] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:27:49 2022] POST /identity/v3/projects => generated 375 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:27:49.630378 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd47d7-bd04-42e1-a2ec-043f7469dc38 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:49.642251 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcd47d7-bd04-42e1-a2ec-043f7469dc38 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:49.699714 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79706101-ff02-4500-baff-2015d9c47b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:49.700265 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79706101-ff02-4500-baff-2015d9c47b5d admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:49.700600 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79706101-ff02-4500-baff-2015d9c47b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:49.700886 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79706101-ff02-4500-baff-2015d9c47b5d admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:49.701516 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79706101-ff02-4500-baff-2015d9c47b5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:49.703439 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79706101-ff02-4500-baff-2015d9c47b5d admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:49.799669 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1215/2445] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:27:49 2022] POST /identity/v3/users => generated 288 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:27:49.804746 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752b481-0bca-4335-9406-bb60f7244192 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:49.815163 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752b481-0bca-4335-9406-bb60f7244192 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:49.820594 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e435a8-8fa9-40e6-8038-06f72f1c3d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:49.821199 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e435a8-8fa9-40e6-8038-06f72f1c3d40 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:49.821477 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e435a8-8fa9-40e6-8038-06f72f1c3d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:49.821881 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e435a8-8fa9-40e6-8038-06f72f1c3d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:49.822525 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e435a8-8fa9-40e6-8038-06f72f1c3d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:49.824136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e435a8-8fa9-40e6-8038-06f72f1c3d40 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:49.834453 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1231/2446] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:27:49.838610 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79706101-ff02-4500-baff-2015d9c47b5d admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:49.848823 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79706101-ff02-4500-baff-2015d9c47b5d admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:49.853627 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e7305c-88fb-4a7c-bc5b-4f0cdd2d33f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:49.854251 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7305c-88fb-4a7c-bc5b-4f0cdd2d33f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:49.854672 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7305c-88fb-4a7c-bc5b-4f0cdd2d33f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:49.854813 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e7305c-88fb-4a7c-bc5b-4f0cdd2d33f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:49.855454 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7305c-88fb-4a7c-bc5b-4f0cdd2d33f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:49.857277 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e7305c-88fb-4a7c-bc5b-4f0cdd2d33f0 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:49.866466 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:27:49.869359 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1216/2447] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:27:49.873606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e435a8-8fa9-40e6-8038-06f72f1c3d40 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:49.891375 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e435a8-8fa9-40e6-8038-06f72f1c3d40 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:49.893299 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a95984-fa6b-47a8-b0c9-0eabef59c85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:49.894023 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a95984-fa6b-47a8-b0c9-0eabef59c85e admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:49.894304 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a95984-fa6b-47a8-b0c9-0eabef59c85e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:49.894578 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a95984-fa6b-47a8-b0c9-0eabef59c85e admin admin] PATH_INFO: `/v3/projects/2a1801fac5124ca094c533579c44cf2c/users/0847e14592fd41869dbce0248e60264b/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:49.911366 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a95984-fa6b-47a8-b0c9-0eabef59c85e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a1801fac5124ca094c533579c44cf2c, user_id=0847e14592fd41869dbce0248e60264b, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:49.914414 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a95984-fa6b-47a8-b0c9-0eabef59c85e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:50.033555 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1232/2448] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:27:49 2022] PUT /identity/v3/projects/2a1801fac5124ca094c533579c44cf2c/users/0847e14592fd41869dbce0248e60264b/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:27:50.044683 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec6b55-030d-454c-8bc9-66fd0ddd7378 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:50.045220 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec6b55-030d-454c-8bc9-66fd0ddd7378 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:50.045641 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec6b55-030d-454c-8bc9-66fd0ddd7378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:50.074403 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-2aec6b55-030d-454c-8bc9-66fd0ddd7378 None None] MFA Rules not processed for user `0847e14592fd41869dbce0248e60264b`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:27:50.075600 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-2aec6b55-030d-454c-8bc9-66fd0ddd7378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:27:50.139568 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1217/2449] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:27:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:27:50.150802 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a95984-fa6b-47a8-b0c9-0eabef59c85e admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:50.152503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-23a95984-fa6b-47a8-b0c9-0eabef59c85e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:27:50.225928 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a95984-fa6b-47a8-b0c9-0eabef59c85e admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:50.231615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e3314-ebe7-4239-bc69-e79d6163cd64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:50.232248 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e3314-ebe7-4239-bc69-e79d6163cd64 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:50.232533 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e3314-ebe7-4239-bc69-e79d6163cd64 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:50.232804 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e3314-ebe7-4239-bc69-e79d6163cd64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:50.241243 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29e3314-ebe7-4239-bc69-e79d6163cd64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:50.242910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29e3314-ebe7-4239-bc69-e79d6163cd64 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:50.251996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1233/2450] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:27:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:27:50.467692 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec6b55-030d-454c-8bc9-66fd0ddd7378 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:50.529657 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec6b55-030d-454c-8bc9-66fd0ddd7378 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:50.534148 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c9a45-3b87-469f-b5c3-881ab2f4c0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:50.534769 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c9a45-3b87-469f-b5c3-881ab2f4c0b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:50.535048 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c9a45-3b87-469f-b5c3-881ab2f4c0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:50.535321 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7c9a45-3b87-469f-b5c3-881ab2f4c0b1 admin admin] PATH_INFO: `/v3/users/0847e14592fd41869dbce0248e60264b` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:50.536451 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c9a45-3b87-469f-b5c3-881ab2f4c0b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0847e14592fd41869dbce0248e60264b)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:50.539169 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7c9a45-3b87-469f-b5c3-881ab2f4c0b1 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:50.745025 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1e7c9a45-3b87-469f-b5c3-881ab2f4c0b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0847e14592fd41869dbce0248e60264b'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:27:50.830399 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1e7c9a45-3b87-469f-b5c3-881ab2f4c0b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0847e14592fd41869dbce0248e60264b'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:27:50.843599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1e7c9a45-3b87-469f-b5c3-881ab2f4c0b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0847e14592fd41869dbce0248e60264b'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:27:50.844291 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1e7c9a45-3b87-469f-b5c3-881ab2f4c0b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0847e14592fd41869dbce0248e60264b'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:27:50.851255 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-1e7c9a45-3b87-469f-b5c3-881ab2f4c0b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0847e14592fd41869dbce0248e60264b'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:27:50.857332 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1218/2451] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:27:50 2022] DELETE /identity/v3/users/0847e14592fd41869dbce0248e60264b => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:27:50.861836 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3c928-bd87-4201-9424-75d46d6ebab2 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:50.862300 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3c928-bd87-4201-9424-75d46d6ebab2 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:50.862426 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e3c928-bd87-4201-9424-75d46d6ebab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:50.882042 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:27:50.888080 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-89e3c928-bd87-4201-9424-75d46d6ebab2 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:27:50.889312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-89e3c928-bd87-4201-9424-75d46d6ebab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:27:50.950210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1234/2452] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:27:50.960755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c9a45-3b87-469f-b5c3-881ab2f4c0b1 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:50.962621 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1e7c9a45-3b87-469f-b5c3-881ab2f4c0b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:27:50.969853 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:27:51.022795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7c9a45-3b87-469f-b5c3-881ab2f4c0b1 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:51.026325 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c83b78-3747-477f-8625-99e14229020e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:51.026941 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c83b78-3747-477f-8625-99e14229020e service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:51.027225 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c83b78-3747-477f-8625-99e14229020e service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:51.027501 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c83b78-3747-477f-8625-99e14229020e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:51.037017 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c83b78-3747-477f-8625-99e14229020e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:51.038457 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c83b78-3747-477f-8625-99e14229020e service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:51.048589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1219/2453] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:27:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:27:51.538338 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3c928-bd87-4201-9424-75d46d6ebab2 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:51.539760 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-89e3c928-bd87-4201-9424-75d46d6ebab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:27:51.552388 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e3c928-bd87-4201-9424-75d46d6ebab2 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:51.557834 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77029a0f-d6cb-4026-976f-c5f3236cef9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:51.558423 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77029a0f-d6cb-4026-976f-c5f3236cef9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:51.558866 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77029a0f-d6cb-4026-976f-c5f3236cef9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:51.559154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77029a0f-d6cb-4026-976f-c5f3236cef9c admin admin] PATH_INFO: `/v3/projects/2a1801fac5124ca094c533579c44cf2c` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:51.560331 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77029a0f-d6cb-4026-976f-c5f3236cef9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a1801fac5124ca094c533579c44cf2c)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:51.562392 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77029a0f-d6cb-4026-976f-c5f3236cef9c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:51.682670 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-77029a0f-d6cb-4026-976f-c5f3236cef9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a1801fac5124ca094c533579c44cf2c', 'request_id': 'req-77029a0f-d6cb-4026-976f-c5f3236cef9c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:27:51.688491 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-77029a0f-d6cb-4026-976f-c5f3236cef9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a1801fac5124ca094c533579c44cf2c', 'request_id': 'req-77029a0f-d6cb-4026-976f-c5f3236cef9c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:27:51.695421 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-77029a0f-d6cb-4026-976f-c5f3236cef9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a1801fac5124ca094c533579c44cf2c', 'request_id': 'req-77029a0f-d6cb-4026-976f-c5f3236cef9c'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:27:51.764355 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-77029a0f-d6cb-4026-976f-c5f3236cef9c admin admin] The token cache is being invalidate because project 2a1801fac5124ca094c533579c44cf2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:27:51.764608 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-77029a0f-d6cb-4026-976f-c5f3236cef9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:27:51.765276 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-77029a0f-d6cb-4026-976f-c5f3236cef9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:27:51.766771 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1235/2454] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:27:51 2022] DELETE /identity/v3/projects/2a1801fac5124ca094c533579c44cf2c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:27:51.772601 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de666bfe-9a31-4f9f-9739-fc7ff24787bd None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:51.773184 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de666bfe-9a31-4f9f-9739-fc7ff24787bd None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:51.773184 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de666bfe-9a31-4f9f-9739-fc7ff24787bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:51.792668 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-de666bfe-9a31-4f9f-9739-fc7ff24787bd None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:27:51.793971 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-de666bfe-9a31-4f9f-9739-fc7ff24787bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:27:51.853616 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1220/2455] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:27:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:27:51.862695 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef728b-969a-4c6b-ac87-7ce81e4e59d3 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:51.863234 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef728b-969a-4c6b-ac87-7ce81e4e59d3 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:51.863234 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef728b-969a-4c6b-ac87-7ce81e4e59d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:51.883611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-16ef728b-969a-4c6b-ac87-7ce81e4e59d3 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:27:51.884842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-16ef728b-969a-4c6b-ac87-7ce81e4e59d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:27:51.892641 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1236/2456] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:27:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:27:51.897469 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de666bfe-9a31-4f9f-9739-fc7ff24787bd None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:51.907298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de666bfe-9a31-4f9f-9739-fc7ff24787bd None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:51.912041 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d0417-10a2-4e8c-b3a9-a0f1f937a572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:51.912663 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d0417-10a2-4e8c-b3a9-a0f1f937a572 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:51.912942 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d0417-10a2-4e8c-b3a9-a0f1f937a572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:51.913214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d0417-10a2-4e8c-b3a9-a0f1f937a572 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:51.913859 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d0417-10a2-4e8c-b3a9-a0f1f937a572 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:27:51.914162 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d0417-10a2-4e8c-b3a9-a0f1f937a572 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:51.915787 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d0417-10a2-4e8c-b3a9-a0f1f937a572 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:51.927848 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1221/2457] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:27:51.932871 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef728b-969a-4c6b-ac87-7ce81e4e59d3 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:51.942268 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef728b-969a-4c6b-ac87-7ce81e4e59d3 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:51.950373 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4f86a-155a-4dcb-9490-9bc07e6d0eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:51.950979 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4f86a-155a-4dcb-9490-9bc07e6d0eed admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:51.951258 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4f86a-155a-4dcb-9490-9bc07e6d0eed admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:51.951527 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4f86a-155a-4dcb-9490-9bc07e6d0eed admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:51.952230 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4f86a-155a-4dcb-9490-9bc07e6d0eed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:51.954176 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4f86a-155a-4dcb-9490-9bc07e6d0eed admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:52.055573 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1237/2458] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:27:51 2022] POST /identity/v3/projects => generated 363 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:27:52.059621 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d0417-10a2-4e8c-b3a9-a0f1f937a572 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:52.071184 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d0417-10a2-4e8c-b3a9-a0f1f937a572 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:52.126020 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f40f65-784e-4da7-8e4e-e5e14d76aee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:52.126543 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f40f65-784e-4da7-8e4e-e5e14d76aee6 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:52.126822 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f40f65-784e-4da7-8e4e-e5e14d76aee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:52.127098 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f40f65-784e-4da7-8e4e-e5e14d76aee6 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:52.127731 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f40f65-784e-4da7-8e4e-e5e14d76aee6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:52.129688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f40f65-784e-4da7-8e4e-e5e14d76aee6 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:52.235996 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1222/2459] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:27:52 2022] POST /identity/v3/users => generated 282 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:27:52.240157 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4f86a-155a-4dcb-9490-9bc07e6d0eed admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:52.251158 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4f86a-155a-4dcb-9490-9bc07e6d0eed admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:52.256036 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591fd533-7430-4b91-ba1c-a68cf33f2f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:52.257350 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fd533-7430-4b91-ba1c-a68cf33f2f97 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:52.257558 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fd533-7430-4b91-ba1c-a68cf33f2f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:52.257824 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fd533-7430-4b91-ba1c-a68cf33f2f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:52.258463 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591fd533-7430-4b91-ba1c-a68cf33f2f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:52.260021 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591fd533-7430-4b91-ba1c-a68cf33f2f97 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:52.271053 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1238/2460] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:27:52.274931 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f40f65-784e-4da7-8e4e-e5e14d76aee6 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:52.284998 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f40f65-784e-4da7-8e4e-e5e14d76aee6 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:52.290736 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46246da-5049-4198-8cf0-048854fa1e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:52.291352 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46246da-5049-4198-8cf0-048854fa1e38 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:52.291641 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46246da-5049-4198-8cf0-048854fa1e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:52.291919 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46246da-5049-4198-8cf0-048854fa1e38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:52.292592 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46246da-5049-4198-8cf0-048854fa1e38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:52.294192 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46246da-5049-4198-8cf0-048854fa1e38 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:52.306069 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1223/2461] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:27:52.310670 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591fd533-7430-4b91-ba1c-a68cf33f2f97 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:52.320819 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591fd533-7430-4b91-ba1c-a68cf33f2f97 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:52.325710 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bcf46-b295-4464-8cc1-bb442941876a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:52.326384 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bcf46-b295-4464-8cc1-bb442941876a admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:52.326660 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bcf46-b295-4464-8cc1-bb442941876a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:52.326935 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bcf46-b295-4464-8cc1-bb442941876a admin admin] PATH_INFO: `/v3/projects/9b26e670cc994f5faaed68452bde07d4/users/2698570344d8493b97aaad4aa7fd70f2/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:52.341840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46bcf46-b295-4464-8cc1-bb442941876a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b26e670cc994f5faaed68452bde07d4, user_id=2698570344d8493b97aaad4aa7fd70f2, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:52.344533 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46bcf46-b295-4464-8cc1-bb442941876a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:52.441989 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1239/2462] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:27:52 2022] PUT /identity/v3/projects/9b26e670cc994f5faaed68452bde07d4/users/2698570344d8493b97aaad4aa7fd70f2/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:27:52.452245 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0db66-ee70-4b14-81d4-dba0f9a3e9b6 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:52.452534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0db66-ee70-4b14-81d4-dba0f9a3e9b6 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:52.452808 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0db66-ee70-4b14-81d4-dba0f9a3e9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:52.477953 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:27:52.480926 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-76d0db66-ee70-4b14-81d4-dba0f9a3e9b6 None None] MFA Rules not processed for user `2698570344d8493b97aaad4aa7fd70f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:27:52.482140 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-76d0db66-ee70-4b14-81d4-dba0f9a3e9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:27:52.546369 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1224/2463] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:27:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:27:52.550867 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bcf46-b295-4464-8cc1-bb442941876a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:52.580389 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:27:52.612452 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bcf46-b295-4464-8cc1-bb442941876a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:52.617734 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7d26a-ae26-4eb7-abb5-1c9387cb6e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:52.618337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7d26a-ae26-4eb7-abb5-1c9387cb6e81 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:52.618618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7d26a-ae26-4eb7-abb5-1c9387cb6e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:52.618905 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c7d26a-ae26-4eb7-abb5-1c9387cb6e81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:52.619528 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c7d26a-ae26-4eb7-abb5-1c9387cb6e81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:52.621434 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c7d26a-ae26-4eb7-abb5-1c9387cb6e81 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:52.751655 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1240/2464] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:27:52 2022] POST /identity/v3/projects => generated 365 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:27:52.755670 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0db66-ee70-4b14-81d4-dba0f9a3e9b6 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:52.766352 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0db66-ee70-4b14-81d4-dba0f9a3e9b6 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:52.822567 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46bd022-e361-40f0-ab46-160be868c6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:52.823232 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bd022-e361-40f0-ab46-160be868c6bb admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:52.823506 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bd022-e361-40f0-ab46-160be868c6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:52.823779 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46bd022-e361-40f0-ab46-160be868c6bb admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:52.824450 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46bd022-e361-40f0-ab46-160be868c6bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:52.826355 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46bd022-e361-40f0-ab46-160be868c6bb admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:52.937122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1225/2465] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:27:52 2022] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:27:52.941130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7d26a-ae26-4eb7-abb5-1c9387cb6e81 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:52.951989 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c7d26a-ae26-4eb7-abb5-1c9387cb6e81 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:52.957152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29028341-ca8d-45db-87e6-fed5c7d13a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:52.957699 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46bd022-e361-40f0-ab46-160be868c6bb admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:52.957856 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29028341-ca8d-45db-87e6-fed5c7d13a1a admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:52.958070 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29028341-ca8d-45db-87e6-fed5c7d13a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:52.958339 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29028341-ca8d-45db-87e6-fed5c7d13a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:52.958982 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29028341-ca8d-45db-87e6-fed5c7d13a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:52.960071 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d46bd022-e361-40f0-ab46-160be868c6bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:27:52.961073 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29028341-ca8d-45db-87e6-fed5c7d13a1a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:52.978458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1241/2466] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:27:52.980314 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29028341-ca8d-45db-87e6-fed5c7d13a1a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:52.990250 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29028341-ca8d-45db-87e6-fed5c7d13a1a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:52.994989 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8b4f5-5b50-41ec-8b3a-1384064fac88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:52.995653 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8b4f5-5b50-41ec-8b3a-1384064fac88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:52.995935 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8b4f5-5b50-41ec-8b3a-1384064fac88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:52.996255 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8b4f5-5b50-41ec-8b3a-1384064fac88 admin admin] PATH_INFO: `/v3/projects/b4c5c32c3b064fc5948ba890e0801438/users/53fd2c1d45bf42c5828193df44b8993c/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:53.014389 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8b4f5-5b50-41ec-8b3a-1384064fac88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4c5c32c3b064fc5948ba890e0801438, user_id=53fd2c1d45bf42c5828193df44b8993c, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:53.014688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8b4f5-5b50-41ec-8b3a-1384064fac88 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:53.020218 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46bd022-e361-40f0-ab46-160be868c6bb admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:53.024415 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7500dc-3478-4572-b23d-8026c235e086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:53.025016 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7500dc-3478-4572-b23d-8026c235e086 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:53.025295 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7500dc-3478-4572-b23d-8026c235e086 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:53.025569 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7500dc-3478-4572-b23d-8026c235e086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:53.027373 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7d7500dc-3478-4572-b23d-8026c235e086 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:27:53.074099 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:27:53.099240 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7500dc-3478-4572-b23d-8026c235e086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:53.100818 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7500dc-3478-4572-b23d-8026c235e086 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:53.112271 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1226/2467] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:27:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:27:53.165482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1242/2468] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:27:52 2022] PUT /identity/v3/projects/b4c5c32c3b064fc5948ba890e0801438/users/53fd2c1d45bf42c5828193df44b8993c/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:27:53.169857 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7500dc-3478-4572-b23d-8026c235e086 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:53.182919 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7500dc-3478-4572-b23d-8026c235e086 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:53.238998 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a020fda-06d3-41ea-a3d4-433bb73ec7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:53.242666 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a020fda-06d3-41ea-a3d4-433bb73ec7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:53.242666 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a020fda-06d3-41ea-a3d4-433bb73ec7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:53.242666 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a020fda-06d3-41ea-a3d4-433bb73ec7b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:53.242666 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a020fda-06d3-41ea-a3d4-433bb73ec7b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:53.242666 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a020fda-06d3-41ea-a3d4-433bb73ec7b8 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:53.258158 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1227/2469] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:27:53.262686 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8b4f5-5b50-41ec-8b3a-1384064fac88 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:53.278618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8b4f5-5b50-41ec-8b3a-1384064fac88 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:53.283304 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b00594-d7d7-4ab3-b93d-bd0e2e3b7c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:53.283965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b00594-d7d7-4ab3-b93d-bd0e2e3b7c66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:53.284344 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b00594-d7d7-4ab3-b93d-bd0e2e3b7c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:53.284624 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b00594-d7d7-4ab3-b93d-bd0e2e3b7c66 admin admin] PATH_INFO: `/v3/projects/b4c5c32c3b064fc5948ba890e0801438/users/53fd2c1d45bf42c5828193df44b8993c/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:53.286540 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b00594-d7d7-4ab3-b93d-bd0e2e3b7c66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4c5c32c3b064fc5948ba890e0801438, user_id=53fd2c1d45bf42c5828193df44b8993c, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:53.289362 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b00594-d7d7-4ab3-b93d-bd0e2e3b7c66 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:53.300378 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1243/2470] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:27:53 2022] PUT /identity/v3/projects/b4c5c32c3b064fc5948ba890e0801438/users/53fd2c1d45bf42c5828193df44b8993c/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:27:53.310986 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fb36c-bea2-4ee0-b4ec-f274bc6d8cc6 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:53.311275 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fb36c-bea2-4ee0-b4ec-f274bc6d8cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:53.311554 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fb36c-bea2-4ee0-b4ec-f274bc6d8cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:53.341812 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f69fb36c-bea2-4ee0-b4ec-f274bc6d8cc6 None None] MFA Rules not processed for user `53fd2c1d45bf42c5828193df44b8993c`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:27:53.343079 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f69fb36c-bea2-4ee0-b4ec-f274bc6d8cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:27:53.426999 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1228/2471] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:27:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:27:53.438874 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b00594-d7d7-4ab3-b93d-bd0e2e3b7c66 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:53.441411 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f0b00594-d7d7-4ab3-b93d-bd0e2e3b7c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:27:53.511301 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b00594-d7d7-4ab3-b93d-bd0e2e3b7c66 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:53.515223 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5e057-d2b9-4be3-b150-a5df5e63995e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:53.515869 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5e057-d2b9-4be3-b150-a5df5e63995e service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:53.516215 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5e057-d2b9-4be3-b150-a5df5e63995e service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:53.516493 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5e057-d2b9-4be3-b150-a5df5e63995e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:53.526628 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5e057-d2b9-4be3-b150-a5df5e63995e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:53.527970 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5e057-d2b9-4be3-b150-a5df5e63995e service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:53.537753 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1244/2472] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:27:53 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:27:53.822731 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fb36c-bea2-4ee0-b4ec-f274bc6d8cc6 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:53.840464 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fb36c-bea2-4ee0-b4ec-f274bc6d8cc6 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:53.844453 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942da97-780d-4bfb-810d-70fd6891b725 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:53.845371 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942da97-780d-4bfb-810d-70fd6891b725 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:53.845371 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942da97-780d-4bfb-810d-70fd6891b725 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:53.845620 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942da97-780d-4bfb-810d-70fd6891b725 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:53.921614 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:27:53.926600 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942da97-780d-4bfb-810d-70fd6891b725 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:53.928898 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942da97-780d-4bfb-810d-70fd6891b725 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:53.944175 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1229/2473] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:27:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:27:57.245447 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5e057-d2b9-4be3-b150-a5df5e63995e service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:57.247297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3ff5e057-d2b9-4be3-b150-a5df5e63995e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:27:57.320318 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:27:57.324641 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5e057-d2b9-4be3-b150-a5df5e63995e service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:57.330402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea7afb-6f07-411e-aa90-0a6364be53ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:57.331089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea7afb-6f07-411e-aa90-0a6364be53ae service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:57.331338 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea7afb-6f07-411e-aa90-0a6364be53ae service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:57.331612 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea7afb-6f07-411e-aa90-0a6364be53ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:57.333412 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6fea7afb-6f07-411e-aa90-0a6364be53ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:27:57.394640 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea7afb-6f07-411e-aa90-0a6364be53ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:57.396344 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea7afb-6f07-411e-aa90-0a6364be53ae service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:57.405932 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1245/2474] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:27:57 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:27:59.233261 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942da97-780d-4bfb-810d-70fd6891b725 service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:27:59.288705 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942da97-780d-4bfb-810d-70fd6891b725 service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:27:59.292314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a414cae-6543-4f0b-961c-362a167487af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:27:59.292917 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a414cae-6543-4f0b-961c-362a167487af service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:27:59.293197 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a414cae-6543-4f0b-961c-362a167487af service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:27:59.293472 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a414cae-6543-4f0b-961c-362a167487af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:27:59.295482 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-2a414cae-6543-4f0b-961c-362a167487af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:27:59.309361 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a414cae-6543-4f0b-961c-362a167487af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:27:59.310780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a414cae-6543-4f0b-961c-362a167487af service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:27:59.321491 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1230/2475] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:27:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:28:01.095107 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea7afb-6f07-411e-aa90-0a6364be53ae service nova] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:01.105588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea7afb-6f07-411e-aa90-0a6364be53ae service nova] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:01.109365 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9f845-0702-4b45-9415-784c187affdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:01.109985 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9f845-0702-4b45-9415-784c187affdb service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:01.110273 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9f845-0702-4b45-9415-784c187affdb service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:01.110552 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9f845-0702-4b45-9415-784c187affdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:01.112579 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-25e9f845-0702-4b45-9415-784c187affdb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:01.187116 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9f845-0702-4b45-9415-784c187affdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:01.188611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9f845-0702-4b45-9415-784c187affdb service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:01.198404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1246/2476] 10.222.0.81 () {60 vars in 1396 bytes} [Tue Sep 6 21:28:01 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:28:03.467068 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a414cae-6543-4f0b-961c-362a167487af service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:03.539798 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a414cae-6543-4f0b-961c-362a167487af service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:03.548699 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605385f9-c29a-4b24-ad89-2d52787f2da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:03.549377 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605385f9-c29a-4b24-ad89-2d52787f2da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:03.549617 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605385f9-c29a-4b24-ad89-2d52787f2da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:03.549886 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605385f9-c29a-4b24-ad89-2d52787f2da0 admin admin] PATH_INFO: `/v3/users/2698570344d8493b97aaad4aa7fd70f2` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:03.550995 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605385f9-c29a-4b24-ad89-2d52787f2da0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2698570344d8493b97aaad4aa7fd70f2)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:03.553487 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605385f9-c29a-4b24-ad89-2d52787f2da0 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:03.783540 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-605385f9-c29a-4b24-ad89-2d52787f2da0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2698570344d8493b97aaad4aa7fd70f2'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:03.852679 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-605385f9-c29a-4b24-ad89-2d52787f2da0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2698570344d8493b97aaad4aa7fd70f2'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:03.866559 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-605385f9-c29a-4b24-ad89-2d52787f2da0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2698570344d8493b97aaad4aa7fd70f2'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:03.867452 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-605385f9-c29a-4b24-ad89-2d52787f2da0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2698570344d8493b97aaad4aa7fd70f2'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:03.875157 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-605385f9-c29a-4b24-ad89-2d52787f2da0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2698570344d8493b97aaad4aa7fd70f2'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:03.881417 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1231/2477] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:28:03 2022] DELETE /identity/v3/users/2698570344d8493b97aaad4aa7fd70f2 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:28:03.886618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be5b7a-13fa-4852-a81a-d434789b1948 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:03.887120 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be5b7a-13fa-4852-a81a-d434789b1948 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:03.887227 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be5b7a-13fa-4852-a81a-d434789b1948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:03.928211 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-c1be5b7a-13fa-4852-a81a-d434789b1948 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:03.928211 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c1be5b7a-13fa-4852-a81a-d434789b1948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:04.013385 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1247/2478] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:28:04.021458 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605385f9-c29a-4b24-ad89-2d52787f2da0 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:04.022987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-605385f9-c29a-4b24-ad89-2d52787f2da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:04.043450 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:04.083393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca0706-c33e-46d4-8065-7f4396681a94 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:04.083732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca0706-c33e-46d4-8065-7f4396681a94 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:04.084007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca0706-c33e-46d4-8065-7f4396681a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:04.096716 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605385f9-c29a-4b24-ad89-2d52787f2da0 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:04.099538 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f93811-b284-40e9-a35a-7e995323c5af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:04.100465 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f93811-b284-40e9-a35a-7e995323c5af service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:04.100906 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f93811-b284-40e9-a35a-7e995323c5af service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:04.101323 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f93811-b284-40e9-a35a-7e995323c5af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:04.112254 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-53ca0706-c33e-46d4-8065-7f4396681a94 None None] MFA Rules not processed for user `0ba7376671a24d35a920e0ec3290472b`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:04.112254 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-53ca0706-c33e-46d4-8065-7f4396681a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:04.118004 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f93811-b284-40e9-a35a-7e995323c5af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:04.120186 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f93811-b284-40e9-a35a-7e995323c5af service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:04.130693 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1232/2479] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:28:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:28:04.160462 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:04.180991 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1248/2480] 10.222.0.81 () {58 vars in 967 bytes} [Tue Sep 6 21:28:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:28:04.360626 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f93811-b284-40e9-a35a-7e995323c5af service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:04.362105 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-81f93811-b284-40e9-a35a-7e995323c5af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:04.438431 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f93811-b284-40e9-a35a-7e995323c5af service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:04.444062 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b0dc8-0f4f-4927-952a-735c29ed1281 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0aac45d8b549afafae0a3f623bce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:04.444707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b0dc8-0f4f-4927-952a-735c29ed1281 service swift] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:04.444989 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b0dc8-0f4f-4927-952a-735c29ed1281 service swift] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:04.445263 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b0dc8-0f4f-4927-952a-735c29ed1281 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:04.453911 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b0dc8-0f4f-4927-952a-735c29ed1281 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:04.455532 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11b0dc8-0f4f-4927-952a-735c29ed1281 service swift] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:04.463755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1233/2481] 10.222.0.81 () {60 vars in 1384 bytes} [Tue Sep 6 21:28:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 21:28:04.640552 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca0706-c33e-46d4-8065-7f4396681a94 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:04.644602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-53ca0706-c33e-46d4-8065-7f4396681a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:04.665860 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca0706-c33e-46d4-8065-7f4396681a94 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:04.671363 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544461d-b46b-4cc5-92fa-8426ac9ddc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:04.671973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544461d-b46b-4cc5-92fa-8426ac9ddc63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:04.672304 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544461d-b46b-4cc5-92fa-8426ac9ddc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:04.672580 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544461d-b46b-4cc5-92fa-8426ac9ddc63 admin admin] PATH_INFO: `/v3/projects/9b26e670cc994f5faaed68452bde07d4` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:04.674138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544461d-b46b-4cc5-92fa-8426ac9ddc63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b26e670cc994f5faaed68452bde07d4)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:04.675993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544461d-b46b-4cc5-92fa-8426ac9ddc63 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:04.805791 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b544461d-b46b-4cc5-92fa-8426ac9ddc63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b26e670cc994f5faaed68452bde07d4', 'request_id': 'req-b544461d-b46b-4cc5-92fa-8426ac9ddc63'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:04.811298 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b544461d-b46b-4cc5-92fa-8426ac9ddc63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b26e670cc994f5faaed68452bde07d4', 'request_id': 'req-b544461d-b46b-4cc5-92fa-8426ac9ddc63'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:04.819139 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b544461d-b46b-4cc5-92fa-8426ac9ddc63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b26e670cc994f5faaed68452bde07d4', 'request_id': 'req-b544461d-b46b-4cc5-92fa-8426ac9ddc63'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:04.907773 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b544461d-b46b-4cc5-92fa-8426ac9ddc63 admin admin] The token cache is being invalidate because project 9b26e670cc994f5faaed68452bde07d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:28:04.914043 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b544461d-b46b-4cc5-92fa-8426ac9ddc63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:04.914043 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b544461d-b46b-4cc5-92fa-8426ac9ddc63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:04.914043 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1249/2482] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:28:04 2022] DELETE /identity/v3/projects/9b26e670cc994f5faaed68452bde07d4 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:28:04.915110 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b0dc8-0f4f-4927-952a-735c29ed1281 service swift] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:04.927408 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b0dc8-0f4f-4927-952a-735c29ed1281 service swift] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:04.998036 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce53a69a-f955-4069-819d-167dc8c60021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:04.998683 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53a69a-f955-4069-819d-167dc8c60021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:04.999071 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53a69a-f955-4069-819d-167dc8c60021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:04.999355 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce53a69a-f955-4069-819d-167dc8c60021 admin admin] PATH_INFO: `/v3/users/53fd2c1d45bf42c5828193df44b8993c` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:05.000566 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53a69a-f955-4069-819d-167dc8c60021 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53fd2c1d45bf42c5828193df44b8993c)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:05.002536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce53a69a-f955-4069-819d-167dc8c60021 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:05.262201 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ce53a69a-f955-4069-819d-167dc8c60021 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53fd2c1d45bf42c5828193df44b8993c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:05.265795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:05.356071 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ce53a69a-f955-4069-819d-167dc8c60021 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53fd2c1d45bf42c5828193df44b8993c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:05.369718 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ce53a69a-f955-4069-819d-167dc8c60021 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53fd2c1d45bf42c5828193df44b8993c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:05.370474 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ce53a69a-f955-4069-819d-167dc8c60021 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53fd2c1d45bf42c5828193df44b8993c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:05.377460 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ce53a69a-f955-4069-819d-167dc8c60021 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53fd2c1d45bf42c5828193df44b8993c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:05.384406 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1234/2483] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:28:04 2022] DELETE /identity/v3/users/53fd2c1d45bf42c5828193df44b8993c => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:28:05.817866 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544461d-b46b-4cc5-92fa-8426ac9ddc63 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:05.820550 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b544461d-b46b-4cc5-92fa-8426ac9ddc63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:05.837751 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544461d-b46b-4cc5-92fa-8426ac9ddc63 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:05.908809 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b49413-4b33-43fe-86b5-10d8afcab831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:05.909550 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b49413-4b33-43fe-86b5-10d8afcab831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:05.909911 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b49413-4b33-43fe-86b5-10d8afcab831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:05.910247 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b49413-4b33-43fe-86b5-10d8afcab831 admin admin] PATH_INFO: `/v3/projects/b4c5c32c3b064fc5948ba890e0801438` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:05.911530 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b49413-4b33-43fe-86b5-10d8afcab831 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4c5c32c3b064fc5948ba890e0801438)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:05.913462 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b49413-4b33-43fe-86b5-10d8afcab831 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:06.037425 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-86b49413-4b33-43fe-86b5-10d8afcab831 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4c5c32c3b064fc5948ba890e0801438', 'request_id': 'req-86b49413-4b33-43fe-86b5-10d8afcab831'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:06.044157 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-86b49413-4b33-43fe-86b5-10d8afcab831 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4c5c32c3b064fc5948ba890e0801438', 'request_id': 'req-86b49413-4b33-43fe-86b5-10d8afcab831'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:06.050565 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-86b49413-4b33-43fe-86b5-10d8afcab831 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4c5c32c3b064fc5948ba890e0801438', 'request_id': 'req-86b49413-4b33-43fe-86b5-10d8afcab831'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:06.152423 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:06.156786 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-86b49413-4b33-43fe-86b5-10d8afcab831 admin admin] The token cache is being invalidate because project b4c5c32c3b064fc5948ba890e0801438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:28:06.157083 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-86b49413-4b33-43fe-86b5-10d8afcab831 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:06.158641 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-86b49413-4b33-43fe-86b5-10d8afcab831 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:06.159975 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1250/2484] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:28:05 2022] DELETE /identity/v3/projects/b4c5c32c3b064fc5948ba890e0801438 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:28:06.165339 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17e5e3-953b-4700-8c34-1081a203a000 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:06.165870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17e5e3-953b-4700-8c34-1081a203a000 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:06.165973 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17e5e3-953b-4700-8c34-1081a203a000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:06.187523 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-db17e5e3-953b-4700-8c34-1081a203a000 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:06.188794 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-db17e5e3-953b-4700-8c34-1081a203a000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:06.255664 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1235/2485] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:28:06.265539 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54146b4e-3f6a-417f-b36a-691365402e50 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:06.266219 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54146b4e-3f6a-417f-b36a-691365402e50 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:06.266501 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54146b4e-3f6a-417f-b36a-691365402e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:06.287547 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-54146b4e-3f6a-417f-b36a-691365402e50 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:06.288861 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-54146b4e-3f6a-417f-b36a-691365402e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:06.300551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1251/2486] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:28:06.303193 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17e5e3-953b-4700-8c34-1081a203a000 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:06.313421 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17e5e3-953b-4700-8c34-1081a203a000 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:06.318494 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab410f0-0aed-4922-b61c-90f9627c0928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:06.319327 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab410f0-0aed-4922-b61c-90f9627c0928 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:06.320952 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab410f0-0aed-4922-b61c-90f9627c0928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:06.320952 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab410f0-0aed-4922-b61c-90f9627c0928 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:06.321209 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab410f0-0aed-4922-b61c-90f9627c0928 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:28:06.323037 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab410f0-0aed-4922-b61c-90f9627c0928 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:06.323269 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab410f0-0aed-4922-b61c-90f9627c0928 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:06.339001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1236/2487] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:28:06.340845 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54146b4e-3f6a-417f-b36a-691365402e50 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:06.350677 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54146b4e-3f6a-417f-b36a-691365402e50 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:06.363675 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb9162-afa8-40ef-9f27-26461ffb51b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:06.363675 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb9162-afa8-40ef-9f27-26461ffb51b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:06.363675 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb9162-afa8-40ef-9f27-26461ffb51b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:06.363675 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfb9162-afa8-40ef-9f27-26461ffb51b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:06.364305 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb9162-afa8-40ef-9f27-26461ffb51b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:06.366795 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfb9162-afa8-40ef-9f27-26461ffb51b2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:06.516670 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1252/2488] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:28:06 2022] POST /identity/v3/projects => generated 393 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:28:06.520993 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab410f0-0aed-4922-b61c-90f9627c0928 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:06.531368 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab410f0-0aed-4922-b61c-90f9627c0928 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:06.592867 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084d2e2-db7b-4602-b2c5-27b369851587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:06.593491 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084d2e2-db7b-4602-b2c5-27b369851587 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:06.593802 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084d2e2-db7b-4602-b2c5-27b369851587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:06.594265 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084d2e2-db7b-4602-b2c5-27b369851587 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:06.594905 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084d2e2-db7b-4602-b2c5-27b369851587 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:06.597593 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084d2e2-db7b-4602-b2c5-27b369851587 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:06.717190 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1237/2489] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:28:06 2022] POST /identity/v3/users => generated 297 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:28:06.721510 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb9162-afa8-40ef-9f27-26461ffb51b2 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:06.732697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfb9162-afa8-40ef-9f27-26461ffb51b2 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:06.737403 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b5543-1056-48f8-92fb-b79f8878352e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:06.737980 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b5543-1056-48f8-92fb-b79f8878352e admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:06.738323 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b5543-1056-48f8-92fb-b79f8878352e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:06.738695 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b5543-1056-48f8-92fb-b79f8878352e admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:06.739294 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b5543-1056-48f8-92fb-b79f8878352e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:06.745530 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7b5543-1056-48f8-92fb-b79f8878352e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:06.756038 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1253/2490] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:28:06.761775 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084d2e2-db7b-4602-b2c5-27b369851587 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:06.772225 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084d2e2-db7b-4602-b2c5-27b369851587 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:06.776893 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed650bfe-f770-4b7e-8e6a-8459a2a1bc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:06.777494 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed650bfe-f770-4b7e-8e6a-8459a2a1bc4b admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:06.777770 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed650bfe-f770-4b7e-8e6a-8459a2a1bc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:06.778043 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed650bfe-f770-4b7e-8e6a-8459a2a1bc4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:06.778675 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed650bfe-f770-4b7e-8e6a-8459a2a1bc4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:06.780334 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed650bfe-f770-4b7e-8e6a-8459a2a1bc4b admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:06.791690 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1238/2491] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:28:06.798563 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b5543-1056-48f8-92fb-b79f8878352e admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:06.807168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b5543-1056-48f8-92fb-b79f8878352e admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:06.811904 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0733f3-7c5f-4937-843d-7cf0efd9a7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:06.812615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0733f3-7c5f-4937-843d-7cf0efd9a7fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:06.812900 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0733f3-7c5f-4937-843d-7cf0efd9a7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:06.813178 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0733f3-7c5f-4937-843d-7cf0efd9a7fe admin admin] PATH_INFO: `/v3/projects/61e68d7b282a4a9a98350fd1e4f89bf3/users/8040c21ef84f4f8483fe4418273c9eeb/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:06.832429 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0733f3-7c5f-4937-843d-7cf0efd9a7fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=61e68d7b282a4a9a98350fd1e4f89bf3, user_id=8040c21ef84f4f8483fe4418273c9eeb, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:06.835185 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0733f3-7c5f-4937-843d-7cf0efd9a7fe admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:06.991829 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1254/2492] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:28:06 2022] PUT /identity/v3/projects/61e68d7b282a4a9a98350fd1e4f89bf3/users/8040c21ef84f4f8483fe4418273c9eeb/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:28:06.993809 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be79b7d-458a-46a1-9369-7cb6366f59c9 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:06.994115 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be79b7d-458a-46a1-9369-7cb6366f59c9 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:06.994560 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be79b7d-458a-46a1-9369-7cb6366f59c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:07.029475 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-5be79b7d-458a-46a1-9369-7cb6366f59c9 None None] MFA Rules not processed for user `8040c21ef84f4f8483fe4418273c9eeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:07.030682 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5be79b7d-458a-46a1-9369-7cb6366f59c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:07.052924 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:07.107952 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1239/2493] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:28:07.109013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0733f3-7c5f-4937-843d-7cf0efd9a7fe admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:07.182575 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0733f3-7c5f-4937-843d-7cf0efd9a7fe admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:07.187909 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2603d24-17b3-4b74-95ca-fa73d7ba88c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:07.188675 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2603d24-17b3-4b74-95ca-fa73d7ba88c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:07.189014 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2603d24-17b3-4b74-95ca-fa73d7ba88c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:07.189353 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2603d24-17b3-4b74-95ca-fa73d7ba88c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:07.190106 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2603d24-17b3-4b74-95ca-fa73d7ba88c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:07.192329 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2603d24-17b3-4b74-95ca-fa73d7ba88c8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:07.307148 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1255/2494] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:28:07 2022] POST /identity/v3/projects => generated 391 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:28:07.311452 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be79b7d-458a-46a1-9369-7cb6366f59c9 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:07.323045 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be79b7d-458a-46a1-9369-7cb6366f59c9 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:07.410753 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd0676-0861-420c-9f1b-659ec3ae6022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:07.411335 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd0676-0861-420c-9f1b-659ec3ae6022 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:07.411564 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd0676-0861-420c-9f1b-659ec3ae6022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:07.411839 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd0676-0861-420c-9f1b-659ec3ae6022 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:07.412564 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd0676-0861-420c-9f1b-659ec3ae6022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:07.414542 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dd0676-0861-420c-9f1b-659ec3ae6022 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:07.583941 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1240/2495] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:28:07 2022] POST /identity/v3/users => generated 302 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:28:07.588416 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2603d24-17b3-4b74-95ca-fa73d7ba88c8 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:07.599778 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2603d24-17b3-4b74-95ca-fa73d7ba88c8 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:07.604482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653b206-87fc-4ed0-beee-e224a6b75130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:07.605204 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653b206-87fc-4ed0-beee-e224a6b75130 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:07.605821 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653b206-87fc-4ed0-beee-e224a6b75130 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:07.605821 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653b206-87fc-4ed0-beee-e224a6b75130 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:07.606586 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d653b206-87fc-4ed0-beee-e224a6b75130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:07.608339 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d653b206-87fc-4ed0-beee-e224a6b75130 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:07.624388 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1256/2496] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:28:07.625645 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd0676-0861-420c-9f1b-659ec3ae6022 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:07.638584 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd0676-0861-420c-9f1b-659ec3ae6022 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:07.643860 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c646b9-a2c5-44fc-af02-42c5ffa98ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:07.644602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c646b9-a2c5-44fc-af02-42c5ffa98ca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:07.648233 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c646b9-a2c5-44fc-af02-42c5ffa98ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:07.648233 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c646b9-a2c5-44fc-af02-42c5ffa98ca5 admin admin] PATH_INFO: `/v3/projects/d7eda6dcb73d46039e19d97baa0e8b86/users/3e7dd23673cb49b187b7b2accf0ee77d/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:07.662454 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c646b9-a2c5-44fc-af02-42c5ffa98ca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7eda6dcb73d46039e19d97baa0e8b86, user_id=3e7dd23673cb49b187b7b2accf0ee77d, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:07.665378 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c646b9-a2c5-44fc-af02-42c5ffa98ca5 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:07.812679 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1241/2497] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:28:07 2022] PUT /identity/v3/projects/d7eda6dcb73d46039e19d97baa0e8b86/users/3e7dd23673cb49b187b7b2accf0ee77d/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:28:07.814106 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653b206-87fc-4ed0-beee-e224a6b75130 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:07.825572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653b206-87fc-4ed0-beee-e224a6b75130 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:07.892162 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c459b3-ba9d-4119-944d-9e9cdb9d9544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:07.893167 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c459b3-ba9d-4119-944d-9e9cdb9d9544 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:07.893451 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c459b3-ba9d-4119-944d-9e9cdb9d9544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:07.893727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c459b3-ba9d-4119-944d-9e9cdb9d9544 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:07.894371 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c459b3-ba9d-4119-944d-9e9cdb9d9544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:07.895968 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c459b3-ba9d-4119-944d-9e9cdb9d9544 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:07.908130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1257/2498] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:28:07.910824 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c646b9-a2c5-44fc-af02-42c5ffa98ca5 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:07.922071 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c646b9-a2c5-44fc-af02-42c5ffa98ca5 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:07.927019 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc19bf9-4b1e-4090-8fc0-ffbc68517bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:07.928577 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc19bf9-4b1e-4090-8fc0-ffbc68517bfe admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:07.928577 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc19bf9-4b1e-4090-8fc0-ffbc68517bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:07.928577 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc19bf9-4b1e-4090-8fc0-ffbc68517bfe admin admin] PATH_INFO: `/v3/projects/d7eda6dcb73d46039e19d97baa0e8b86/users/3e7dd23673cb49b187b7b2accf0ee77d/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:07.931025 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc19bf9-4b1e-4090-8fc0-ffbc68517bfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7eda6dcb73d46039e19d97baa0e8b86, user_id=3e7dd23673cb49b187b7b2accf0ee77d, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:07.933761 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc19bf9-4b1e-4090-8fc0-ffbc68517bfe admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:07.946248 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1242/2499] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:28:07 2022] PUT /identity/v3/projects/d7eda6dcb73d46039e19d97baa0e8b86/users/3e7dd23673cb49b187b7b2accf0ee77d/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:28:07.957192 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6b743-fb30-4b85-bb84-2792f5e014f9 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:07.957630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6b743-fb30-4b85-bb84-2792f5e014f9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:07.958005 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6b743-fb30-4b85-bb84-2792f5e014f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:07.972223 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:07.987877 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-9bf6b743-fb30-4b85-bb84-2792f5e014f9 None None] MFA Rules not processed for user `3e7dd23673cb49b187b7b2accf0ee77d`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:07.989340 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9bf6b743-fb30-4b85-bb84-2792f5e014f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:08.088170 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1258/2500] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:07 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:28:08.097714 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc19bf9-4b1e-4090-8fc0-ffbc68517bfe admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:08.100054 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-2bc19bf9-4b1e-4090-8fc0-ffbc68517bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:08.198589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc19bf9-4b1e-4090-8fc0-ffbc68517bfe admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:08.202684 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f883ad0-16f8-4712-9208-25471cefe618 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:08.203316 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f883ad0-16f8-4712-9208-25471cefe618 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:08.203603 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f883ad0-16f8-4712-9208-25471cefe618 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:08.203880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f883ad0-16f8-4712-9208-25471cefe618 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:08.215147 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f883ad0-16f8-4712-9208-25471cefe618 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:08.216644 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f883ad0-16f8-4712-9208-25471cefe618 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:08.227840 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1243/2501] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:28:08 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:28:08.296225 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6b743-fb30-4b85-bb84-2792f5e014f9 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:08.297651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9bf6b743-fb30-4b85-bb84-2792f5e014f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:08.310220 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6b743-fb30-4b85-bb84-2792f5e014f9 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:08.317870 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1b396-de52-4789-a4d0-a2bda9fdd771 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:08.317870 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1b396-de52-4789-a4d0-a2bda9fdd771 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:08.317870 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1b396-de52-4789-a4d0-a2bda9fdd771 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:08.317870 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1b396-de52-4789-a4d0-a2bda9fdd771 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:08.371741 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1b396-de52-4789-a4d0-a2bda9fdd771 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:08.374377 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1b396-de52-4789-a4d0-a2bda9fdd771 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:08.383401 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1259/2502] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:28:08 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:28:13.884429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108ca6c-e310-40d8-8e0f-7361cf72c330 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:13.885930 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108ca6c-e310-40d8-8e0f-7361cf72c330 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:13.885930 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8108ca6c-e310-40d8-8e0f-7361cf72c330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:13.920994 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-8108ca6c-e310-40d8-8e0f-7361cf72c330 None None] MFA Rules not processed for user `0ba7376671a24d35a920e0ec3290472b`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:13.922540 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8108ca6c-e310-40d8-8e0f-7361cf72c330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:13.941823 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:14.003272 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1244/2503] 10.222.0.81 () {58 vars in 1009 bytes} [Tue Sep 6 21:28:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:28:14.021259 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1b396-de52-4789-a4d0-a2bda9fdd771 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:14.026914 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-47c1b396-de52-4789-a4d0-a2bda9fdd771 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:14.131399 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108ca6c-e310-40d8-8e0f-7361cf72c330 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:14.133240 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1b396-de52-4789-a4d0-a2bda9fdd771 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:14.139559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656cde36-d31f-4d7f-9c64-f0beb6aa9a8a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0aac45d8b549afafae0a3f623bce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:14.140227 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656cde36-d31f-4d7f-9c64-f0beb6aa9a8a service swift] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:14.140515 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656cde36-d31f-4d7f-9c64-f0beb6aa9a8a service swift] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:14.140795 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656cde36-d31f-4d7f-9c64-f0beb6aa9a8a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:14.150394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656cde36-d31f-4d7f-9c64-f0beb6aa9a8a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:14.152429 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656cde36-d31f-4d7f-9c64-f0beb6aa9a8a service swift] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:14.165323 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1260/2504] 10.222.0.81 () {60 vars in 1384 bytes} [Tue Sep 6 21:28:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 21:28:14.211766 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8108ca6c-e310-40d8-8e0f-7361cf72c330 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:14.219095 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a01b69-8a68-4750-a293-6dac9af2aec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:14.220173 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a01b69-8a68-4750-a293-6dac9af2aec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:14.220640 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a01b69-8a68-4750-a293-6dac9af2aec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:14.221191 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a01b69-8a68-4750-a293-6dac9af2aec8 admin admin] PATH_INFO: `/v3/users/8040c21ef84f4f8483fe4418273c9eeb` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:14.223139 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a01b69-8a68-4750-a293-6dac9af2aec8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8040c21ef84f4f8483fe4418273c9eeb)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:14.226019 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a01b69-8a68-4750-a293-6dac9af2aec8 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:14.496389 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-79a01b69-8a68-4750-a293-6dac9af2aec8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8040c21ef84f4f8483fe4418273c9eeb'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:14.597266 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656cde36-d31f-4d7f-9c64-f0beb6aa9a8a service swift] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:14.599135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-656cde36-d31f-4d7f-9c64-f0beb6aa9a8a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:14.626917 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656cde36-d31f-4d7f-9c64-f0beb6aa9a8a service swift] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:14.633864 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-79a01b69-8a68-4750-a293-6dac9af2aec8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8040c21ef84f4f8483fe4418273c9eeb'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:14.639366 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1de08f-f364-47b4-90da-d71b641d817d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:14.640381 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1de08f-f364-47b4-90da-d71b641d817d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:14.640562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1de08f-f364-47b4-90da-d71b641d817d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:14.640943 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1de08f-f364-47b4-90da-d71b641d817d admin admin] PATH_INFO: `/v3/users/10857cba2e9741d5ac0db85d1f52d083` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:14.642395 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1de08f-f364-47b4-90da-d71b641d817d admin admin] RBAC: Authorizing `identity:delete_user(user_id=10857cba2e9741d5ac0db85d1f52d083)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:14.645939 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1de08f-f364-47b4-90da-d71b641d817d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:14.659980 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-79a01b69-8a68-4750-a293-6dac9af2aec8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8040c21ef84f4f8483fe4418273c9eeb'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:14.661083 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-79a01b69-8a68-4750-a293-6dac9af2aec8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8040c21ef84f4f8483fe4418273c9eeb'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:14.665396 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:14.671699 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-79a01b69-8a68-4750-a293-6dac9af2aec8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8040c21ef84f4f8483fe4418273c9eeb'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:14.683096 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1245/2505] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:28:14 2022] DELETE /identity/v3/users/8040c21ef84f4f8483fe4418273c9eeb => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:28:14.688034 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ec86c-322a-48e0-ba6f-35be35c65943 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:14.688034 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ec86c-322a-48e0-ba6f-35be35c65943 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:14.688034 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ec86c-322a-48e0-ba6f-35be35c65943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:14.708189 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-e27ec86c-322a-48e0-ba6f-35be35c65943 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:14.709408 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e27ec86c-322a-48e0-ba6f-35be35c65943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:14.755628 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:14.783720 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1246/2506] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:28:14.793981 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ec86c-322a-48e0-ba6f-35be35c65943 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:14.797578 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e27ec86c-322a-48e0-ba6f-35be35c65943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:14.871502 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ec86c-322a-48e0-ba6f-35be35c65943 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:14.876499 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df9b17-785f-4378-a38c-9041e7bff257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:14.877152 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df9b17-785f-4378-a38c-9041e7bff257 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:14.877436 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df9b17-785f-4378-a38c-9041e7bff257 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:14.877710 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df9b17-785f-4378-a38c-9041e7bff257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:14.879332 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0a1de08f-f364-47b4-90da-d71b641d817d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10857cba2e9741d5ac0db85d1f52d083'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:14.888286 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df9b17-785f-4378-a38c-9041e7bff257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:14.889913 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3df9b17-785f-4378-a38c-9041e7bff257 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:14.901019 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1247/2507] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:28:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:28:14.964870 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0a1de08f-f364-47b4-90da-d71b641d817d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10857cba2e9741d5ac0db85d1f52d083'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:14.992352 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0a1de08f-f364-47b4-90da-d71b641d817d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10857cba2e9741d5ac0db85d1f52d083'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:14.994582 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0a1de08f-f364-47b4-90da-d71b641d817d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10857cba2e9741d5ac0db85d1f52d083'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:15.017000 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0a1de08f-f364-47b4-90da-d71b641d817d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10857cba2e9741d5ac0db85d1f52d083'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:15.025413 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1261/2508] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:28:14 2022] DELETE /identity/v3/users/10857cba2e9741d5ac0db85d1f52d083 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:28:15.479025 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df9b17-785f-4378-a38c-9041e7bff257 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:15.481551 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b3df9b17-785f-4378-a38c-9041e7bff257 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:15.523888 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df9b17-785f-4378-a38c-9041e7bff257 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:15.590636 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1de08f-f364-47b4-90da-d71b641d817d admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:15.592988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0a1de08f-f364-47b4-90da-d71b641d817d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:15.637309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c34d0d-258a-4b42-89e5-136af4286fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:15.641131 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c34d0d-258a-4b42-89e5-136af4286fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:15.641131 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c34d0d-258a-4b42-89e5-136af4286fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:15.641131 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c34d0d-258a-4b42-89e5-136af4286fb1 admin admin] PATH_INFO: `/v3/projects/eb083183cfa84507a77eb79c5a77e22a` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:15.642094 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c34d0d-258a-4b42-89e5-136af4286fb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb083183cfa84507a77eb79c5a77e22a)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:15.648123 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c34d0d-258a-4b42-89e5-136af4286fb1 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:15.737858 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1de08f-f364-47b4-90da-d71b641d817d admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:15.745789 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8f816-a459-4eac-b0ec-e8d18a66bebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:15.746507 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8f816-a459-4eac-b0ec-e8d18a66bebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:15.746921 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8f816-a459-4eac-b0ec-e8d18a66bebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:15.747224 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8f816-a459-4eac-b0ec-e8d18a66bebe admin admin] PATH_INFO: `/v3/projects/61e68d7b282a4a9a98350fd1e4f89bf3` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:15.748801 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8f816-a459-4eac-b0ec-e8d18a66bebe admin admin] RBAC: Authorizing `identity:delete_project(project_id=61e68d7b282a4a9a98350fd1e4f89bf3)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:15.750327 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8f816-a459-4eac-b0ec-e8d18a66bebe admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:15.847703 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-77c34d0d-258a-4b42-89e5-136af4286fb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb083183cfa84507a77eb79c5a77e22a', 'request_id': 'req-77c34d0d-258a-4b42-89e5-136af4286fb1'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:15.906045 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d1a8f816-a459-4eac-b0ec-e8d18a66bebe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61e68d7b282a4a9a98350fd1e4f89bf3', 'request_id': 'req-d1a8f816-a459-4eac-b0ec-e8d18a66bebe'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:15.918690 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d1a8f816-a459-4eac-b0ec-e8d18a66bebe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61e68d7b282a4a9a98350fd1e4f89bf3', 'request_id': 'req-d1a8f816-a459-4eac-b0ec-e8d18a66bebe'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:15.932487 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-77c34d0d-258a-4b42-89e5-136af4286fb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb083183cfa84507a77eb79c5a77e22a', 'request_id': 'req-77c34d0d-258a-4b42-89e5-136af4286fb1'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:15.937216 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d1a8f816-a459-4eac-b0ec-e8d18a66bebe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61e68d7b282a4a9a98350fd1e4f89bf3', 'request_id': 'req-d1a8f816-a459-4eac-b0ec-e8d18a66bebe'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:15.941370 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-77c34d0d-258a-4b42-89e5-136af4286fb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb083183cfa84507a77eb79c5a77e22a', 'request_id': 'req-77c34d0d-258a-4b42-89e5-136af4286fb1'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:15.965778 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-77c34d0d-258a-4b42-89e5-136af4286fb1 admin admin] The token cache is being invalidate because project eb083183cfa84507a77eb79c5a77e22a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:28:15.966441 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-77c34d0d-258a-4b42-89e5-136af4286fb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:15.968211 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-77c34d0d-258a-4b42-89e5-136af4286fb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:15.970314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1248/2509] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:28:15 2022] DELETE /identity/v3/projects/eb083183cfa84507a77eb79c5a77e22a => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:28:15.973992 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c34d0d-258a-4b42-89e5-136af4286fb1 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:15.976442 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-77c34d0d-258a-4b42-89e5-136af4286fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:15.999177 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:16.041386 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d1a8f816-a459-4eac-b0ec-e8d18a66bebe admin admin] The token cache is being invalidate because project 61e68d7b282a4a9a98350fd1e4f89bf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:28:16.042459 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d1a8f816-a459-4eac-b0ec-e8d18a66bebe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:16.044350 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d1a8f816-a459-4eac-b0ec-e8d18a66bebe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:16.047736 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1262/2510] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:28:15 2022] DELETE /identity/v3/projects/61e68d7b282a4a9a98350fd1e4f89bf3 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:28:16.051603 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8f816-a459-4eac-b0ec-e8d18a66bebe admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:16.054305 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d1a8f816-a459-4eac-b0ec-e8d18a66bebe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:16.062861 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c34d0d-258a-4b42-89e5-136af4286fb1 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:16.131267 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68c03e-0cd0-47a2-8e5d-10f038078e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:16.131421 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:16.136080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68c03e-0cd0-47a2-8e5d-10f038078e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:16.136080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68c03e-0cd0-47a2-8e5d-10f038078e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:16.136080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68c03e-0cd0-47a2-8e5d-10f038078e30 admin admin] PATH_INFO: `/v3/users/420afc2d5ceb4069956cc64a66b899b4` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:16.136080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68c03e-0cd0-47a2-8e5d-10f038078e30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=420afc2d5ceb4069956cc64a66b899b4)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:16.136568 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68c03e-0cd0-47a2-8e5d-10f038078e30 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:16.200568 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8f816-a459-4eac-b0ec-e8d18a66bebe admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:16.207635 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0cca13-32fd-4703-8987-dd4cba32f5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:16.208457 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cca13-32fd-4703-8987-dd4cba32f5e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:16.209059 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cca13-32fd-4703-8987-dd4cba32f5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:16.209394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cca13-32fd-4703-8987-dd4cba32f5e3 admin admin] PATH_INFO: `/v3/users/3e7dd23673cb49b187b7b2accf0ee77d` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:16.211468 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0cca13-32fd-4703-8987-dd4cba32f5e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e7dd23673cb49b187b7b2accf0ee77d)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:16.217505 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0cca13-32fd-4703-8987-dd4cba32f5e3 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:16.426818 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5e68c03e-0cd0-47a2-8e5d-10f038078e30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '420afc2d5ceb4069956cc64a66b899b4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:16.496266 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5e68c03e-0cd0-47a2-8e5d-10f038078e30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '420afc2d5ceb4069956cc64a66b899b4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:16.512712 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5e68c03e-0cd0-47a2-8e5d-10f038078e30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '420afc2d5ceb4069956cc64a66b899b4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:16.513856 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5e68c03e-0cd0-47a2-8e5d-10f038078e30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '420afc2d5ceb4069956cc64a66b899b4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:16.526516 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5e68c03e-0cd0-47a2-8e5d-10f038078e30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '420afc2d5ceb4069956cc64a66b899b4'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:16.545456 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1249/2511] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:28:15 2022] DELETE /identity/v3/users/420afc2d5ceb4069956cc64a66b899b4 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:28:16.695043 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8a0cca13-32fd-4703-8987-dd4cba32f5e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e7dd23673cb49b187b7b2accf0ee77d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:16.781798 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8a0cca13-32fd-4703-8987-dd4cba32f5e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e7dd23673cb49b187b7b2accf0ee77d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:16.832822 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8a0cca13-32fd-4703-8987-dd4cba32f5e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e7dd23673cb49b187b7b2accf0ee77d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:16.834182 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8a0cca13-32fd-4703-8987-dd4cba32f5e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e7dd23673cb49b187b7b2accf0ee77d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:16.853704 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8a0cca13-32fd-4703-8987-dd4cba32f5e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e7dd23673cb49b187b7b2accf0ee77d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:16.871864 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1263/2512] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:28:16 2022] DELETE /identity/v3/users/3e7dd23673cb49b187b7b2accf0ee77d => generated 0 bytes in 818 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:28:17.024220 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68c03e-0cd0-47a2-8e5d-10f038078e30 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:17.027026 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5e68c03e-0cd0-47a2-8e5d-10f038078e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:17.089325 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:17.115487 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68c03e-0cd0-47a2-8e5d-10f038078e30 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:17.250259 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87c3b8-7f77-46fa-b05b-e2081b7b6e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:17.253761 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87c3b8-7f77-46fa-b05b-e2081b7b6e7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:17.254388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87c3b8-7f77-46fa-b05b-e2081b7b6e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:17.254851 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87c3b8-7f77-46fa-b05b-e2081b7b6e7f admin admin] PATH_INFO: `/v3/projects/95e73638c9614b34af2732920eef5849` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:17.258638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87c3b8-7f77-46fa-b05b-e2081b7b6e7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=95e73638c9614b34af2732920eef5849)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:17.263049 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87c3b8-7f77-46fa-b05b-e2081b7b6e7f admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:17.441808 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ac87c3b8-7f77-46fa-b05b-e2081b7b6e7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95e73638c9614b34af2732920eef5849', 'request_id': 'req-ac87c3b8-7f77-46fa-b05b-e2081b7b6e7f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:17.513531 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ac87c3b8-7f77-46fa-b05b-e2081b7b6e7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95e73638c9614b34af2732920eef5849', 'request_id': 'req-ac87c3b8-7f77-46fa-b05b-e2081b7b6e7f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:17.520807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0cca13-32fd-4703-8987-dd4cba32f5e3 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:17.523078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8a0cca13-32fd-4703-8987-dd4cba32f5e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:17.530042 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ac87c3b8-7f77-46fa-b05b-e2081b7b6e7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95e73638c9614b34af2732920eef5849', 'request_id': 'req-ac87c3b8-7f77-46fa-b05b-e2081b7b6e7f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:17.559122 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0cca13-32fd-4703-8987-dd4cba32f5e3 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:17.575655 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ac87c3b8-7f77-46fa-b05b-e2081b7b6e7f admin admin] The token cache is being invalidate because project 95e73638c9614b34af2732920eef5849 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:28:17.576512 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ac87c3b8-7f77-46fa-b05b-e2081b7b6e7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:17.582480 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ac87c3b8-7f77-46fa-b05b-e2081b7b6e7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:17.598055 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1250/2513] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:28:17 2022] DELETE /identity/v3/projects/95e73638c9614b34af2732920eef5849 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:28:17.599613 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87c3b8-7f77-46fa-b05b-e2081b7b6e7f admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:17.605648 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ac87c3b8-7f77-46fa-b05b-e2081b7b6e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:17.657591 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41fb4c-3b70-4616-9f91-dd1108b07e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:17.658259 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41fb4c-3b70-4616-9f91-dd1108b07e4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:17.659155 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41fb4c-3b70-4616-9f91-dd1108b07e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:17.659438 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41fb4c-3b70-4616-9f91-dd1108b07e4b admin admin] PATH_INFO: `/v3/projects/d7eda6dcb73d46039e19d97baa0e8b86` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:17.661918 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41fb4c-3b70-4616-9f91-dd1108b07e4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7eda6dcb73d46039e19d97baa0e8b86)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:17.664408 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e41fb4c-3b70-4616-9f91-dd1108b07e4b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:17.783640 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87c3b8-7f77-46fa-b05b-e2081b7b6e7f admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:17.793066 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066d927b-5e1f-4c9d-a74c-f5406d70a62d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:17.793707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d927b-5e1f-4c9d-a74c-f5406d70a62d service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:17.794012 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d927b-5e1f-4c9d-a74c-f5406d70a62d service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:17.794297 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d927b-5e1f-4c9d-a74c-f5406d70a62d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:17.800199 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-066d927b-5e1f-4c9d-a74c-f5406d70a62d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:17.855547 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d927b-5e1f-4c9d-a74c-f5406d70a62d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:17.857784 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066d927b-5e1f-4c9d-a74c-f5406d70a62d service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:17.899973 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1251/2514] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:28:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:28:17.901784 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d2513-8974-4b7d-b06c-8b2f5a860472 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:17.902155 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d2513-8974-4b7d-b06c-8b2f5a860472 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:17.902526 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d2513-8974-4b7d-b06c-8b2f5a860472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:17.914817 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:17.921680 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6e41fb4c-3b70-4616-9f91-dd1108b07e4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7eda6dcb73d46039e19d97baa0e8b86', 'request_id': 'req-6e41fb4c-3b70-4616-9f91-dd1108b07e4b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:17.936270 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:17.936679 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6e41fb4c-3b70-4616-9f91-dd1108b07e4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7eda6dcb73d46039e19d97baa0e8b86', 'request_id': 'req-6e41fb4c-3b70-4616-9f91-dd1108b07e4b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:17.954043 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6e41fb4c-3b70-4616-9f91-dd1108b07e4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7eda6dcb73d46039e19d97baa0e8b86', 'request_id': 'req-6e41fb4c-3b70-4616-9f91-dd1108b07e4b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:17.973180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-8b6d2513-8974-4b7d-b06c-8b2f5a860472 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:17.974703 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8b6d2513-8974-4b7d-b06c-8b2f5a860472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:18.051405 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1252/2515] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:28:18.070008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80b558-e3ab-45a9-a80b-51ed65cb757f None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:18.070298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80b558-e3ab-45a9-a80b-51ed65cb757f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:18.070742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80b558-e3ab-45a9-a80b-51ed65cb757f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:18.094387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-7f80b558-e3ab-45a9-a80b-51ed65cb757f None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:18.096172 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7f80b558-e3ab-45a9-a80b-51ed65cb757f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:18.108592 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1253/2516] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:28:18.110002 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80b558-e3ab-45a9-a80b-51ed65cb757f None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:18.120061 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80b558-e3ab-45a9-a80b-51ed65cb757f None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:18.137918 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9915b-1d1f-40b4-a2e2-911e5b37532d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:18.137918 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9915b-1d1f-40b4-a2e2-911e5b37532d admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:18.137918 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9915b-1d1f-40b4-a2e2-911e5b37532d admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:18.137918 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9915b-1d1f-40b4-a2e2-911e5b37532d admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:18.138670 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9915b-1d1f-40b4-a2e2-911e5b37532d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:28:18.138670 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9915b-1d1f-40b4-a2e2-911e5b37532d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:18.138670 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9915b-1d1f-40b4-a2e2-911e5b37532d admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:18.145111 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1254/2517] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:28:18.150121 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9915b-1d1f-40b4-a2e2-911e5b37532d admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:18.161164 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9915b-1d1f-40b4-a2e2-911e5b37532d admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:18.167084 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6dbe5-cf8e-449e-a588-4efbb6f008b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:18.167750 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6dbe5-cf8e-449e-a588-4efbb6f008b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:18.168063 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6dbe5-cf8e-449e-a588-4efbb6f008b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:18.168403 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6dbe5-cf8e-449e-a588-4efbb6f008b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:18.169266 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6dbe5-cf8e-449e-a588-4efbb6f008b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:18.172676 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6dbe5-cf8e-449e-a588-4efbb6f008b4 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:18.256528 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6e41fb4c-3b70-4616-9f91-dd1108b07e4b admin admin] The token cache is being invalidate because project d7eda6dcb73d46039e19d97baa0e8b86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:28:18.256804 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6e41fb4c-3b70-4616-9f91-dd1108b07e4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:18.257649 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-6e41fb4c-3b70-4616-9f91-dd1108b07e4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:18.259172 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1264/2518] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:28:17 2022] DELETE /identity/v3/projects/d7eda6dcb73d46039e19d97baa0e8b86 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:28:18.264061 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cacc82-9d71-42eb-9953-ba119940b65e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:18.264564 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cacc82-9d71-42eb-9953-ba119940b65e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:18.265017 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cacc82-9d71-42eb-9953-ba119940b65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:18.285119 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-08cacc82-9d71-42eb-9953-ba119940b65e None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:18.286318 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-08cacc82-9d71-42eb-9953-ba119940b65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:18.295589 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1265/2519] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:28:18.303690 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455e037-7140-4d7d-aba5-1d563abaab49 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:18.303977 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455e037-7140-4d7d-aba5-1d563abaab49 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:18.304287 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455e037-7140-4d7d-aba5-1d563abaab49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:18.329947 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-7455e037-7140-4d7d-aba5-1d563abaab49 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:18.331168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7455e037-7140-4d7d-aba5-1d563abaab49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:18.339827 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1266/2520] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:28:18.343942 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455e037-7140-4d7d-aba5-1d563abaab49 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:18.353687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455e037-7140-4d7d-aba5-1d563abaab49 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:18.358375 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a7bf3-d9a4-4c6b-9e89-113459cd8e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:18.358975 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a7bf3-d9a4-4c6b-9e89-113459cd8e8b admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:18.359259 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a7bf3-d9a4-4c6b-9e89-113459cd8e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:18.359535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a7bf3-d9a4-4c6b-9e89-113459cd8e8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:18.360216 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a7bf3-d9a4-4c6b-9e89-113459cd8e8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:28:18.360525 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a7bf3-d9a4-4c6b-9e89-113459cd8e8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:18.362107 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a7bf3-d9a4-4c6b-9e89-113459cd8e8b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:18.374084 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1267/2521] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:28:18.378114 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a7bf3-d9a4-4c6b-9e89-113459cd8e8b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:18.387855 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a7bf3-d9a4-4c6b-9e89-113459cd8e8b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:18.392635 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dae6dd-8485-4eb7-8d81-b9950b1c983f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:18.393230 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dae6dd-8485-4eb7-8d81-b9950b1c983f admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:18.393507 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dae6dd-8485-4eb7-8d81-b9950b1c983f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:18.393867 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dae6dd-8485-4eb7-8d81-b9950b1c983f admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:18.394497 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dae6dd-8485-4eb7-8d81-b9950b1c983f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:18.396385 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dae6dd-8485-4eb7-8d81-b9950b1c983f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:18.592271 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1268/2522] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:28:18 2022] POST /identity/v3/projects => generated 385 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:28:18.593744 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1255/2523] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:28:18 2022] POST /identity/v3/projects => generated 373 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:28:18.597909 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6dbe5-cf8e-449e-a588-4efbb6f008b4 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:18.598050 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dae6dd-8485-4eb7-8d81-b9950b1c983f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:18.599721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8cd6dbe5-cf8e-449e-a588-4efbb6f008b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:18.668767 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6dbe5-cf8e-449e-a588-4efbb6f008b4 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:18.674060 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9215ca9-d6fc-48b8-8a69-75fd2c3bff24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:18.674672 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9215ca9-d6fc-48b8-8a69-75fd2c3bff24 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:18.674991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9215ca9-d6fc-48b8-8a69-75fd2c3bff24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:18.675229 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9215ca9-d6fc-48b8-8a69-75fd2c3bff24 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:18.675862 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9215ca9-d6fc-48b8-8a69-75fd2c3bff24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:18.677906 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9215ca9-d6fc-48b8-8a69-75fd2c3bff24 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:18.679412 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dae6dd-8485-4eb7-8d81-b9950b1c983f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:18.684359 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b007d-8c96-448e-b583-09c0dced8bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:18.685007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b007d-8c96-448e-b583-09c0dced8bcd admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:18.685287 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b007d-8c96-448e-b583-09c0dced8bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:18.685563 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b007d-8c96-448e-b583-09c0dced8bcd admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:18.686203 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b007d-8c96-448e-b583-09c0dced8bcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:18.688186 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b007d-8c96-448e-b583-09c0dced8bcd admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:18.780376 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1256/2524] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:28:18 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:28:18.785092 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9215ca9-d6fc-48b8-8a69-75fd2c3bff24 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:18.800629 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9215ca9-d6fc-48b8-8a69-75fd2c3bff24 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:18.806461 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f7355-4eb6-43cb-a78f-f24d286aafdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:18.807397 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f7355-4eb6-43cb-a78f-f24d286aafdc admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:18.807968 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f7355-4eb6-43cb-a78f-f24d286aafdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:18.810824 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9f7355-4eb6-43cb-a78f-f24d286aafdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:18.810824 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f7355-4eb6-43cb-a78f-f24d286aafdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:18.811501 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9f7355-4eb6-43cb-a78f-f24d286aafdc admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:18.817221 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1269/2525] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:28:18 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:28:18.818578 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b007d-8c96-448e-b583-09c0dced8bcd admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:18.829096 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1257/2526] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:28:18.830304 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f7355-4eb6-43cb-a78f-f24d286aafdc admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:18.846466 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b007d-8c96-448e-b583-09c0dced8bcd admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:18.847091 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9f7355-4eb6-43cb-a78f-f24d286aafdc admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:18.852474 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caddeff-3b3c-40de-8a60-2e9ad84e6bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:18.853862 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caddeff-3b3c-40de-8a60-2e9ad84e6bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:18.854346 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caddeff-3b3c-40de-8a60-2e9ad84e6bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:18.854696 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caddeff-3b3c-40de-8a60-2e9ad84e6bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:18.855433 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caddeff-3b3c-40de-8a60-2e9ad84e6bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:18.857245 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5ac4d-eb97-46f8-b140-2fefe66f09a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:18.858461 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caddeff-3b3c-40de-8a60-2e9ad84e6bb3 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:18.858602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5ac4d-eb97-46f8-b140-2fefe66f09a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:18.858879 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5ac4d-eb97-46f8-b140-2fefe66f09a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:18.859968 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb5ac4d-eb97-46f8-b140-2fefe66f09a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:18.860922 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5ac4d-eb97-46f8-b140-2fefe66f09a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:18.863664 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb5ac4d-eb97-46f8-b140-2fefe66f09a0 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:18.875346 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1270/2527] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:28:18.876586 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caddeff-3b3c-40de-8a60-2e9ad84e6bb3 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:18.889897 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1258/2528] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:28:18.905711 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5ac4d-eb97-46f8-b140-2fefe66f09a0 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:18.909824 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caddeff-3b3c-40de-8a60-2e9ad84e6bb3 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:18.917032 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d98d06-bca0-4e38-b987-651100d43dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:18.917714 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d98d06-bca0-4e38-b987-651100d43dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:18.917993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d98d06-bca0-4e38-b987-651100d43dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:18.918269 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d98d06-bca0-4e38-b987-651100d43dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:18.918371 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb5ac4d-eb97-46f8-b140-2fefe66f09a0 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:18.920545 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d98d06-bca0-4e38-b987-651100d43dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:18.920934 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d98d06-bca0-4e38-b987-651100d43dc7 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:18.924031 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6c18c-7c32-447b-af56-d9b0cedf2c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:18.924997 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6c18c-7c32-447b-af56-d9b0cedf2c62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:18.925330 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6c18c-7c32-447b-af56-d9b0cedf2c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:18.925614 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6c18c-7c32-447b-af56-d9b0cedf2c62 admin admin] PATH_INFO: `/v3/projects/5fdec4349e24426ca0b2aeb7b6029759/users/8ff58811b016456ab3e51711a69f2d9d/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:18.936647 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1271/2529] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:28:18.939318 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d98d06-bca0-4e38-b987-651100d43dc7 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:18.948753 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c6c18c-7c32-447b-af56-d9b0cedf2c62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fdec4349e24426ca0b2aeb7b6029759, user_id=8ff58811b016456ab3e51711a69f2d9d, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:18.953069 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c6c18c-7c32-447b-af56-d9b0cedf2c62 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:18.960820 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d98d06-bca0-4e38-b987-651100d43dc7 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:18.966950 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e084b7-7b65-4e4e-8a70-05be10194b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:18.967712 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e084b7-7b65-4e4e-8a70-05be10194b51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:18.968602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e084b7-7b65-4e4e-8a70-05be10194b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:18.972689 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e084b7-7b65-4e4e-8a70-05be10194b51 admin admin] PATH_INFO: `/v3/projects/d8705f6ddd1c43f9a0451ad3aa3128e0/users/2b2cec18f0fa4211b0c6bb277dcfe901/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:19.009607 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e084b7-7b65-4e4e-8a70-05be10194b51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8705f6ddd1c43f9a0451ad3aa3128e0, user_id=2b2cec18f0fa4211b0c6bb277dcfe901, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:19.016590 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e084b7-7b65-4e4e-8a70-05be10194b51 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:19.083946 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1259/2530] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:28:18 2022] PUT /identity/v3/projects/5fdec4349e24426ca0b2aeb7b6029759/users/8ff58811b016456ab3e51711a69f2d9d/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:28:19.090962 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171c37e-9ee1-4620-961f-189d3b4f6c25 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:19.091247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171c37e-9ee1-4620-961f-189d3b4f6c25 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:19.091513 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171c37e-9ee1-4620-961f-189d3b4f6c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:19.115572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1272/2531] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:28:18 2022] PUT /identity/v3/projects/d8705f6ddd1c43f9a0451ad3aa3128e0/users/2b2cec18f0fa4211b0c6bb277dcfe901/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:28:19.125665 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb092c-dc3d-47b7-895c-1ad411c51f5e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:19.125976 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb092c-dc3d-47b7-895c-1ad411c51f5e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:19.126211 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb092c-dc3d-47b7-895c-1ad411c51f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:19.137759 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-6171c37e-9ee1-4620-961f-189d3b4f6c25 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:19.139314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6171c37e-9ee1-4620-961f-189d3b4f6c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:19.206842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-fdfb092c-dc3d-47b7-895c-1ad411c51f5e None None] MFA Rules not processed for user `2b2cec18f0fa4211b0c6bb277dcfe901`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:19.208122 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fdfb092c-dc3d-47b7-895c-1ad411c51f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:19.307088 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1260/2532] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:28:19.319861 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171c37e-9ee1-4620-961f-189d3b4f6c25 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:19.321544 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6171c37e-9ee1-4620-961f-189d3b4f6c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:19.331197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1273/2533] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:28:19.343557 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb092c-dc3d-47b7-895c-1ad411c51f5e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:19.345265 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fdfb092c-dc3d-47b7-895c-1ad411c51f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:19.392556 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171c37e-9ee1-4620-961f-189d3b4f6c25 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:19.398436 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a6e97-8054-4d09-83c7-206809fb7a2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:19.400005 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a6e97-8054-4d09-83c7-206809fb7a2f service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:19.400376 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a6e97-8054-4d09-83c7-206809fb7a2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:19.400746 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a6e97-8054-4d09-83c7-206809fb7a2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:19.411624 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a6e97-8054-4d09-83c7-206809fb7a2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:19.413835 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2a6e97-8054-4d09-83c7-206809fb7a2f service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:19.428598 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb092c-dc3d-47b7-895c-1ad411c51f5e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:19.432562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307e8f8-8790-4e3c-8632-aa42954c1979 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:19.433178 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307e8f8-8790-4e3c-8632-aa42954c1979 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:19.433649 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307e8f8-8790-4e3c-8632-aa42954c1979 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:19.436405 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307e8f8-8790-4e3c-8632-aa42954c1979 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:19.437552 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1261/2534] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:28:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:28:19.450624 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c307e8f8-8790-4e3c-8632-aa42954c1979 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:19.453157 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c307e8f8-8790-4e3c-8632-aa42954c1979 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:19.467672 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1274/2535] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:28:19 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:28:19.489192 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a6e97-8054-4d09-83c7-206809fb7a2f service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:19.501934 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a6e97-8054-4d09-83c7-206809fb7a2f service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:19.510243 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525cfd0-6de4-436b-bca4-daeed83e3213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:19.511191 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525cfd0-6de4-436b-bca4-daeed83e3213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:19.511547 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525cfd0-6de4-436b-bca4-daeed83e3213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:19.511892 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525cfd0-6de4-436b-bca4-daeed83e3213 admin admin] PATH_INFO: `/v3/users/2b2cec18f0fa4211b0c6bb277dcfe901` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:19.513503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7525cfd0-6de4-436b-bca4-daeed83e3213 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b2cec18f0fa4211b0c6bb277dcfe901)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:19.515509 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7525cfd0-6de4-436b-bca4-daeed83e3213 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:19.758589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-7525cfd0-6de4-436b-bca4-daeed83e3213 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b2cec18f0fa4211b0c6bb277dcfe901'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:19.924381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-7525cfd0-6de4-436b-bca4-daeed83e3213 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b2cec18f0fa4211b0c6bb277dcfe901'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:19.947247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-7525cfd0-6de4-436b-bca4-daeed83e3213 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b2cec18f0fa4211b0c6bb277dcfe901'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:19.948638 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-7525cfd0-6de4-436b-bca4-daeed83e3213 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b2cec18f0fa4211b0c6bb277dcfe901'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:19.954325 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:19.958312 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-7525cfd0-6de4-436b-bca4-daeed83e3213 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b2cec18f0fa4211b0c6bb277dcfe901'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:19.965466 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1262/2536] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:28:19 2022] DELETE /identity/v3/users/2b2cec18f0fa4211b0c6bb277dcfe901 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:28:19.969556 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2d1cb-ff6c-4f67-b155-863d8bb89ff0 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:19.969838 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2d1cb-ff6c-4f67-b155-863d8bb89ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:19.970116 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa2d1cb-ff6c-4f67-b155-863d8bb89ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:19.992621 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-1fa2d1cb-ff6c-4f67-b155-863d8bb89ff0 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:19.993841 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1fa2d1cb-ff6c-4f67-b155-863d8bb89ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:20.106695 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1275/2537] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:28:20.118030 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525cfd0-6de4-436b-bca4-daeed83e3213 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:20.122424 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7525cfd0-6de4-436b-bca4-daeed83e3213 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:20.126190 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:20.215853 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525cfd0-6de4-436b-bca4-daeed83e3213 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:20.220692 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181187b9-07d4-4e94-abf6-4321c8173295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:20.221792 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181187b9-07d4-4e94-abf6-4321c8173295 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:20.222078 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181187b9-07d4-4e94-abf6-4321c8173295 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:20.222350 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181187b9-07d4-4e94-abf6-4321c8173295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:20.247343 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181187b9-07d4-4e94-abf6-4321c8173295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:20.255577 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181187b9-07d4-4e94-abf6-4321c8173295 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:20.286936 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1263/2538] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:28:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:28:20.976801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:21.055258 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2d1cb-ff6c-4f67-b155-863d8bb89ff0 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:21.057130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1fa2d1cb-ff6c-4f67-b155-863d8bb89ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:21.080799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa2d1cb-ff6c-4f67-b155-863d8bb89ff0 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:21.103387 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bcf48-6f7a-4239-9205-41c5c10d2dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:21.104311 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bcf48-6f7a-4239-9205-41c5c10d2dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:21.106055 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bcf48-6f7a-4239-9205-41c5c10d2dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:21.106588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bcf48-6f7a-4239-9205-41c5c10d2dd0 admin admin] PATH_INFO: `/v3/projects/d8705f6ddd1c43f9a0451ad3aa3128e0` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:21.108630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bcf48-6f7a-4239-9205-41c5c10d2dd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8705f6ddd1c43f9a0451ad3aa3128e0)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:21.111742 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8bcf48-6f7a-4239-9205-41c5c10d2dd0 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:21.296333 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-fb8bcf48-6f7a-4239-9205-41c5c10d2dd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8705f6ddd1c43f9a0451ad3aa3128e0', 'request_id': 'req-fb8bcf48-6f7a-4239-9205-41c5c10d2dd0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:21.312055 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-fb8bcf48-6f7a-4239-9205-41c5c10d2dd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8705f6ddd1c43f9a0451ad3aa3128e0', 'request_id': 'req-fb8bcf48-6f7a-4239-9205-41c5c10d2dd0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:21.331874 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-fb8bcf48-6f7a-4239-9205-41c5c10d2dd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8705f6ddd1c43f9a0451ad3aa3128e0', 'request_id': 'req-fb8bcf48-6f7a-4239-9205-41c5c10d2dd0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:21.373437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:21.428824 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-fb8bcf48-6f7a-4239-9205-41c5c10d2dd0 admin admin] The token cache is being invalidate because project d8705f6ddd1c43f9a0451ad3aa3128e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:28:21.429263 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-fb8bcf48-6f7a-4239-9205-41c5c10d2dd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:21.431213 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-fb8bcf48-6f7a-4239-9205-41c5c10d2dd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:21.435883 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1276/2539] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:28:21 2022] DELETE /identity/v3/projects/d8705f6ddd1c43f9a0451ad3aa3128e0 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:28:21.437673 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67519a3b-ce6b-4035-84a8-e4ff621ef021 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:21.440513 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67519a3b-ce6b-4035-84a8-e4ff621ef021 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:21.440513 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67519a3b-ce6b-4035-84a8-e4ff621ef021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:21.460959 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-67519a3b-ce6b-4035-84a8-e4ff621ef021 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:21.463041 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-67519a3b-ce6b-4035-84a8-e4ff621ef021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:21.540619 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1264/2540] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:28:21.550998 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bbe48-ae9a-4734-8aef-cbf4c8c886e9 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:21.551364 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bbe48-ae9a-4734-8aef-cbf4c8c886e9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:21.555190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bbe48-ae9a-4734-8aef-cbf4c8c886e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:21.603408 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-2f5bbe48-ae9a-4734-8aef-cbf4c8c886e9 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:21.608410 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2f5bbe48-ae9a-4734-8aef-cbf4c8c886e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:21.655112 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1277/2541] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:28:21.661523 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67519a3b-ce6b-4035-84a8-e4ff621ef021 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:21.674939 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67519a3b-ce6b-4035-84a8-e4ff621ef021 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:21.681124 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a963cb-3542-4234-aea0-a3c484d14173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:21.681753 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a963cb-3542-4234-aea0-a3c484d14173 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:21.682042 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a963cb-3542-4234-aea0-a3c484d14173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:21.682340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a963cb-3542-4234-aea0-a3c484d14173 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:21.683001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a963cb-3542-4234-aea0-a3c484d14173 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:28:21.683306 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a963cb-3542-4234-aea0-a3c484d14173 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:21.685053 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a963cb-3542-4234-aea0-a3c484d14173 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:21.712793 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1265/2542] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:28:21.714576 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5bbe48-ae9a-4734-8aef-cbf4c8c886e9 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:21.761321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5bbe48-ae9a-4734-8aef-cbf4c8c886e9 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:21.779421 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb08de-dcee-490e-af79-04c7ed6cb348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:21.780028 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb08de-dcee-490e-af79-04c7ed6cb348 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:21.780335 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb08de-dcee-490e-af79-04c7ed6cb348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:21.780672 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb08de-dcee-490e-af79-04c7ed6cb348 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:21.781245 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb08de-dcee-490e-af79-04c7ed6cb348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:21.783098 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb08de-dcee-490e-af79-04c7ed6cb348 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:21.936158 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1278/2543] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:28:21 2022] POST /identity/v3/projects => generated 375 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:28:21.940923 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a963cb-3542-4234-aea0-a3c484d14173 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:21.972444 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a963cb-3542-4234-aea0-a3c484d14173 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:22.136742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63096222-c6cc-4323-b2aa-dcfe5b28e5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:22.137699 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63096222-c6cc-4323-b2aa-dcfe5b28e5fc admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:22.138158 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63096222-c6cc-4323-b2aa-dcfe5b28e5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:22.138589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63096222-c6cc-4323-b2aa-dcfe5b28e5fc admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:22.139461 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63096222-c6cc-4323-b2aa-dcfe5b28e5fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:22.141986 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63096222-c6cc-4323-b2aa-dcfe5b28e5fc admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:22.315129 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1266/2544] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:28:21 2022] POST /identity/v3/users => generated 288 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:28:22.335836 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb08de-dcee-490e-af79-04c7ed6cb348 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:22.335836 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb08de-dcee-490e-af79-04c7ed6cb348 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:22.344817 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60206b09-6e5f-4fee-8dc7-1269bca5665a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:22.344817 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60206b09-6e5f-4fee-8dc7-1269bca5665a admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:22.344817 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60206b09-6e5f-4fee-8dc7-1269bca5665a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:22.344817 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60206b09-6e5f-4fee-8dc7-1269bca5665a admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:22.346159 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60206b09-6e5f-4fee-8dc7-1269bca5665a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:22.346159 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60206b09-6e5f-4fee-8dc7-1269bca5665a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:22.357478 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1279/2545] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:28:22.362479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63096222-c6cc-4323-b2aa-dcfe5b28e5fc admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:22.375725 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63096222-c6cc-4323-b2aa-dcfe5b28e5fc admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:22.384144 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160a056-3588-46c8-8f0e-c2d3de0dd589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:22.385544 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160a056-3588-46c8-8f0e-c2d3de0dd589 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:22.385544 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160a056-3588-46c8-8f0e-c2d3de0dd589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:22.385544 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160a056-3588-46c8-8f0e-c2d3de0dd589 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:22.386753 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160a056-3588-46c8-8f0e-c2d3de0dd589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:22.389901 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160a056-3588-46c8-8f0e-c2d3de0dd589 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:22.415088 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1267/2546] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:28:22.419063 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60206b09-6e5f-4fee-8dc7-1269bca5665a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:22.432537 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60206b09-6e5f-4fee-8dc7-1269bca5665a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:22.437487 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da08f22-a92b-4912-bbd0-d6b01cfc0aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:22.438256 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da08f22-a92b-4912-bbd0-d6b01cfc0aac admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:22.438508 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da08f22-a92b-4912-bbd0-d6b01cfc0aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:22.438783 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da08f22-a92b-4912-bbd0-d6b01cfc0aac admin admin] PATH_INFO: `/v3/projects/758928cc47eb41f2935b4df2db634abc/users/ea1296c96f44431ba369afa4046b432a/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:22.458936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da08f22-a92b-4912-bbd0-d6b01cfc0aac admin admin] RBAC: Authorizing `identity:create_grant(project_id=758928cc47eb41f2935b4df2db634abc, user_id=ea1296c96f44431ba369afa4046b432a, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:22.461653 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da08f22-a92b-4912-bbd0-d6b01cfc0aac admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:22.864937 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1280/2547] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:28:22 2022] PUT /identity/v3/projects/758928cc47eb41f2935b4df2db634abc/users/ea1296c96f44431ba369afa4046b432a/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:28:22.875434 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498cf37-10fd-4dc7-9605-ccb87710a455 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:22.875919 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498cf37-10fd-4dc7-9605-ccb87710a455 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:22.876030 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498cf37-10fd-4dc7-9605-ccb87710a455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:22.905276 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-4498cf37-10fd-4dc7-9605-ccb87710a455 None None] MFA Rules not processed for user `ea1296c96f44431ba369afa4046b432a`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:22.906508 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4498cf37-10fd-4dc7-9605-ccb87710a455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:22.927626 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:22.980916 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1268/2548] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:28:22.993724 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da08f22-a92b-4912-bbd0-d6b01cfc0aac admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:22.995483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5da08f22-a92b-4912-bbd0-d6b01cfc0aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:23.108437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da08f22-a92b-4912-bbd0-d6b01cfc0aac admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:23.112271 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d724b9-ef54-4fd6-800c-8d19fc31e655 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ba30d9c40641bf8abb580a219b5352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:23.113012 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d724b9-ef54-4fd6-800c-8d19fc31e655 service glance] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:23.113299 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d724b9-ef54-4fd6-800c-8d19fc31e655 service glance] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:23.113572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d724b9-ef54-4fd6-800c-8d19fc31e655 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:23.129579 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d724b9-ef54-4fd6-800c-8d19fc31e655 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:23.132676 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d724b9-ef54-4fd6-800c-8d19fc31e655 service glance] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:23.149402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1281/2549] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:28:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:28:26.393551 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498cf37-10fd-4dc7-9605-ccb87710a455 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:26.395289 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4498cf37-10fd-4dc7-9605-ccb87710a455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:26.499621 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498cf37-10fd-4dc7-9605-ccb87710a455 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:26.504915 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3508d9-a3f3-420e-a39c-6a364e7c2f3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:26.508706 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3508d9-a3f3-420e-a39c-6a364e7c2f3d service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:26.520539 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3508d9-a3f3-420e-a39c-6a364e7c2f3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:26.520942 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3508d9-a3f3-420e-a39c-6a364e7c2f3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:26.523739 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1d3508d9-a3f3-420e-a39c-6a364e7c2f3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:26.643325 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3508d9-a3f3-420e-a39c-6a364e7c2f3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:26.645557 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3508d9-a3f3-420e-a39c-6a364e7c2f3d service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:26.684347 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1269/2550] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:28:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:28:27.852574 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5943c-8b74-45fa-bde5-add992cdda1a None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:27.853842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5943c-8b74-45fa-bde5-add992cdda1a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:27.854342 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5943c-8b74-45fa-bde5-add992cdda1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:27.924802 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a3f5943c-8b74-45fa-bde5-add992cdda1a None None] MFA Rules not processed for user `8ff58811b016456ab3e51711a69f2d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:27.926211 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a3f5943c-8b74-45fa-bde5-add992cdda1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:28.044254 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1282/2551] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:28:28.047745 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3508d9-a3f3-420e-a39c-6a364e7c2f3d service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:28.049519 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1d3508d9-a3f3-420e-a39c-6a364e7c2f3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:28.064416 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3508d9-a3f3-420e-a39c-6a364e7c2f3d service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:28.071003 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49b6a0-fe52-4747-a4b2-8dc0674cd0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:28.071683 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49b6a0-fe52-4747-a4b2-8dc0674cd0d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:28.072007 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49b6a0-fe52-4747-a4b2-8dc0674cd0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:28.072325 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49b6a0-fe52-4747-a4b2-8dc0674cd0d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:28.073032 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49b6a0-fe52-4747-a4b2-8dc0674cd0d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:28.075284 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49b6a0-fe52-4747-a4b2-8dc0674cd0d2 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:28.658534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1270/2552] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:28:28 2022] POST /identity/v3/projects => generated 373 bytes in 611 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:28:28.662405 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5943c-8b74-45fa-bde5-add992cdda1a None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:28.677211 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5943c-8b74-45fa-bde5-add992cdda1a None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:28.688563 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:28.761579 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13832ce-fc21-4955-b5d8-319d0c7d568b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:28.762129 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13832ce-fc21-4955-b5d8-319d0c7d568b admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:28.762546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13832ce-fc21-4955-b5d8-319d0c7d568b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:28.762676 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13832ce-fc21-4955-b5d8-319d0c7d568b admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:28.763324 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13832ce-fc21-4955-b5d8-319d0c7d568b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:28.773793 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13832ce-fc21-4955-b5d8-319d0c7d568b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:28.896240 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1283/2553] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:28:28 2022] POST /identity/v3/users => generated 293 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:28:28.900708 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49b6a0-fe52-4747-a4b2-8dc0674cd0d2 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:28.915775 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49b6a0-fe52-4747-a4b2-8dc0674cd0d2 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:28.929686 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbc6dc-5409-4fd0-a09a-8094f9e6f17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:28.930327 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbc6dc-5409-4fd0-a09a-8094f9e6f17f admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:28.930707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbc6dc-5409-4fd0-a09a-8094f9e6f17f admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:28.931010 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbc6dc-5409-4fd0-a09a-8094f9e6f17f admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:28.932790 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dbc6dc-5409-4fd0-a09a-8094f9e6f17f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:28.934437 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dbc6dc-5409-4fd0-a09a-8094f9e6f17f admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:28.970155 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1271/2554] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:28:28.974037 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13832ce-fc21-4955-b5d8-319d0c7d568b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:28.991643 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13832ce-fc21-4955-b5d8-319d0c7d568b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:28.996241 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a4d8b-8afe-4aa0-9aec-ce24c81efafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:28.999018 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a4d8b-8afe-4aa0-9aec-ce24c81efafe admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:28.999403 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a4d8b-8afe-4aa0-9aec-ce24c81efafe admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:29.000195 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a4d8b-8afe-4aa0-9aec-ce24c81efafe admin admin] PATH_INFO: `/v3/projects/3e1008e1fdc843d0b00f6aba1af09131/users/81a82c298b26449b84ad702d842b7932/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:29.026897 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a4d8b-8afe-4aa0-9aec-ce24c81efafe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e1008e1fdc843d0b00f6aba1af09131, user_id=81a82c298b26449b84ad702d842b7932, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:29.031439 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a4d8b-8afe-4aa0-9aec-ce24c81efafe admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:29.139502 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1284/2555] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:28:28 2022] PUT /identity/v3/projects/3e1008e1fdc843d0b00f6aba1af09131/users/81a82c298b26449b84ad702d842b7932/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:28:29.140983 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbc6dc-5409-4fd0-a09a-8094f9e6f17f admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:29.152437 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbc6dc-5409-4fd0-a09a-8094f9e6f17f admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:29.242525 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:29.295845 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3c37d-2257-48c5-8e7c-a882a382a198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:29.296515 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3c37d-2257-48c5-8e7c-a882a382a198 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:29.296799 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3c37d-2257-48c5-8e7c-a882a382a198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:29.297073 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3c37d-2257-48c5-8e7c-a882a382a198 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:29.297728 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3c37d-2257-48c5-8e7c-a882a382a198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:29.299340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3c37d-2257-48c5-8e7c-a882a382a198 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:29.322642 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1272/2556] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:28:29 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:28:29.325170 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a4d8b-8afe-4aa0-9aec-ce24c81efafe admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:29.339080 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a4d8b-8afe-4aa0-9aec-ce24c81efafe admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:29.352234 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254f0fb-f960-4a7e-9253-01fe17e05766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:29.354278 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254f0fb-f960-4a7e-9253-01fe17e05766 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:29.354278 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254f0fb-f960-4a7e-9253-01fe17e05766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:29.354278 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254f0fb-f960-4a7e-9253-01fe17e05766 admin admin] PATH_INFO: `/v3/projects/3e1008e1fdc843d0b00f6aba1af09131/users/81a82c298b26449b84ad702d842b7932/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:29.356698 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254f0fb-f960-4a7e-9253-01fe17e05766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e1008e1fdc843d0b00f6aba1af09131, user_id=81a82c298b26449b84ad702d842b7932, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:29.359477 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254f0fb-f960-4a7e-9253-01fe17e05766 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:29.382511 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1285/2557] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:28:29 2022] PUT /identity/v3/projects/3e1008e1fdc843d0b00f6aba1af09131/users/81a82c298b26449b84ad702d842b7932/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:28:31.352656 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3c37d-2257-48c5-8e7c-a882a382a198 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:31.457898 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3c37d-2257-48c5-8e7c-a882a382a198 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:31.579049 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae76347-2987-490c-b644-ff344c057aa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:31.579899 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae76347-2987-490c-b644-ff344c057aa5 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:31.580124 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae76347-2987-490c-b644-ff344c057aa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:31.580415 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae76347-2987-490c-b644-ff344c057aa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:31.582441 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6ae76347-2987-490c-b644-ff344c057aa5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:31.595150 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae76347-2987-490c-b644-ff344c057aa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:31.597100 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae76347-2987-490c-b644-ff344c057aa5 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:31.620573 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1273/2558] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:28:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:28:32.977802 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254f0fb-f960-4a7e-9253-01fe17e05766 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:32.980795 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1254f0fb-f960-4a7e-9253-01fe17e05766 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:33.107381 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254f0fb-f960-4a7e-9253-01fe17e05766 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:33.109936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d3bdeb-1d4c-42c4-b4c7-475b0d819821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:33.111176 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3bdeb-1d4c-42c4-b4c7-475b0d819821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:33.111681 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3bdeb-1d4c-42c4-b4c7-475b0d819821 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:33.112076 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d3bdeb-1d4c-42c4-b4c7-475b0d819821 admin admin] PATH_INFO: `/v3/users/7ad886fd7cd445a18918965391eade77` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:33.113301 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3bdeb-1d4c-42c4-b4c7-475b0d819821 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ad886fd7cd445a18918965391eade77)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:33.115357 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d3bdeb-1d4c-42c4-b4c7-475b0d819821 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:33.340242 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-73d3bdeb-1d4c-42c4-b4c7-475b0d819821 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ad886fd7cd445a18918965391eade77'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:33.424970 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-73d3bdeb-1d4c-42c4-b4c7-475b0d819821 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ad886fd7cd445a18918965391eade77'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:33.437653 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=85,keystone:INSERT=6,keystone:DELETE=9 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:33.442709 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-73d3bdeb-1d4c-42c4-b4c7-475b0d819821 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ad886fd7cd445a18918965391eade77'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:33.444779 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-73d3bdeb-1d4c-42c4-b4c7-475b0d819821 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ad886fd7cd445a18918965391eade77'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:33.471368 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-73d3bdeb-1d4c-42c4-b4c7-475b0d819821 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ad886fd7cd445a18918965391eade77'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:33.481443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1286/2559] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:28:32 2022] DELETE /identity/v3/users/7ad886fd7cd445a18918965391eade77 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:28:33.858028 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae76347-2987-490c-b644-ff344c057aa5 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:33.871977 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae76347-2987-490c-b644-ff344c057aa5 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:33.957714 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df29fa-5bba-4720-91f3-75c661536961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:33.961251 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df29fa-5bba-4720-91f3-75c661536961 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:33.961251 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df29fa-5bba-4720-91f3-75c661536961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:33.961251 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df29fa-5bba-4720-91f3-75c661536961 admin admin] PATH_INFO: `/v3/projects/c28dfa296c2c46088aa3b19e550ee828` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:33.963081 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df29fa-5bba-4720-91f3-75c661536961 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c28dfa296c2c46088aa3b19e550ee828)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:33.965680 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df29fa-5bba-4720-91f3-75c661536961 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:34.087768 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:34.102211 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-13df29fa-5bba-4720-91f3-75c661536961 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c28dfa296c2c46088aa3b19e550ee828', 'request_id': 'req-13df29fa-5bba-4720-91f3-75c661536961'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:34.182352 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-13df29fa-5bba-4720-91f3-75c661536961 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c28dfa296c2c46088aa3b19e550ee828', 'request_id': 'req-13df29fa-5bba-4720-91f3-75c661536961'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:34.191793 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-13df29fa-5bba-4720-91f3-75c661536961 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c28dfa296c2c46088aa3b19e550ee828', 'request_id': 'req-13df29fa-5bba-4720-91f3-75c661536961'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:34.208727 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-13df29fa-5bba-4720-91f3-75c661536961 admin admin] The token cache is being invalidate because project c28dfa296c2c46088aa3b19e550ee828 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:28:34.209611 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-13df29fa-5bba-4720-91f3-75c661536961 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:34.210629 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-13df29fa-5bba-4720-91f3-75c661536961 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:34.212732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1274/2560] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:28:33 2022] DELETE /identity/v3/projects/c28dfa296c2c46088aa3b19e550ee828 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:28:34.217708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f11ef6-1974-4b7c-b50e-6ff159288db7 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:34.218566 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f11ef6-1974-4b7c-b50e-6ff159288db7 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:34.218943 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f11ef6-1974-4b7c-b50e-6ff159288db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:34.242769 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a0f11ef6-1974-4b7c-b50e-6ff159288db7 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:34.244992 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a0f11ef6-1974-4b7c-b50e-6ff159288db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:34.353385 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1287/2561] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:28:34.364024 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34737f-adcd-4f35-a2e5-34c8b8f43d31 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:34.365413 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34737f-adcd-4f35-a2e5-34c8b8f43d31 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:34.366814 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db34737f-adcd-4f35-a2e5-34c8b8f43d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:34.390666 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-db34737f-adcd-4f35-a2e5-34c8b8f43d31 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:34.391898 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-db34737f-adcd-4f35-a2e5-34c8b8f43d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:34.400795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1275/2562] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:28:34.405042 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f11ef6-1974-4b7c-b50e-6ff159288db7 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:34.415416 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f11ef6-1974-4b7c-b50e-6ff159288db7 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:34.420061 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801a64a-4ee3-44ed-99e4-6b03fae26047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:34.421113 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801a64a-4ee3-44ed-99e4-6b03fae26047 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:34.421396 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801a64a-4ee3-44ed-99e4-6b03fae26047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:34.421667 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801a64a-4ee3-44ed-99e4-6b03fae26047 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:34.422442 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801a64a-4ee3-44ed-99e4-6b03fae26047 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:28:34.422748 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801a64a-4ee3-44ed-99e4-6b03fae26047 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:34.424371 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801a64a-4ee3-44ed-99e4-6b03fae26047 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:34.439687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1288/2563] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:28:34.441010 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34737f-adcd-4f35-a2e5-34c8b8f43d31 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:34.450817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db34737f-adcd-4f35-a2e5-34c8b8f43d31 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:34.455558 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9efe0-71ba-49fa-a78f-8879cb011fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:34.456196 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9efe0-71ba-49fa-a78f-8879cb011fcf admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:34.457141 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9efe0-71ba-49fa-a78f-8879cb011fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:34.457141 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9efe0-71ba-49fa-a78f-8879cb011fcf admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:34.457414 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9efe0-71ba-49fa-a78f-8879cb011fcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:34.459863 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9efe0-71ba-49fa-a78f-8879cb011fcf admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:34.632176 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1276/2564] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:28:34 2022] POST /identity/v3/projects => generated 385 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:28:34.635384 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801a64a-4ee3-44ed-99e4-6b03fae26047 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:34.652598 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801a64a-4ee3-44ed-99e4-6b03fae26047 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:34.761453 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86751222-e88a-4fb7-8d71-1ef7248b80ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:34.762133 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86751222-e88a-4fb7-8d71-1ef7248b80ea admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:34.762540 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86751222-e88a-4fb7-8d71-1ef7248b80ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:34.762824 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86751222-e88a-4fb7-8d71-1ef7248b80ea admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:34.763462 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86751222-e88a-4fb7-8d71-1ef7248b80ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:34.765582 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86751222-e88a-4fb7-8d71-1ef7248b80ea admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:34.908210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1289/2565] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:28:34 2022] POST /identity/v3/users => generated 293 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:28:34.915152 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9efe0-71ba-49fa-a78f-8879cb011fcf admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:34.931240 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9efe0-71ba-49fa-a78f-8879cb011fcf admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:34.946619 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60293c-7e56-47ad-839b-f6b25c6b8adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:34.947673 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60293c-7e56-47ad-839b-f6b25c6b8adf admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:34.948221 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60293c-7e56-47ad-839b-f6b25c6b8adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:34.950641 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60293c-7e56-47ad-839b-f6b25c6b8adf admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:34.950641 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60293c-7e56-47ad-839b-f6b25c6b8adf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:34.952180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff60293c-7e56-47ad-839b-f6b25c6b8adf admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:34.981854 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1277/2566] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:28:34.987915 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86751222-e88a-4fb7-8d71-1ef7248b80ea admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:35.008213 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86751222-e88a-4fb7-8d71-1ef7248b80ea admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:35.015693 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b3e0b-a802-4e77-b466-3bf4c45779f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:35.016356 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b3e0b-a802-4e77-b466-3bf4c45779f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:35.016640 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b3e0b-a802-4e77-b466-3bf4c45779f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:35.016915 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b3e0b-a802-4e77-b466-3bf4c45779f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:35.017567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b3e0b-a802-4e77-b466-3bf4c45779f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:35.019153 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b3e0b-a802-4e77-b466-3bf4c45779f9 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:35.051332 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1290/2567] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:28:35.053911 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60293c-7e56-47ad-839b-f6b25c6b8adf admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:35.075103 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60293c-7e56-47ad-839b-f6b25c6b8adf admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:35.091174 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a315524-7c5d-4c77-9b32-ec37000a1b83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:35.091973 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a315524-7c5d-4c77-9b32-ec37000a1b83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:35.092388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a315524-7c5d-4c77-9b32-ec37000a1b83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:35.092768 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a315524-7c5d-4c77-9b32-ec37000a1b83 admin admin] PATH_INFO: `/v3/projects/255b7b897a9a4ee4a47fd039b4416be0/users/c4eae7912af24007ba5a099abe3a36b2/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:35.120710 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a315524-7c5d-4c77-9b32-ec37000a1b83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=255b7b897a9a4ee4a47fd039b4416be0, user_id=c4eae7912af24007ba5a099abe3a36b2, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:35.123973 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a315524-7c5d-4c77-9b32-ec37000a1b83 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:35.206539 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1278/2568] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:28:35 2022] PUT /identity/v3/projects/255b7b897a9a4ee4a47fd039b4416be0/users/c4eae7912af24007ba5a099abe3a36b2/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:28:35.208392 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0e859-307f-43e6-b767-976ae6845e9e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:35.208848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0e859-307f-43e6-b767-976ae6845e9e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:35.209342 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0e859-307f-43e6-b767-976ae6845e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:35.232837 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-9ea0e859-307f-43e6-b767-976ae6845e9e None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:35.236147 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9ea0e859-307f-43e6-b767-976ae6845e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:35.297372 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:35.315382 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1291/2569] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:28:35.326157 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a315524-7c5d-4c77-9b32-ec37000a1b83 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:35.328451 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-0a315524-7c5d-4c77-9b32-ec37000a1b83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:35.410927 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a315524-7c5d-4c77-9b32-ec37000a1b83 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:35.422768 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f6e20-dc3e-4323-af68-8dd5fb2d82ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:35.423519 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f6e20-dc3e-4323-af68-8dd5fb2d82ca service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:35.423718 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f6e20-dc3e-4323-af68-8dd5fb2d82ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:35.423988 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f6e20-dc3e-4323-af68-8dd5fb2d82ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:35.439344 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f6e20-dc3e-4323-af68-8dd5fb2d82ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:35.442180 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f6e20-dc3e-4323-af68-8dd5fb2d82ca service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:35.457509 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1279/2570] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:28:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:28:36.345953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0e859-307f-43e6-b767-976ae6845e9e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:36.347436 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9ea0e859-307f-43e6-b767-976ae6845e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:36.544237 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0e859-307f-43e6-b767-976ae6845e9e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:36.559840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22934ba8-26e0-4f1f-8f01-060dc4c33e93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:36.566675 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22934ba8-26e0-4f1f-8f01-060dc4c33e93 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:36.566675 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22934ba8-26e0-4f1f-8f01-060dc4c33e93 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:36.566675 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22934ba8-26e0-4f1f-8f01-060dc4c33e93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:36.566675 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-22934ba8-26e0-4f1f-8f01-060dc4c33e93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:36.597447 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22934ba8-26e0-4f1f-8f01-060dc4c33e93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:36.598773 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22934ba8-26e0-4f1f-8f01-060dc4c33e93 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:36.615593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1292/2571] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:28:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:28:37.049873 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cff745-5bdd-4aa7-8697-c5102ad04d8f None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:37.050387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cff745-5bdd-4aa7-8697-c5102ad04d8f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:37.051985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cff745-5bdd-4aa7-8697-c5102ad04d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:37.088994 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-72cff745-5bdd-4aa7-8697-c5102ad04d8f None None] MFA Rules not processed for user `81a82c298b26449b84ad702d842b7932`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:37.090248 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-72cff745-5bdd-4aa7-8697-c5102ad04d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:37.160905 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:37.186959 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1280/2572] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:28:37.200674 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22934ba8-26e0-4f1f-8f01-060dc4c33e93 service nova] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:37.213969 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22934ba8-26e0-4f1f-8f01-060dc4c33e93 service nova] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:37.241936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb865b-fd34-48ca-99e7-ee24f38eed10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:37.241936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb865b-fd34-48ca-99e7-ee24f38eed10 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:37.241936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb865b-fd34-48ca-99e7-ee24f38eed10 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:37.241936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb865b-fd34-48ca-99e7-ee24f38eed10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:37.250555 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ddeb865b-fd34-48ca-99e7-ee24f38eed10 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:37.316240 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb865b-fd34-48ca-99e7-ee24f38eed10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:37.317824 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb865b-fd34-48ca-99e7-ee24f38eed10 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:37.328213 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1293/2573] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:28:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:28:39.356949 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cff745-5bdd-4aa7-8697-c5102ad04d8f None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:39.359282 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-72cff745-5bdd-4aa7-8697-c5102ad04d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:39.375771 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cff745-5bdd-4aa7-8697-c5102ad04d8f None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:39.421741 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71748fd8-df4b-4be9-bd7a-cdb9db8caf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:39.428392 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71748fd8-df4b-4be9-bd7a-cdb9db8caf76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:39.428694 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71748fd8-df4b-4be9-bd7a-cdb9db8caf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:39.435669 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71748fd8-df4b-4be9-bd7a-cdb9db8caf76 admin admin] PATH_INFO: `/v3/users/ea1296c96f44431ba369afa4046b432a` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:39.444734 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71748fd8-df4b-4be9-bd7a-cdb9db8caf76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea1296c96f44431ba369afa4046b432a)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:39.457212 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71748fd8-df4b-4be9-bd7a-cdb9db8caf76 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:39.773233 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-71748fd8-df4b-4be9-bd7a-cdb9db8caf76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea1296c96f44431ba369afa4046b432a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:39.856981 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-71748fd8-df4b-4be9-bd7a-cdb9db8caf76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea1296c96f44431ba369afa4046b432a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:39.872400 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-71748fd8-df4b-4be9-bd7a-cdb9db8caf76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea1296c96f44431ba369afa4046b432a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:39.873430 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-71748fd8-df4b-4be9-bd7a-cdb9db8caf76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea1296c96f44431ba369afa4046b432a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:39.881612 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-71748fd8-df4b-4be9-bd7a-cdb9db8caf76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea1296c96f44431ba369afa4046b432a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:39.888615 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1281/2574] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:28:39 2022] DELETE /identity/v3/users/ea1296c96f44431ba369afa4046b432a => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:28:39.893091 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4de9d-6ecb-4856-bd31-76b748ed0b1f None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:39.893552 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4de9d-6ecb-4856-bd31-76b748ed0b1f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:39.893790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d4de9d-6ecb-4856-bd31-76b748ed0b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:39.915597 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-33d4de9d-6ecb-4856-bd31-76b748ed0b1f None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:39.916993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-33d4de9d-6ecb-4856-bd31-76b748ed0b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:40.006914 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1294/2575] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:28:40.026533 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71748fd8-df4b-4be9-bd7a-cdb9db8caf76 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:40.030166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-71748fd8-df4b-4be9-bd7a-cdb9db8caf76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:40.040280 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4de9d-6ecb-4856-bd31-76b748ed0b1f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:40.045708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-33d4de9d-6ecb-4856-bd31-76b748ed0b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:40.072073 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:40.136002 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71748fd8-df4b-4be9-bd7a-cdb9db8caf76 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:40.142073 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775c3ed-e111-4a60-950f-f5846907b07f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3295306746f4552837f1bb12b2c500f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:40.142678 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775c3ed-e111-4a60-950f-f5846907b07f service placement] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:40.142960 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775c3ed-e111-4a60-950f-f5846907b07f service placement] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:40.143231 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2775c3ed-e111-4a60-950f-f5846907b07f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:40.145106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-2775c3ed-e111-4a60-950f-f5846907b07f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:40.166950 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775c3ed-e111-4a60-950f-f5846907b07f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:40.169494 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2775c3ed-e111-4a60-950f-f5846907b07f service placement] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:40.174790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d4de9d-6ecb-4856-bd31-76b748ed0b1f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:40.184555 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1282/2576] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:28:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:28:40.193167 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59d662-fcb3-490b-a68a-f5d3ea019df5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:40.193831 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59d662-fcb3-490b-a68a-f5d3ea019df5 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:40.194291 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59d662-fcb3-490b-a68a-f5d3ea019df5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:40.194575 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59d662-fcb3-490b-a68a-f5d3ea019df5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:40.227513 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59d662-fcb3-490b-a68a-f5d3ea019df5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:40.228980 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59d662-fcb3-490b-a68a-f5d3ea019df5 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:40.257590 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1295/2577] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:28:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:28:41.543660 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775c3ed-e111-4a60-950f-f5846907b07f service placement] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:41.545990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-2775c3ed-e111-4a60-950f-f5846907b07f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:41.565718 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2775c3ed-e111-4a60-950f-f5846907b07f service placement] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:41.572185 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c3ca6-eb5c-4394-be0d-c3ba284f4124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:41.573072 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c3ca6-eb5c-4394-be0d-c3ba284f4124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:41.573616 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c3ca6-eb5c-4394-be0d-c3ba284f4124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:41.574050 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c3ca6-eb5c-4394-be0d-c3ba284f4124 admin admin] PATH_INFO: `/v3/projects/758928cc47eb41f2935b4df2db634abc` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:41.576151 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c3ca6-eb5c-4394-be0d-c3ba284f4124 admin admin] RBAC: Authorizing `identity:delete_project(project_id=758928cc47eb41f2935b4df2db634abc)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:41.579101 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c3ca6-eb5c-4394-be0d-c3ba284f4124 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:41.749760 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:41.755157 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-710c3ca6-eb5c-4394-be0d-c3ba284f4124 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '758928cc47eb41f2935b4df2db634abc', 'request_id': 'req-710c3ca6-eb5c-4394-be0d-c3ba284f4124'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:41.821718 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b406d91-677b-4623-9f9f-6afb56f9025e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:41.822324 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b406d91-677b-4623-9f9f-6afb56f9025e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:41.822536 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b406d91-677b-4623-9f9f-6afb56f9025e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:41.857606 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8b406d91-677b-4623-9f9f-6afb56f9025e None None] MFA Rules not processed for user `8ff58811b016456ab3e51711a69f2d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:41.859030 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8b406d91-677b-4623-9f9f-6afb56f9025e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:41.872922 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-710c3ca6-eb5c-4394-be0d-c3ba284f4124 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '758928cc47eb41f2935b4df2db634abc', 'request_id': 'req-710c3ca6-eb5c-4394-be0d-c3ba284f4124'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:41.886526 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-710c3ca6-eb5c-4394-be0d-c3ba284f4124 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '758928cc47eb41f2935b4df2db634abc', 'request_id': 'req-710c3ca6-eb5c-4394-be0d-c3ba284f4124'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:41.908333 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-710c3ca6-eb5c-4394-be0d-c3ba284f4124 admin admin] The token cache is being invalidate because project 758928cc47eb41f2935b4df2db634abc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:28:41.908987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-710c3ca6-eb5c-4394-be0d-c3ba284f4124 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:41.910630 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-710c3ca6-eb5c-4394-be0d-c3ba284f4124 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:41.913914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1283/2578] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:28:41 2022] DELETE /identity/v3/projects/758928cc47eb41f2935b4df2db634abc => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:28:41.921257 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404d34a-b7ee-4510-8253-91041ab571ea None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:41.921795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404d34a-b7ee-4510-8253-91041ab571ea None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:41.922286 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404d34a-b7ee-4510-8253-91041ab571ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:41.969538 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-a404d34a-b7ee-4510-8253-91041ab571ea None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:41.971166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a404d34a-b7ee-4510-8253-91041ab571ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:42.037648 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1296/2579] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:28:42.149661 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1284/2580] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:28:42.157770 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce627c-39e6-4c82-8634-c4f77d07985d None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:42.158174 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce627c-39e6-4c82-8634-c4f77d07985d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:42.158700 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce627c-39e6-4c82-8634-c4f77d07985d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:42.209878 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-72ce627c-39e6-4c82-8634-c4f77d07985d None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:42.211101 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-72ce627c-39e6-4c82-8634-c4f77d07985d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:42.229268 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404d34a-b7ee-4510-8253-91041ab571ea None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:42.252234 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1297/2581] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:28:42.259337 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404d34a-b7ee-4510-8253-91041ab571ea None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:42.273607 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9effa-c228-487e-87af-5fd954878f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:42.274488 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9effa-c228-487e-87af-5fd954878f06 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:42.275085 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9effa-c228-487e-87af-5fd954878f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:42.275356 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea9effa-c228-487e-87af-5fd954878f06 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:42.276009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9effa-c228-487e-87af-5fd954878f06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:28:42.276342 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9effa-c228-487e-87af-5fd954878f06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:42.278013 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea9effa-c228-487e-87af-5fd954878f06 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:42.314639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1285/2582] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:28:42.316681 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce627c-39e6-4c82-8634-c4f77d07985d None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:42.335577 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce627c-39e6-4c82-8634-c4f77d07985d None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:42.351191 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920da96-e1c6-4ffa-8ca8-3d73fe5eb23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:42.352164 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920da96-e1c6-4ffa-8ca8-3d73fe5eb23c admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:42.352663 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920da96-e1c6-4ffa-8ca8-3d73fe5eb23c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:42.353664 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920da96-e1c6-4ffa-8ca8-3d73fe5eb23c admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:42.354704 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920da96-e1c6-4ffa-8ca8-3d73fe5eb23c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:42.357242 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920da96-e1c6-4ffa-8ca8-3d73fe5eb23c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:42.461998 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1298/2583] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:28:42 2022] POST /identity/v3/projects => generated 361 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:28:42.465913 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9effa-c228-487e-87af-5fd954878f06 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:42.478022 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea9effa-c228-487e-87af-5fd954878f06 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:42.625534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fff9d-bde7-4ba5-b7c7-a67b3bb2bacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:42.626449 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fff9d-bde7-4ba5-b7c7-a67b3bb2bacb admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:42.628087 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fff9d-bde7-4ba5-b7c7-a67b3bb2bacb admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:42.628425 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8fff9d-bde7-4ba5-b7c7-a67b3bb2bacb admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:42.629622 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8fff9d-bde7-4ba5-b7c7-a67b3bb2bacb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:42.633748 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8fff9d-bde7-4ba5-b7c7-a67b3bb2bacb admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:42.736212 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1286/2584] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:28:42 2022] POST /identity/v3/users => generated 281 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:28:42.743964 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920da96-e1c6-4ffa-8ca8-3d73fe5eb23c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:42.761619 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920da96-e1c6-4ffa-8ca8-3d73fe5eb23c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:42.796280 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d9ffa-0445-4613-95a6-d9e6b1bb62a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:42.797029 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d9ffa-0445-4613-95a6-d9e6b1bb62a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:42.797157 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d9ffa-0445-4613-95a6-d9e6b1bb62a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:42.798010 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d9ffa-0445-4613-95a6-d9e6b1bb62a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:42.799426 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d9ffa-0445-4613-95a6-d9e6b1bb62a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:42.801818 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0d9ffa-0445-4613-95a6-d9e6b1bb62a2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:42.827183 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1299/2585] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:28:42.832895 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fff9d-bde7-4ba5-b7c7-a67b3bb2bacb admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:42.847268 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8fff9d-bde7-4ba5-b7c7-a67b3bb2bacb admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:42.852857 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc90698-c704-4c86-a00d-811ac89bbec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:42.853482 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc90698-c704-4c86-a00d-811ac89bbec7 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:42.854108 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc90698-c704-4c86-a00d-811ac89bbec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:42.854537 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc90698-c704-4c86-a00d-811ac89bbec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:42.855485 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc90698-c704-4c86-a00d-811ac89bbec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:42.857214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc90698-c704-4c86-a00d-811ac89bbec7 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:42.882649 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1287/2586] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:28:42 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:28:42.886902 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d9ffa-0445-4613-95a6-d9e6b1bb62a2 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:42.908923 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d9ffa-0445-4613-95a6-d9e6b1bb62a2 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:42.914902 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcf037-a37a-4c83-b4aa-b229044d7eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:42.915835 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcf037-a37a-4c83-b4aa-b229044d7eac admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:42.922697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcf037-a37a-4c83-b4aa-b229044d7eac admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:42.922697 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdcf037-a37a-4c83-b4aa-b229044d7eac admin admin] PATH_INFO: `/v3/projects/22d27b98fd594391a064c599721c6b19/users/186786e1a7334a8f8bbd5c844abd2e75/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:42.960779 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdcf037-a37a-4c83-b4aa-b229044d7eac admin admin] RBAC: Authorizing `identity:create_grant(project_id=22d27b98fd594391a064c599721c6b19, user_id=186786e1a7334a8f8bbd5c844abd2e75, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:42.965193 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdcf037-a37a-4c83-b4aa-b229044d7eac admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:43.057064 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1300/2587] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:28:42 2022] PUT /identity/v3/projects/22d27b98fd594391a064c599721c6b19/users/186786e1a7334a8f8bbd5c844abd2e75/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:28:43.150489 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c623ad-5ad1-4673-8111-d18d3a8003b7 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:43.150605 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c623ad-5ad1-4673-8111-d18d3a8003b7 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:43.150883 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c623ad-5ad1-4673-8111-d18d3a8003b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:43.243536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-d7c623ad-5ad1-4673-8111-d18d3a8003b7 None None] MFA Rules not processed for user `186786e1a7334a8f8bbd5c844abd2e75`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:43.245982 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d7c623ad-5ad1-4673-8111-d18d3a8003b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:43.324922 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:43.408676 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1288/2588] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:28:43.460841 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcf037-a37a-4c83-b4aa-b229044d7eac admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:43.460841 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9bdcf037-a37a-4c83-b4aa-b229044d7eac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:43.470595 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1217e0d-b9dd-4ec1-94b8-db3b490ad699 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:43.470905 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1217e0d-b9dd-4ec1-94b8-db3b490ad699 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:43.471181 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1217e0d-b9dd-4ec1-94b8-db3b490ad699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:43.525661 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f1217e0d-b9dd-4ec1-94b8-db3b490ad699 None None] MFA Rules not processed for user `c4eae7912af24007ba5a099abe3a36b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:43.531849 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f1217e0d-b9dd-4ec1-94b8-db3b490ad699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:43.599185 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdcf037-a37a-4c83-b4aa-b229044d7eac admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:43.606345 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe69ca4-a941-4c5f-a412-9e63faa7de69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:43.607122 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe69ca4-a941-4c5f-a412-9e63faa7de69 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:43.607419 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe69ca4-a941-4c5f-a412-9e63faa7de69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:43.607692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe69ca4-a941-4c5f-a412-9e63faa7de69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:43.620886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe69ca4-a941-4c5f-a412-9e63faa7de69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:43.622537 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe69ca4-a941-4c5f-a412-9e63faa7de69 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:43.640224 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1289/2589] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:28:43.648552 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:43.657669 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1301/2590] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:28:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:28:43.665241 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1217e0d-b9dd-4ec1-94b8-db3b490ad699 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:43.667059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f1217e0d-b9dd-4ec1-94b8-db3b490ad699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:43.677267 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe69ca4-a941-4c5f-a412-9e63faa7de69 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:43.863631 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1217e0d-b9dd-4ec1-94b8-db3b490ad699 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:43.873882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05265b9c-e85b-4790-9257-a1552d39afd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:43.874584 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05265b9c-e85b-4790-9257-a1552d39afd2 service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:43.874865 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05265b9c-e85b-4790-9257-a1552d39afd2 service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:43.875143 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05265b9c-e85b-4790-9257-a1552d39afd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:43.885689 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05265b9c-e85b-4790-9257-a1552d39afd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:43.887676 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05265b9c-e85b-4790-9257-a1552d39afd2 service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:43.910979 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1290/2591] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:28:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:28:43.914499 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d92ea4-c6c1-4556-b4e2-a1a6d3de3a71 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:43.914499 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d92ea4-c6c1-4556-b4e2-a1a6d3de3a71 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:43.914710 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d92ea4-c6c1-4556-b4e2-a1a6d3de3a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:43.931892 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe69ca4-a941-4c5f-a412-9e63faa7de69 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:43.956798 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890f0c8-2c65-42f5-872a-c2e4029c4e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:43.957559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890f0c8-2c65-42f5-872a-c2e4029c4e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:43.958046 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890f0c8-2c65-42f5-872a-c2e4029c4e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:43.958358 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890f0c8-2c65-42f5-872a-c2e4029c4e59 admin admin] PATH_INFO: `/v3/users/186786e1a7334a8f8bbd5c844abd2e75` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:43.960875 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890f0c8-2c65-42f5-872a-c2e4029c4e59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=186786e1a7334a8f8bbd5c844abd2e75)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:43.964018 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-33d92ea4-c6c1-4556-b4e2-a1a6d3de3a71 None None] MFA Rules not processed for user `0ba7376671a24d35a920e0ec3290472b`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:43.964167 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890f0c8-2c65-42f5-872a-c2e4029c4e59 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:43.969960 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-33d92ea4-c6c1-4556-b4e2-a1a6d3de3a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:44.112636 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1291/2592] 10.222.0.81 () {58 vars in 1009 bytes} [Tue Sep 6 21:28:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:28:44.133164 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d92ea4-c6c1-4556-b4e2-a1a6d3de3a71 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:44.135345 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-33d92ea4-c6c1-4556-b4e2-a1a6d3de3a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:44.290605 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c890f0c8-2c65-42f5-872a-c2e4029c4e59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '186786e1a7334a8f8bbd5c844abd2e75'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:44.297340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d92ea4-c6c1-4556-b4e2-a1a6d3de3a71 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:44.304302 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6582f-1ef7-41fd-8141-de7e3422a442 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0aac45d8b549afafae0a3f623bce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:44.305149 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6582f-1ef7-41fd-8141-de7e3422a442 service swift] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:44.305481 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6582f-1ef7-41fd-8141-de7e3422a442 service swift] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:44.305731 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6582f-1ef7-41fd-8141-de7e3422a442 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:44.323721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6582f-1ef7-41fd-8141-de7e3422a442 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:44.325804 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6582f-1ef7-41fd-8141-de7e3422a442 service swift] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:44.341291 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:44.347131 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1292/2593] 10.222.0.81 () {60 vars in 1384 bytes} [Tue Sep 6 21:28:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 06 21:28:44.372142 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c890f0c8-2c65-42f5-872a-c2e4029c4e59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '186786e1a7334a8f8bbd5c844abd2e75'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:44.405681 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c890f0c8-2c65-42f5-872a-c2e4029c4e59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '186786e1a7334a8f8bbd5c844abd2e75'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:44.406621 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c890f0c8-2c65-42f5-872a-c2e4029c4e59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '186786e1a7334a8f8bbd5c844abd2e75'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:44.424668 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c890f0c8-2c65-42f5-872a-c2e4029c4e59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '186786e1a7334a8f8bbd5c844abd2e75'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:44.433764 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1302/2594] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:28:43 2022] DELETE /identity/v3/users/186786e1a7334a8f8bbd5c844abd2e75 => generated 0 bytes in 757 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:28:44.438103 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e77cfc-0f2c-4731-ad36-f9eb31a16b2f None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:44.438845 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e77cfc-0f2c-4731-ad36-f9eb31a16b2f None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:44.439353 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e77cfc-0f2c-4731-ad36-f9eb31a16b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:44.496200 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-14e77cfc-0f2c-4731-ad36-f9eb31a16b2f None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:44.497492 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-14e77cfc-0f2c-4731-ad36-f9eb31a16b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:44.648619 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1293/2595] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:28:44.658735 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890f0c8-2c65-42f5-872a-c2e4029c4e59 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:44.660611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c890f0c8-2c65-42f5-872a-c2e4029c4e59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:44.776879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890f0c8-2c65-42f5-872a-c2e4029c4e59 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:44.782088 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8ac109-cb68-4e67-a044-4aa23eff711d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:44.783327 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ac109-cb68-4e67-a044-4aa23eff711d service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:44.783628 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ac109-cb68-4e67-a044-4aa23eff711d service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:44.783945 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8ac109-cb68-4e67-a044-4aa23eff711d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:44.800146 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ac109-cb68-4e67-a044-4aa23eff711d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:44.801580 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8ac109-cb68-4e67-a044-4aa23eff711d service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:44.813868 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1303/2596] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:28:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:28:45.495686 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e77cfc-0f2c-4731-ad36-f9eb31a16b2f None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:45.501245 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-14e77cfc-0f2c-4731-ad36-f9eb31a16b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:45.545801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e77cfc-0f2c-4731-ad36-f9eb31a16b2f None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:45.586182 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a291e0-94bd-4e52-b78a-1c35b1721960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:45.590192 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a291e0-94bd-4e52-b78a-1c35b1721960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:45.597666 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a291e0-94bd-4e52-b78a-1c35b1721960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:45.597944 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a291e0-94bd-4e52-b78a-1c35b1721960 admin admin] PATH_INFO: `/v3/projects/22d27b98fd594391a064c599721c6b19` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:45.605708 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a291e0-94bd-4e52-b78a-1c35b1721960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22d27b98fd594391a064c599721c6b19)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:45.609455 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a291e0-94bd-4e52-b78a-1c35b1721960 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:45.801674 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-47a291e0-94bd-4e52-b78a-1c35b1721960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22d27b98fd594391a064c599721c6b19', 'request_id': 'req-47a291e0-94bd-4e52-b78a-1c35b1721960'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:45.904060 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-47a291e0-94bd-4e52-b78a-1c35b1721960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22d27b98fd594391a064c599721c6b19', 'request_id': 'req-47a291e0-94bd-4e52-b78a-1c35b1721960'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:45.915063 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-47a291e0-94bd-4e52-b78a-1c35b1721960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22d27b98fd594391a064c599721c6b19', 'request_id': 'req-47a291e0-94bd-4e52-b78a-1c35b1721960'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:45.924525 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:45.945226 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-47a291e0-94bd-4e52-b78a-1c35b1721960 admin admin] The token cache is being invalidate because project 22d27b98fd594391a064c599721c6b19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:28:45.945450 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-47a291e0-94bd-4e52-b78a-1c35b1721960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:45.946326 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-47a291e0-94bd-4e52-b78a-1c35b1721960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:28:45.956143 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1294/2597] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:28:45 2022] DELETE /identity/v3/projects/22d27b98fd594391a064c599721c6b19 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:28:45.960369 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823eb37-3864-4834-bf3f-27e528a83672 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:45.961011 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823eb37-3864-4834-bf3f-27e528a83672 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:45.961011 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823eb37-3864-4834-bf3f-27e528a83672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:46.012849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-2823eb37-3864-4834-bf3f-27e528a83672 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:46.014453 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2823eb37-3864-4834-bf3f-27e528a83672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:46.037932 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:46.118405 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1304/2598] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:28:46.125091 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f4fc7-d99e-4718-a731-ab510af71fb4 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:46.125496 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f4fc7-d99e-4718-a731-ab510af71fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:46.127166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f4fc7-d99e-4718-a731-ab510af71fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:46.154386 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-132f4fc7-d99e-4718-a731-ab510af71fb4 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:46.155657 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-132f4fc7-d99e-4718-a731-ab510af71fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:46.184198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1295/2599] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:28:46.192738 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823eb37-3864-4834-bf3f-27e528a83672 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:46.203094 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823eb37-3864-4834-bf3f-27e528a83672 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:46.216699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc920c3-658b-489a-b3bf-5d1a28319c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:46.218168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc920c3-658b-489a-b3bf-5d1a28319c8c admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:46.218168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc920c3-658b-489a-b3bf-5d1a28319c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:46.218168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc920c3-658b-489a-b3bf-5d1a28319c8c admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:46.218679 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc920c3-658b-489a-b3bf-5d1a28319c8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:28:46.218984 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc920c3-658b-489a-b3bf-5d1a28319c8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:46.220724 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc920c3-658b-489a-b3bf-5d1a28319c8c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:46.260148 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1305/2600] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:28:46.263031 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f4fc7-d99e-4718-a731-ab510af71fb4 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:46.287102 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f4fc7-d99e-4718-a731-ab510af71fb4 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:46.299177 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c432e3-fafb-48eb-a090-f65a217128b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:46.299958 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c432e3-fafb-48eb-a090-f65a217128b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:46.300077 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c432e3-fafb-48eb-a090-f65a217128b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:46.300413 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c432e3-fafb-48eb-a090-f65a217128b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:46.301067 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c432e3-fafb-48eb-a090-f65a217128b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:46.304267 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c432e3-fafb-48eb-a090-f65a217128b6 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:46.471795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1296/2601] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:28:46 2022] POST /identity/v3/projects => generated 385 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:28:46.473188 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc920c3-658b-489a-b3bf-5d1a28319c8c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:46.490257 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc920c3-658b-489a-b3bf-5d1a28319c8c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:46.666236 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf213b-4c21-40fb-ac2d-9d20e25361e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:46.667160 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf213b-4c21-40fb-ac2d-9d20e25361e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:46.684165 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf213b-4c21-40fb-ac2d-9d20e25361e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:46.685186 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf213b-4c21-40fb-ac2d-9d20e25361e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:46.688083 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf213b-4c21-40fb-ac2d-9d20e25361e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:46.688083 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecf213b-4c21-40fb-ac2d-9d20e25361e7 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:46.794796 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1306/2602] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:28:46 2022] POST /identity/v3/users => generated 293 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:28:46.799667 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c432e3-fafb-48eb-a090-f65a217128b6 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:46.815919 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c432e3-fafb-48eb-a090-f65a217128b6 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:46.833643 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cc179-7f38-4c5e-b86e-535657004e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:46.834949 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cc179-7f38-4c5e-b86e-535657004e85 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:46.834949 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cc179-7f38-4c5e-b86e-535657004e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:46.834949 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99cc179-7f38-4c5e-b86e-535657004e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:46.835492 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99cc179-7f38-4c5e-b86e-535657004e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:46.837700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99cc179-7f38-4c5e-b86e-535657004e85 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:46.861475 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1297/2603] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:28:46.865962 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf213b-4c21-40fb-ac2d-9d20e25361e7 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:46.887431 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecf213b-4c21-40fb-ac2d-9d20e25361e7 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:46.903739 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80120540-5936-4954-b801-e178e96fbaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:46.922691 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80120540-5936-4954-b801-e178e96fbaf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:46.923323 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80120540-5936-4954-b801-e178e96fbaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:46.923751 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80120540-5936-4954-b801-e178e96fbaf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:46.925025 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80120540-5936-4954-b801-e178e96fbaf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:46.930737 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80120540-5936-4954-b801-e178e96fbaf1 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:46.979998 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1307/2604] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:28:46.981318 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cc179-7f38-4c5e-b86e-535657004e85 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:46.996412 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99cc179-7f38-4c5e-b86e-535657004e85 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:47.010105 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5af79-8bec-4571-b54c-33db037ae491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:47.010907 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5af79-8bec-4571-b54c-33db037ae491 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:47.011193 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5af79-8bec-4571-b54c-33db037ae491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:47.012715 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5af79-8bec-4571-b54c-33db037ae491 admin admin] PATH_INFO: `/v3/projects/5a00f3ea8c6146f297580abb80e9f88d/users/d121d74479cb4748abb33bb914993d98/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:47.059262 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5af79-8bec-4571-b54c-33db037ae491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a00f3ea8c6146f297580abb80e9f88d, user_id=d121d74479cb4748abb33bb914993d98, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:47.062055 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5af79-8bec-4571-b54c-33db037ae491 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:47.206043 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1298/2605] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:28:46 2022] PUT /identity/v3/projects/5a00f3ea8c6146f297580abb80e9f88d/users/d121d74479cb4748abb33bb914993d98/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:28:47.219774 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b624a-f7ed-4df9-94ae-96e73123ac65 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:47.220337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b624a-f7ed-4df9-94ae-96e73123ac65 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:47.220812 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b624a-f7ed-4df9-94ae-96e73123ac65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:47.291668 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-e74b624a-f7ed-4df9-94ae-96e73123ac65 None None] MFA Rules not processed for user `d121d74479cb4748abb33bb914993d98`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:47.293626 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e74b624a-f7ed-4df9-94ae-96e73123ac65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:47.454768 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1308/2606] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:28:47.459993 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5af79-8bec-4571-b54c-33db037ae491 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:47.620403 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5af79-8bec-4571-b54c-33db037ae491 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:47.634473 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf200c-24ba-4b70-a090-39ed9b4f6250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:47.635381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf200c-24ba-4b70-a090-39ed9b4f6250 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:47.635731 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf200c-24ba-4b70-a090-39ed9b4f6250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:47.636005 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf200c-24ba-4b70-a090-39ed9b4f6250 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:47.636684 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf200c-24ba-4b70-a090-39ed9b4f6250 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:47.638728 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf200c-24ba-4b70-a090-39ed9b4f6250 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:47.778974 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b624a-f7ed-4df9-94ae-96e73123ac65 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:47.780156 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1299/2607] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:28:47 2022] POST /identity/v3/projects => generated 383 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:28:47.807783 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0d063-7337-496b-a248-af3c6feab538 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:47.807783 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0d063-7337-496b-a248-af3c6feab538 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:47.807783 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0d063-7337-496b-a248-af3c6feab538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:47.829294 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b624a-f7ed-4df9-94ae-96e73123ac65 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:47.878981 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-bce0d063-7337-496b-a248-af3c6feab538 None None] MFA Rules not processed for user `c4eae7912af24007ba5a099abe3a36b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:47.882579 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-bce0d063-7337-496b-a248-af3c6feab538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:47.904245 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:48.046571 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c319b-5f25-40aa-b5fe-005254ef58a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:48.047277 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c319b-5f25-40aa-b5fe-005254ef58a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:48.054527 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c319b-5f25-40aa-b5fe-005254ef58a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:48.055137 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c319b-5f25-40aa-b5fe-005254ef58a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:48.056452 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c319b-5f25-40aa-b5fe-005254ef58a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:48.061299 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1300/2608] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:28:48.061940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c319b-5f25-40aa-b5fe-005254ef58a5 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:48.242640 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1309/2609] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:28:47 2022] POST /identity/v3/users => generated 292 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:28:48.247372 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0d063-7337-496b-a248-af3c6feab538 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:48.276361 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0d063-7337-496b-a248-af3c6feab538 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:48.298846 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8ef2a-f233-4c61-850e-a81dac8aedd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:48.299806 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8ef2a-f233-4c61-850e-a81dac8aedd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:48.300505 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8ef2a-f233-4c61-850e-a81dac8aedd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:48.300505 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f8ef2a-f233-4c61-850e-a81dac8aedd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:48.301052 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8ef2a-f233-4c61-850e-a81dac8aedd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:48.302995 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f8ef2a-f233-4c61-850e-a81dac8aedd5 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:48.321353 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1301/2610] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:28:48.322308 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c319b-5f25-40aa-b5fe-005254ef58a5 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:48.342803 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c319b-5f25-40aa-b5fe-005254ef58a5 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:48.360959 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f15fb0-a598-4794-a6c6-0b03aad74ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:48.361713 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f15fb0-a598-4794-a6c6-0b03aad74ecf admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:48.362084 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f15fb0-a598-4794-a6c6-0b03aad74ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:48.362379 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f15fb0-a598-4794-a6c6-0b03aad74ecf admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:48.363329 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f15fb0-a598-4794-a6c6-0b03aad74ecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:48.364920 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f15fb0-a598-4794-a6c6-0b03aad74ecf admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:48.389634 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1310/2611] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:28:48 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:28:48.394293 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8ef2a-f233-4c61-850e-a81dac8aedd5 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:48.423747 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f8ef2a-f233-4c61-850e-a81dac8aedd5 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:48.450558 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d3865-9f68-476d-9615-f8dd7172b53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:48.453191 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d3865-9f68-476d-9615-f8dd7172b53d admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:48.454470 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d3865-9f68-476d-9615-f8dd7172b53d admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:48.456690 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d3865-9f68-476d-9615-f8dd7172b53d admin admin] PATH_INFO: `/v3/projects/e2ce2d54caa34520a74bfbffed716fcf/users/615c8676362e49028223eb2d30a98e63/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:48.481414 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:48.489284 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d3865-9f68-476d-9615-f8dd7172b53d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2ce2d54caa34520a74bfbffed716fcf, user_id=615c8676362e49028223eb2d30a98e63, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:48.492385 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d3865-9f68-476d-9615-f8dd7172b53d admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:48.562656 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1302/2612] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:28:48 2022] PUT /identity/v3/projects/e2ce2d54caa34520a74bfbffed716fcf/users/615c8676362e49028223eb2d30a98e63/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:28:48.576636 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819badf-582f-4d64-b47c-ec738db61ab0 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:48.577168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819badf-582f-4d64-b47c-ec738db61ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:48.578523 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819badf-582f-4d64-b47c-ec738db61ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:48.622144 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-e819badf-582f-4d64-b47c-ec738db61ab0 None None] MFA Rules not processed for user `615c8676362e49028223eb2d30a98e63`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:48.628386 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e819badf-582f-4d64-b47c-ec738db61ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:48.798401 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1311/2613] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:28:48.801424 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d3865-9f68-476d-9615-f8dd7172b53d admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:48.933910 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d3865-9f68-476d-9615-f8dd7172b53d admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:48.941409 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74e5ad-2516-4b99-b146-207e08a19324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:48.942656 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74e5ad-2516-4b99-b146-207e08a19324 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:48.943623 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74e5ad-2516-4b99-b146-207e08a19324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:48.944028 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74e5ad-2516-4b99-b146-207e08a19324 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:48.947062 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74e5ad-2516-4b99-b146-207e08a19324 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:48.949995 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74e5ad-2516-4b99-b146-207e08a19324 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:49.079129 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1303/2614] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:28:48 2022] POST /identity/v3/projects => generated 385 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:28:49.083056 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819badf-582f-4d64-b47c-ec738db61ab0 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:49.107542 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819badf-582f-4d64-b47c-ec738db61ab0 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:49.231551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45140c-7cfd-40f4-8897-898046f55f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:49.232248 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45140c-7cfd-40f4-8897-898046f55f37 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:49.232533 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45140c-7cfd-40f4-8897-898046f55f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:49.232816 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45140c-7cfd-40f4-8897-898046f55f37 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:49.233513 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45140c-7cfd-40f4-8897-898046f55f37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:49.235470 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45140c-7cfd-40f4-8897-898046f55f37 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:49.400665 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1312/2615] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:28:49 2022] POST /identity/v3/users => generated 299 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:28:49.404609 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74e5ad-2516-4b99-b146-207e08a19324 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:49.434678 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74e5ad-2516-4b99-b146-207e08a19324 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:49.456144 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8e084-2bcd-4f64-ba82-df9834f73376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:49.456874 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8e084-2bcd-4f64-ba82-df9834f73376 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:49.457175 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8e084-2bcd-4f64-ba82-df9834f73376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:49.457451 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8e084-2bcd-4f64-ba82-df9834f73376 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:49.461600 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c8e084-2bcd-4f64-ba82-df9834f73376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:49.463502 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c8e084-2bcd-4f64-ba82-df9834f73376 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:49.486923 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1304/2616] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:28:49.490900 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45140c-7cfd-40f4-8897-898046f55f37 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:49.506657 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45140c-7cfd-40f4-8897-898046f55f37 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:49.534489 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce7499-9ff8-4b6d-ba40-5ba9324db126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:49.535202 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce7499-9ff8-4b6d-ba40-5ba9324db126 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:49.535489 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce7499-9ff8-4b6d-ba40-5ba9324db126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:49.535765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ce7499-9ff8-4b6d-ba40-5ba9324db126 admin admin] PATH_INFO: `/v3/projects/3d18eafa2b8e4bb3912403e6f1e34d79/users/3ca15f43a66b4a90920316adbdbe1867/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:49.570634 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:49.577715 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce7499-9ff8-4b6d-ba40-5ba9324db126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d18eafa2b8e4bb3912403e6f1e34d79, user_id=3ca15f43a66b4a90920316adbdbe1867, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:49.585210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ce7499-9ff8-4b6d-ba40-5ba9324db126 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:49.741310 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1313/2617] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:28:49 2022] PUT /identity/v3/projects/3d18eafa2b8e4bb3912403e6f1e34d79/users/3ca15f43a66b4a90920316adbdbe1867/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:28:49.742830 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8e084-2bcd-4f64-ba82-df9834f73376 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:49.889554 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8e084-2bcd-4f64-ba82-df9834f73376 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:50.054479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4742c61-546b-46b2-9a4c-98e5ab9e9dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:50.055223 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4742c61-546b-46b2-9a4c-98e5ab9e9dfa admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:50.055507 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4742c61-546b-46b2-9a4c-98e5ab9e9dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:50.055761 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4742c61-546b-46b2-9a4c-98e5ab9e9dfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:50.056455 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4742c61-546b-46b2-9a4c-98e5ab9e9dfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:50.058048 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4742c61-546b-46b2-9a4c-98e5ab9e9dfa admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:50.075848 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1305/2618] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:28:49 2022] GET /identity/v3/roles => generated 1420 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:28:50.085818 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce7499-9ff8-4b6d-ba40-5ba9324db126 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:50.199440 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ce7499-9ff8-4b6d-ba40-5ba9324db126 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:50.217400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf1a67-c3b8-4ccc-9316-4a7e3e9b6387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:50.225031 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf1a67-c3b8-4ccc-9316-4a7e3e9b6387 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:50.225031 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf1a67-c3b8-4ccc-9316-4a7e3e9b6387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:50.225031 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf1a67-c3b8-4ccc-9316-4a7e3e9b6387 admin admin] PATH_INFO: `/v3/projects/3d18eafa2b8e4bb3912403e6f1e34d79/users/3ca15f43a66b4a90920316adbdbe1867/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:50.226603 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf1a67-c3b8-4ccc-9316-4a7e3e9b6387 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d18eafa2b8e4bb3912403e6f1e34d79, user_id=3ca15f43a66b4a90920316adbdbe1867, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:50.229568 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf1a67-c3b8-4ccc-9316-4a7e3e9b6387 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:50.255007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1314/2619] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:28:50 2022] PUT /identity/v3/projects/3d18eafa2b8e4bb3912403e6f1e34d79/users/3ca15f43a66b4a90920316adbdbe1867/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:28:50.264329 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d28d6-82fe-45ab-925f-9fdb743bc653 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:50.264607 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d28d6-82fe-45ab-925f-9fdb743bc653 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:50.271789 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d28d6-82fe-45ab-925f-9fdb743bc653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:50.529059 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:50.534435 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-6f1d28d6-82fe-45ab-925f-9fdb743bc653 None None] MFA Rules not processed for user `3ca15f43a66b4a90920316adbdbe1867`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:28:50.537550 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6f1d28d6-82fe-45ab-925f-9fdb743bc653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:50.650223 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1306/2620] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:28:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:28:50.673959 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf1a67-c3b8-4ccc-9316-4a7e3e9b6387 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:50.676303 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b5bf1a67-c3b8-4ccc-9316-4a7e3e9b6387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:50.875001 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf1a67-c3b8-4ccc-9316-4a7e3e9b6387 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:50.878746 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd91e06-e386-414a-b258-728bd6c8be9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:50.879377 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd91e06-e386-414a-b258-728bd6c8be9c service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:50.879652 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd91e06-e386-414a-b258-728bd6c8be9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:50.879950 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd91e06-e386-414a-b258-728bd6c8be9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:50.994140 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd91e06-e386-414a-b258-728bd6c8be9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:50.996333 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd91e06-e386-414a-b258-728bd6c8be9c service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:51.011420 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1315/2621] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:28:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:28:53.010129 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d28d6-82fe-45ab-925f-9fdb743bc653 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:53.011853 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6f1d28d6-82fe-45ab-925f-9fdb743bc653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:53.103799 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d28d6-82fe-45ab-925f-9fdb743bc653 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:53.107913 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f122b0-91d1-4275-b64e-a24be0346bf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:53.108618 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f122b0-91d1-4275-b64e-a24be0346bf1 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:53.108884 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f122b0-91d1-4275-b64e-a24be0346bf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:53.109157 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f122b0-91d1-4275-b64e-a24be0346bf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:53.110977 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-86f122b0-91d1-4275-b64e-a24be0346bf1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:53.121696 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f122b0-91d1-4275-b64e-a24be0346bf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:53.123184 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f122b0-91d1-4275-b64e-a24be0346bf1 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:53.132786 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1307/2622] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:28:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:28:53.847807 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd91e06-e386-414a-b258-728bd6c8be9c service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:53.849965 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4dd91e06-e386-414a-b258-728bd6c8be9c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:53.861651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd91e06-e386-414a-b258-728bd6c8be9c service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:53.866092 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afb475-14ba-4a07-aee8-029dab1ed9f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:53.866829 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afb475-14ba-4a07-aee8-029dab1ed9f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:53.867178 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afb475-14ba-4a07-aee8-029dab1ed9f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:53.867468 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1afb475-14ba-4a07-aee8-029dab1ed9f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:53.877904 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:28:53.924923 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1afb475-14ba-4a07-aee8-029dab1ed9f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:53.926312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1afb475-14ba-4a07-aee8-029dab1ed9f0 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:53.936237 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1316/2623] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:28:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:28:55.508812 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f122b0-91d1-4275-b64e-a24be0346bf1 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:55.518786 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f122b0-91d1-4275-b64e-a24be0346bf1 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:55.522470 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e729fc8-6114-4010-b892-c5790163f51f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:55.523191 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e729fc8-6114-4010-b892-c5790163f51f service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:55.523564 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e729fc8-6114-4010-b892-c5790163f51f service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:55.524073 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e729fc8-6114-4010-b892-c5790163f51f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:55.533648 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e729fc8-6114-4010-b892-c5790163f51f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:55.535116 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e729fc8-6114-4010-b892-c5790163f51f service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:55.544932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1308/2624] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:28:55 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:28:57.432185 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afb475-14ba-4a07-aee8-029dab1ed9f0 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:28:57.442676 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1afb475-14ba-4a07-aee8-029dab1ed9f0 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:28:57.446616 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592d516-257a-4cd8-a8e9-af65e61cdad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:28:57.447236 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592d516-257a-4cd8-a8e9-af65e61cdad8 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:28:57.447517 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592d516-257a-4cd8-a8e9-af65e61cdad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:28:57.447799 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592d516-257a-4cd8-a8e9-af65e61cdad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:28:57.449707 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e592d516-257a-4cd8-a8e9-af65e61cdad8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:28:57.460726 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592d516-257a-4cd8-a8e9-af65e61cdad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:28:57.462804 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592d516-257a-4cd8-a8e9-af65e61cdad8 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:28:57.470687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1317/2625] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:28:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:29:00.484960 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f787e0f-c541-4061-8420-06fcfaacabc4 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:00.485461 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f787e0f-c541-4061-8420-06fcfaacabc4 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:00.485556 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f787e0f-c541-4061-8420-06fcfaacabc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:00.524231 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-6f787e0f-c541-4061-8420-06fcfaacabc4 None None] MFA Rules not processed for user `0ba7376671a24d35a920e0ec3290472b`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:29:00.524814 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6f787e0f-c541-4061-8420-06fcfaacabc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:29:00.525307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592d516-257a-4cd8-a8e9-af65e61cdad8 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:00.584490 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1309/2626] 10.222.0.81 () {58 vars in 967 bytes} [Tue Sep 6 21:29:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:29:00.597891 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f787e0f-c541-4061-8420-06fcfaacabc4 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:00.599863 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6f787e0f-c541-4061-8420-06fcfaacabc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:29:00.606678 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=100 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:29:00.625149 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592d516-257a-4cd8-a8e9-af65e61cdad8 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:00.630552 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdfd20-7a5e-4c3c-996e-3c50de5704f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:00.631179 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdfd20-7a5e-4c3c-996e-3c50de5704f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:00.631458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdfd20-7a5e-4c3c-996e-3c50de5704f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:00.631730 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdfd20-7a5e-4c3c-996e-3c50de5704f1 admin admin] PATH_INFO: `/v3/users/d121d74479cb4748abb33bb914993d98` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:00.632930 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bdfd20-7a5e-4c3c-996e-3c50de5704f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d121d74479cb4748abb33bb914993d98)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:00.634815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bdfd20-7a5e-4c3c-996e-3c50de5704f1 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:00.676607 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f787e0f-c541-4061-8420-06fcfaacabc4 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:00.682683 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87de9ec-e0d2-4747-8b4d-c593000c27c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf0aac45d8b549afafae0a3f623bce46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:00.686497 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87de9ec-e0d2-4747-8b4d-c593000c27c0 service swift] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:00.686497 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87de9ec-e0d2-4747-8b4d-c593000c27c0 service swift] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:00.686497 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87de9ec-e0d2-4747-8b4d-c593000c27c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:00.697233 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87de9ec-e0d2-4747-8b4d-c593000c27c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:00.700139 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87de9ec-e0d2-4747-8b4d-c593000c27c0 service swift] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:00.707844 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1310/2627] 10.222.0.81 () {60 vars in 1384 bytes} [Tue Sep 6 21:29:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 06 21:29:01.007735 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b5bdfd20-7a5e-4c3c-996e-3c50de5704f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd121d74479cb4748abb33bb914993d98'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:01.102651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b5bdfd20-7a5e-4c3c-996e-3c50de5704f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd121d74479cb4748abb33bb914993d98'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:01.117926 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b5bdfd20-7a5e-4c3c-996e-3c50de5704f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd121d74479cb4748abb33bb914993d98'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:01.120024 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b5bdfd20-7a5e-4c3c-996e-3c50de5704f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd121d74479cb4748abb33bb914993d98'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:01.127251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-b5bdfd20-7a5e-4c3c-996e-3c50de5704f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd121d74479cb4748abb33bb914993d98'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:01.133597 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1318/2628] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:29:00 2022] DELETE /identity/v3/users/d121d74479cb4748abb33bb914993d98 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:29:01.138324 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e32c00-0957-4252-9892-03638b459d45 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:01.138632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e32c00-0957-4252-9892-03638b459d45 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:01.139000 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e32c00-0957-4252-9892-03638b459d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:01.170619 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-b7e32c00-0957-4252-9892-03638b459d45 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:29:01.172432 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b7e32c00-0957-4252-9892-03638b459d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:29:01.235736 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1311/2629] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:29:01.248851 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdfd20-7a5e-4c3c-996e-3c50de5704f1 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:01.250423 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-b5bdfd20-7a5e-4c3c-996e-3c50de5704f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:29:01.271311 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:29:01.310692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdfd20-7a5e-4c3c-996e-3c50de5704f1 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:01.314316 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecded5d-1682-4738-8b66-f31171d427ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:01.314940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecded5d-1682-4738-8b66-f31171d427ec service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:01.315207 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecded5d-1682-4738-8b66-f31171d427ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:01.315482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecded5d-1682-4738-8b66-f31171d427ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:01.324908 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecded5d-1682-4738-8b66-f31171d427ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:01.326333 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecded5d-1682-4738-8b66-f31171d427ec service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:01.336720 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1319/2630] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:29:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:29:01.869224 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e32c00-0957-4252-9892-03638b459d45 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:01.871240 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b7e32c00-0957-4252-9892-03638b459d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:29:01.887107 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e32c00-0957-4252-9892-03638b459d45 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:01.898905 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5258668-8aa0-4189-bb5e-d31bc7e9ed82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:01.900044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5258668-8aa0-4189-bb5e-d31bc7e9ed82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:01.900850 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5258668-8aa0-4189-bb5e-d31bc7e9ed82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:01.900850 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5258668-8aa0-4189-bb5e-d31bc7e9ed82 admin admin] PATH_INFO: `/v3/projects/5a00f3ea8c6146f297580abb80e9f88d` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:01.909719 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5258668-8aa0-4189-bb5e-d31bc7e9ed82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a00f3ea8c6146f297580abb80e9f88d)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:01.911695 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5258668-8aa0-4189-bb5e-d31bc7e9ed82 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:02.034727 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b5258668-8aa0-4189-bb5e-d31bc7e9ed82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a00f3ea8c6146f297580abb80e9f88d', 'request_id': 'req-b5258668-8aa0-4189-bb5e-d31bc7e9ed82'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:02.125133 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b5258668-8aa0-4189-bb5e-d31bc7e9ed82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a00f3ea8c6146f297580abb80e9f88d', 'request_id': 'req-b5258668-8aa0-4189-bb5e-d31bc7e9ed82'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:02.131403 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b5258668-8aa0-4189-bb5e-d31bc7e9ed82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a00f3ea8c6146f297580abb80e9f88d', 'request_id': 'req-b5258668-8aa0-4189-bb5e-d31bc7e9ed82'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:02.142574 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b5258668-8aa0-4189-bb5e-d31bc7e9ed82 admin admin] The token cache is being invalidate because project 5a00f3ea8c6146f297580abb80e9f88d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:29:02.142865 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b5258668-8aa0-4189-bb5e-d31bc7e9ed82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:02.143503 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b5258668-8aa0-4189-bb5e-d31bc7e9ed82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:02.145004 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1312/2631] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:29:01 2022] DELETE /identity/v3/projects/5a00f3ea8c6146f297580abb80e9f88d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:29:02.149096 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecded5d-1682-4738-8b66-f31171d427ec service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:02.158687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecded5d-1682-4738-8b66-f31171d427ec service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:02.222931 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95261ba0-ead3-4c13-afab-8bd3ac2e7f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:02.223488 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95261ba0-ead3-4c13-afab-8bd3ac2e7f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:02.223773 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95261ba0-ead3-4c13-afab-8bd3ac2e7f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:02.224054 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95261ba0-ead3-4c13-afab-8bd3ac2e7f18 admin admin] PATH_INFO: `/v3/users/615c8676362e49028223eb2d30a98e63` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:02.225758 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95261ba0-ead3-4c13-afab-8bd3ac2e7f18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=615c8676362e49028223eb2d30a98e63)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:02.227675 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95261ba0-ead3-4c13-afab-8bd3ac2e7f18 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:02.538291 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-95261ba0-ead3-4c13-afab-8bd3ac2e7f18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '615c8676362e49028223eb2d30a98e63'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:02.605667 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-95261ba0-ead3-4c13-afab-8bd3ac2e7f18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '615c8676362e49028223eb2d30a98e63'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:02.621417 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-95261ba0-ead3-4c13-afab-8bd3ac2e7f18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '615c8676362e49028223eb2d30a98e63'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:02.622369 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-95261ba0-ead3-4c13-afab-8bd3ac2e7f18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '615c8676362e49028223eb2d30a98e63'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:02.630170 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-95261ba0-ead3-4c13-afab-8bd3ac2e7f18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '615c8676362e49028223eb2d30a98e63'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:02.640133 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1320/2632] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:29:02 2022] DELETE /identity/v3/users/615c8676362e49028223eb2d30a98e63 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:29:03.415043 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5258668-8aa0-4189-bb5e-d31bc7e9ed82 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:03.416570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b5258668-8aa0-4189-bb5e-d31bc7e9ed82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:29:03.430546 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5258668-8aa0-4189-bb5e-d31bc7e9ed82 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:03.440214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:29:03.502904 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b80e2c-583e-4892-b4b5-3d42c4fbb688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:03.503554 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b80e2c-583e-4892-b4b5-3d42c4fbb688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:03.504630 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b80e2c-583e-4892-b4b5-3d42c4fbb688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:03.504630 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b80e2c-583e-4892-b4b5-3d42c4fbb688 admin admin] PATH_INFO: `/v3/projects/e2ce2d54caa34520a74bfbffed716fcf` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:03.505535 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b80e2c-583e-4892-b4b5-3d42c4fbb688 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2ce2d54caa34520a74bfbffed716fcf)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:03.507987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b80e2c-583e-4892-b4b5-3d42c4fbb688 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:03.685682 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-56b80e2c-583e-4892-b4b5-3d42c4fbb688 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2ce2d54caa34520a74bfbffed716fcf', 'request_id': 'req-56b80e2c-583e-4892-b4b5-3d42c4fbb688'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:03.789674 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-56b80e2c-583e-4892-b4b5-3d42c4fbb688 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2ce2d54caa34520a74bfbffed716fcf', 'request_id': 'req-56b80e2c-583e-4892-b4b5-3d42c4fbb688'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:03.797113 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-56b80e2c-583e-4892-b4b5-3d42c4fbb688 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2ce2d54caa34520a74bfbffed716fcf', 'request_id': 'req-56b80e2c-583e-4892-b4b5-3d42c4fbb688'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:03.808815 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-56b80e2c-583e-4892-b4b5-3d42c4fbb688 admin admin] The token cache is being invalidate because project e2ce2d54caa34520a74bfbffed716fcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:29:03.809153 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-56b80e2c-583e-4892-b4b5-3d42c4fbb688 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:03.809978 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-56b80e2c-583e-4892-b4b5-3d42c4fbb688 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:03.813673 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1313/2633] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:29:03 2022] DELETE /identity/v3/projects/e2ce2d54caa34520a74bfbffed716fcf => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:29:03.819751 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95261ba0-ead3-4c13-afab-8bd3ac2e7f18 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:03.821515 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-95261ba0-ead3-4c13-afab-8bd3ac2e7f18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:29:03.836128 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95261ba0-ead3-4c13-afab-8bd3ac2e7f18 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:03.879418 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:29:03.899523 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bccaf42-436c-43be-9ab8-f041a54233b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:03.900866 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bccaf42-436c-43be-9ab8-f041a54233b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:03.901174 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bccaf42-436c-43be-9ab8-f041a54233b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:03.901465 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bccaf42-436c-43be-9ab8-f041a54233b0 admin admin] PATH_INFO: `/v3/users/3ca15f43a66b4a90920316adbdbe1867` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:03.902687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bccaf42-436c-43be-9ab8-f041a54233b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ca15f43a66b4a90920316adbdbe1867)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:03.904657 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bccaf42-436c-43be-9ab8-f041a54233b0 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:04.066067 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8bccaf42-436c-43be-9ab8-f041a54233b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ca15f43a66b4a90920316adbdbe1867'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:04.143069 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8bccaf42-436c-43be-9ab8-f041a54233b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ca15f43a66b4a90920316adbdbe1867'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:04.156465 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8bccaf42-436c-43be-9ab8-f041a54233b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ca15f43a66b4a90920316adbdbe1867'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:04.157100 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8bccaf42-436c-43be-9ab8-f041a54233b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ca15f43a66b4a90920316adbdbe1867'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:04.164527 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8bccaf42-436c-43be-9ab8-f041a54233b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ca15f43a66b4a90920316adbdbe1867'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:04.171572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1321/2634] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:29:03 2022] DELETE /identity/v3/users/3ca15f43a66b4a90920316adbdbe1867 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:29:04.674432 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b80e2c-583e-4892-b4b5-3d42c4fbb688 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:04.676403 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-56b80e2c-583e-4892-b4b5-3d42c4fbb688 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:29:04.699584 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b80e2c-583e-4892-b4b5-3d42c4fbb688 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:04.766028 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1311aa-ae3f-4612-8cca-2275102f8637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:04.766873 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1311aa-ae3f-4612-8cca-2275102f8637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:04.767885 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1311aa-ae3f-4612-8cca-2275102f8637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:04.767885 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1311aa-ae3f-4612-8cca-2275102f8637 admin admin] PATH_INFO: `/v3/projects/3d18eafa2b8e4bb3912403e6f1e34d79` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:04.768794 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1311aa-ae3f-4612-8cca-2275102f8637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d18eafa2b8e4bb3912403e6f1e34d79)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:04.771072 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1311aa-ae3f-4612-8cca-2275102f8637 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:04.909575 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:29:04.913300 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-fc1311aa-ae3f-4612-8cca-2275102f8637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d18eafa2b8e4bb3912403e6f1e34d79', 'request_id': 'req-fc1311aa-ae3f-4612-8cca-2275102f8637'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:05.080408 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-fc1311aa-ae3f-4612-8cca-2275102f8637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d18eafa2b8e4bb3912403e6f1e34d79', 'request_id': 'req-fc1311aa-ae3f-4612-8cca-2275102f8637'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:05.088219 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-fc1311aa-ae3f-4612-8cca-2275102f8637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d18eafa2b8e4bb3912403e6f1e34d79', 'request_id': 'req-fc1311aa-ae3f-4612-8cca-2275102f8637'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:05.099910 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-fc1311aa-ae3f-4612-8cca-2275102f8637 admin admin] The token cache is being invalidate because project 3d18eafa2b8e4bb3912403e6f1e34d79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:29:05.100750 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-fc1311aa-ae3f-4612-8cca-2275102f8637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:05.101403 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-fc1311aa-ae3f-4612-8cca-2275102f8637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:05.102944 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1314/2635] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:29:04 2022] DELETE /identity/v3/projects/3d18eafa2b8e4bb3912403e6f1e34d79 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:29:14.103669 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bccaf42-436c-43be-9ab8-f041a54233b0 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:14.105342 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8bccaf42-436c-43be-9ab8-f041a54233b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:29:14.164636 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bccaf42-436c-43be-9ab8-f041a54233b0 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:14.213063 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5226a-a39e-48a5-8a9e-3e34d6503ec1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:14.213669 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5226a-a39e-48a5-8a9e-3e34d6503ec1 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:14.213948 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5226a-a39e-48a5-8a9e-3e34d6503ec1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:14.214220 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5226a-a39e-48a5-8a9e-3e34d6503ec1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:14.215939 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-50f5226a-a39e-48a5-8a9e-3e34d6503ec1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:29:14.245456 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:29:14.277687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f5226a-a39e-48a5-8a9e-3e34d6503ec1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:14.279143 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f5226a-a39e-48a5-8a9e-3e34d6503ec1 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:14.290184 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1322/2636] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:29:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:29:15.517767 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=8,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:29:24.357136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=16 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:29:44.480407 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1311aa-ae3f-4612-8cca-2275102f8637 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:44.481981 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-fc1311aa-ae3f-4612-8cca-2275102f8637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:29:44.495052 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1311aa-ae3f-4612-8cca-2275102f8637 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:44.499009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33fe7c-f63f-45db-9552-4c166ff88d66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:44.499610 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33fe7c-f63f-45db-9552-4c166ff88d66 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:44.499885 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33fe7c-f63f-45db-9552-4c166ff88d66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:44.500183 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb33fe7c-f63f-45db-9552-4c166ff88d66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:44.501861 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-cb33fe7c-f63f-45db-9552-4c166ff88d66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:29:44.566617 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33fe7c-f63f-45db-9552-4c166ff88d66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:44.568035 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb33fe7c-f63f-45db-9552-4c166ff88d66 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:44.578362 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1315/2637] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:29:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:29:48.191609 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5226a-a39e-48a5-8a9e-3e34d6503ec1 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:48.193972 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-50f5226a-a39e-48a5-8a9e-3e34d6503ec1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:29:48.270634 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5226a-a39e-48a5-8a9e-3e34d6503ec1 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:48.276552 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69b6b9-a1e7-4104-8dba-b92e488ab8f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3295306746f4552837f1bb12b2c500f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:48.277161 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69b6b9-a1e7-4104-8dba-b92e488ab8f8 service placement] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:48.277442 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69b6b9-a1e7-4104-8dba-b92e488ab8f8 service placement] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:48.277713 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69b6b9-a1e7-4104-8dba-b92e488ab8f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:48.279408 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3f69b6b9-a1e7-4104-8dba-b92e488ab8f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:29:48.290879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69b6b9-a1e7-4104-8dba-b92e488ab8f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:48.293073 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69b6b9-a1e7-4104-8dba-b92e488ab8f8 service placement] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:48.303140 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1323/2638] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:29:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:29:48.343267 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33fe7c-f63f-45db-9552-4c166ff88d66 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:48.345110 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-cb33fe7c-f63f-45db-9552-4c166ff88d66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:29:48.357899 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb33fe7c-f63f-45db-9552-4c166ff88d66 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:48.362689 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66e249-797e-4d87-b7ef-fad3f7e8a516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:48.363322 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66e249-797e-4d87-b7ef-fad3f7e8a516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:48.363600 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66e249-797e-4d87-b7ef-fad3f7e8a516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:48.365438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66e249-797e-4d87-b7ef-fad3f7e8a516 admin admin] PATH_INFO: `/v3/users/7f06e823c4ad4725896e7452eecfcc4c` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:48.365438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66e249-797e-4d87-b7ef-fad3f7e8a516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f06e823c4ad4725896e7452eecfcc4c)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:48.366936 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66e249-797e-4d87-b7ef-fad3f7e8a516 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:48.525471 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5c66e249-797e-4d87-b7ef-fad3f7e8a516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f06e823c4ad4725896e7452eecfcc4c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:48.591999 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5c66e249-797e-4d87-b7ef-fad3f7e8a516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f06e823c4ad4725896e7452eecfcc4c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:48.603935 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5c66e249-797e-4d87-b7ef-fad3f7e8a516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f06e823c4ad4725896e7452eecfcc4c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:48.604592 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5c66e249-797e-4d87-b7ef-fad3f7e8a516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f06e823c4ad4725896e7452eecfcc4c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:48.611317 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5c66e249-797e-4d87-b7ef-fad3f7e8a516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f06e823c4ad4725896e7452eecfcc4c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:48.617249 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1316/2639] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:29:48 2022] DELETE /identity/v3/users/7f06e823c4ad4725896e7452eecfcc4c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:29:48.887255 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69b6b9-a1e7-4104-8dba-b92e488ab8f8 service placement] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:48.898012 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69b6b9-a1e7-4104-8dba-b92e488ab8f8 service placement] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:48.958534 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d057e29-0fd6-4368-86cf-8859b0320a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:48.959166 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d057e29-0fd6-4368-86cf-8859b0320a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:48.959449 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d057e29-0fd6-4368-86cf-8859b0320a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:48.959761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d057e29-0fd6-4368-86cf-8859b0320a9e admin admin] PATH_INFO: `/v3/projects/15e5a4d7e5cd4bfd9af9e3e3d4c5a0ca` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:48.960986 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d057e29-0fd6-4368-86cf-8859b0320a9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=15e5a4d7e5cd4bfd9af9e3e3d4c5a0ca)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:48.966234 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d057e29-0fd6-4368-86cf-8859b0320a9e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:49.067137 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-7d057e29-0fd6-4368-86cf-8859b0320a9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15e5a4d7e5cd4bfd9af9e3e3d4c5a0ca', 'request_id': 'req-7d057e29-0fd6-4368-86cf-8859b0320a9e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:49.073110 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-7d057e29-0fd6-4368-86cf-8859b0320a9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15e5a4d7e5cd4bfd9af9e3e3d4c5a0ca', 'request_id': 'req-7d057e29-0fd6-4368-86cf-8859b0320a9e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:49.079240 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-7d057e29-0fd6-4368-86cf-8859b0320a9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15e5a4d7e5cd4bfd9af9e3e3d4c5a0ca', 'request_id': 'req-7d057e29-0fd6-4368-86cf-8859b0320a9e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:49.157452 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-7d057e29-0fd6-4368-86cf-8859b0320a9e admin admin] The token cache is being invalidate because project 15e5a4d7e5cd4bfd9af9e3e3d4c5a0ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:29:49.157656 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-7d057e29-0fd6-4368-86cf-8859b0320a9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:49.158272 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-7d057e29-0fd6-4368-86cf-8859b0320a9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:49.159750 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1324/2640] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:29:48 2022] DELETE /identity/v3/projects/15e5a4d7e5cd4bfd9af9e3e3d4c5a0ca => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:29:49.164794 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3924b-9520-493c-a3ff-9523e4cdc33c None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:49.165079 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3924b-9520-493c-a3ff-9523e4cdc33c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:49.165353 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3924b-9520-493c-a3ff-9523e4cdc33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:49.214710 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-9dd3924b-9520-493c-a3ff-9523e4cdc33c None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:29:49.215950 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-9dd3924b-9520-493c-a3ff-9523e4cdc33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:29:49.256385 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:29:49.277043 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1317/2641] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:29:49.284947 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef9702-d3ac-4845-8f10-43558cd7981e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:49.285749 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef9702-d3ac-4845-8f10-43558cd7981e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:49.285749 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef9702-d3ac-4845-8f10-43558cd7981e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:49.305875 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-67ef9702-d3ac-4845-8f10-43558cd7981e None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:29:49.307929 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-67ef9702-d3ac-4845-8f10-43558cd7981e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:29:49.315462 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1325/2642] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:29:49.319855 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3924b-9520-493c-a3ff-9523e4cdc33c None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:49.329447 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3924b-9520-493c-a3ff-9523e4cdc33c None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:49.333980 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0a929-9b34-4f0a-91ec-d66b05e334e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:49.334573 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0a929-9b34-4f0a-91ec-d66b05e334e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:49.334850 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0a929-9b34-4f0a-91ec-d66b05e334e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:49.335120 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0a929-9b34-4f0a-91ec-d66b05e334e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:49.335755 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed0a929-9b34-4f0a-91ec-d66b05e334e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:29:49.336057 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed0a929-9b34-4f0a-91ec-d66b05e334e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:49.337682 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed0a929-9b34-4f0a-91ec-d66b05e334e8 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:49.349138 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1318/2643] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:29:49.354015 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef9702-d3ac-4845-8f10-43558cd7981e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:49.363271 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef9702-d3ac-4845-8f10-43558cd7981e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:49.368066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb6525-7b4a-4a2c-99bf-62bd792d1932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:49.368689 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb6525-7b4a-4a2c-99bf-62bd792d1932 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:49.368993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb6525-7b4a-4a2c-99bf-62bd792d1932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:49.369801 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb6525-7b4a-4a2c-99bf-62bd792d1932 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:49.370441 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb6525-7b4a-4a2c-99bf-62bd792d1932 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:49.372428 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb6525-7b4a-4a2c-99bf-62bd792d1932 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:49.383653 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:29:49.526316 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1326/2644] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:29:49 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:29:49.528914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0a929-9b34-4f0a-91ec-d66b05e334e8 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:49.538940 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0a929-9b34-4f0a-91ec-d66b05e334e8 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:49.599079 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88432b88-6c56-4c7d-85cc-1f86f3b66613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:49.599699 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88432b88-6c56-4c7d-85cc-1f86f3b66613 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:49.600639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88432b88-6c56-4c7d-85cc-1f86f3b66613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:49.600947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88432b88-6c56-4c7d-85cc-1f86f3b66613 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:49.601620 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88432b88-6c56-4c7d-85cc-1f86f3b66613 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:49.604260 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88432b88-6c56-4c7d-85cc-1f86f3b66613 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:49.731883 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1319/2645] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:29:49 2022] POST /identity/v3/users => generated 287 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:29:49.735632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb6525-7b4a-4a2c-99bf-62bd792d1932 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:49.746103 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb6525-7b4a-4a2c-99bf-62bd792d1932 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:49.751337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96dbc0-117f-4489-bb24-18c71a61e085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:49.753961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96dbc0-117f-4489-bb24-18c71a61e085 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:49.753961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96dbc0-117f-4489-bb24-18c71a61e085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:49.753961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96dbc0-117f-4489-bb24-18c71a61e085 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:49.753961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96dbc0-117f-4489-bb24-18c71a61e085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:49.754842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96dbc0-117f-4489-bb24-18c71a61e085 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:49.764874 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1327/2646] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:29:49.769114 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88432b88-6c56-4c7d-85cc-1f86f3b66613 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:49.779815 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88432b88-6c56-4c7d-85cc-1f86f3b66613 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:49.784939 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e3463f-be5f-4ebe-9d33-1adf10e1ecd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:49.785534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3463f-be5f-4ebe-9d33-1adf10e1ecd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:49.785807 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3463f-be5f-4ebe-9d33-1adf10e1ecd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:49.786087 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e3463f-be5f-4ebe-9d33-1adf10e1ecd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:49.786720 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3463f-be5f-4ebe-9d33-1adf10e1ecd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:49.788367 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e3463f-be5f-4ebe-9d33-1adf10e1ecd7 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:49.799792 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1320/2647] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:29:49.804082 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96dbc0-117f-4489-bb24-18c71a61e085 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:49.813844 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96dbc0-117f-4489-bb24-18c71a61e085 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:49.818910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb14293-649a-4825-9e26-55ca8d9f968c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:49.819567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb14293-649a-4825-9e26-55ca8d9f968c admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:49.819850 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb14293-649a-4825-9e26-55ca8d9f968c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:49.820146 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb14293-649a-4825-9e26-55ca8d9f968c admin admin] PATH_INFO: `/v3/projects/318a28e665e84e27a06fdb4a477319a4/users/b9f060d351f3469cb3ef64d67ffed955/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:49.834700 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb14293-649a-4825-9e26-55ca8d9f968c admin admin] RBAC: Authorizing `identity:create_grant(project_id=318a28e665e84e27a06fdb4a477319a4, user_id=b9f060d351f3469cb3ef64d67ffed955, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:49.837461 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb14293-649a-4825-9e26-55ca8d9f968c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:49.945756 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1328/2648] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:29:49 2022] PUT /identity/v3/projects/318a28e665e84e27a06fdb4a477319a4/users/b9f060d351f3469cb3ef64d67ffed955/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:29:49.956728 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de48e7b-efd7-426a-a81e-fec10c33933c None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:49.956959 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de48e7b-efd7-426a-a81e-fec10c33933c None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:49.957228 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de48e7b-efd7-426a-a81e-fec10c33933c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:49.985205 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-4de48e7b-efd7-426a-a81e-fec10c33933c None None] MFA Rules not processed for user `b9f060d351f3469cb3ef64d67ffed955`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:29:49.986412 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4de48e7b-efd7-426a-a81e-fec10c33933c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:29:50.053766 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1321/2649] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:29:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:29:50.064894 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb14293-649a-4825-9e26-55ca8d9f968c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:50.069142 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-adb14293-649a-4825-9e26-55ca8d9f968c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:29:50.139699 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb14293-649a-4825-9e26-55ca8d9f968c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:50.145243 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54626c0-7a14-473b-bd32-782aeea69390 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:50.145849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54626c0-7a14-473b-bd32-782aeea69390 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:50.146130 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54626c0-7a14-473b-bd32-782aeea69390 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:50.146406 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54626c0-7a14-473b-bd32-782aeea69390 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:50.154602 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54626c0-7a14-473b-bd32-782aeea69390 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:50.156192 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54626c0-7a14-473b-bd32-782aeea69390 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:50.164761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1329/2650] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:29:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:29:53.318677 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de48e7b-efd7-426a-a81e-fec10c33933c None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:53.358552 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:29:53.379930 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de48e7b-efd7-426a-a81e-fec10c33933c None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:53.384927 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bead40-4fee-400d-bf03-f5f15d65a4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:53.385563 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bead40-4fee-400d-bf03-f5f15d65a4e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:53.385845 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bead40-4fee-400d-bf03-f5f15d65a4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:53.386119 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bead40-4fee-400d-bf03-f5f15d65a4e7 admin admin] PATH_INFO: `/v3/users/b9f060d351f3469cb3ef64d67ffed955` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:53.387243 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bead40-4fee-400d-bf03-f5f15d65a4e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9f060d351f3469cb3ef64d67ffed955)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:53.389226 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bead40-4fee-400d-bf03-f5f15d65a4e7 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:53.582330 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-03bead40-4fee-400d-bf03-f5f15d65a4e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9f060d351f3469cb3ef64d67ffed955'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:53.775999 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-03bead40-4fee-400d-bf03-f5f15d65a4e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9f060d351f3469cb3ef64d67ffed955'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:53.789041 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-03bead40-4fee-400d-bf03-f5f15d65a4e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9f060d351f3469cb3ef64d67ffed955'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:53.789707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-03bead40-4fee-400d-bf03-f5f15d65a4e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9f060d351f3469cb3ef64d67ffed955'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:53.799030 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-03bead40-4fee-400d-bf03-f5f15d65a4e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9f060d351f3469cb3ef64d67ffed955'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:53.802738 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1322/2651] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:29:53 2022] DELETE /identity/v3/users/b9f060d351f3469cb3ef64d67ffed955 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:29:53.807256 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55e851-3384-4099-81d2-1096fc33f9bf None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:53.807758 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55e851-3384-4099-81d2-1096fc33f9bf None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:53.807867 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55e851-3384-4099-81d2-1096fc33f9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:53.827394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-7b55e851-3384-4099-81d2-1096fc33f9bf None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:29:53.828703 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7b55e851-3384-4099-81d2-1096fc33f9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:29:53.890233 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1330/2652] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:29:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:29:53.901224 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bead40-4fee-400d-bf03-f5f15d65a4e7 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:53.902768 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-03bead40-4fee-400d-bf03-f5f15d65a4e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:29:53.959860 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bead40-4fee-400d-bf03-f5f15d65a4e7 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:53.964127 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7270f7-ef2b-48ff-9346-c2fc5804b53c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:53.964732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7270f7-ef2b-48ff-9346-c2fc5804b53c service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:53.965012 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7270f7-ef2b-48ff-9346-c2fc5804b53c service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:53.965287 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7270f7-ef2b-48ff-9346-c2fc5804b53c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:53.974019 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7270f7-ef2b-48ff-9346-c2fc5804b53c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:53.976475 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7270f7-ef2b-48ff-9346-c2fc5804b53c service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:53.984735 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1323/2653] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:29:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:29:54.006695 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1298ff-ea3d-4d22-9f66-21b8dbbc9504 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:54.010934 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1298ff-ea3d-4d22-9f66-21b8dbbc9504 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:54.010934 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1298ff-ea3d-4d22-9f66-21b8dbbc9504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:54.027078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-6f1298ff-ea3d-4d22-9f66-21b8dbbc9504 None None] MFA Rules not processed for user `c4eae7912af24007ba5a099abe3a36b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:29:54.028313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-6f1298ff-ea3d-4d22-9f66-21b8dbbc9504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:29:54.061650 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:29:54.088089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1331/2654] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:29:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:29:54.520419 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7270f7-ef2b-48ff-9346-c2fc5804b53c service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:54.524061 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6a7270f7-ef2b-48ff-9346-c2fc5804b53c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:29:54.536201 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7270f7-ef2b-48ff-9346-c2fc5804b53c service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:54.542042 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878daa4-b50c-48b7-9424-500716cf08d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:54.542688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878daa4-b50c-48b7-9424-500716cf08d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:54.542968 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878daa4-b50c-48b7-9424-500716cf08d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:54.543267 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878daa4-b50c-48b7-9424-500716cf08d2 admin admin] PATH_INFO: `/v3/projects/318a28e665e84e27a06fdb4a477319a4` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:54.544409 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878daa4-b50c-48b7-9424-500716cf08d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=318a28e665e84e27a06fdb4a477319a4)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:54.546625 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878daa4-b50c-48b7-9424-500716cf08d2 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:54.647455 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-c878daa4-b50c-48b7-9424-500716cf08d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '318a28e665e84e27a06fdb4a477319a4', 'request_id': 'req-c878daa4-b50c-48b7-9424-500716cf08d2'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:54.651076 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:29:54.730035 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-c878daa4-b50c-48b7-9424-500716cf08d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '318a28e665e84e27a06fdb4a477319a4', 'request_id': 'req-c878daa4-b50c-48b7-9424-500716cf08d2'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:54.736155 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-c878daa4-b50c-48b7-9424-500716cf08d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '318a28e665e84e27a06fdb4a477319a4', 'request_id': 'req-c878daa4-b50c-48b7-9424-500716cf08d2'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:54.748686 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-c878daa4-b50c-48b7-9424-500716cf08d2 admin admin] The token cache is being invalidate because project 318a28e665e84e27a06fdb4a477319a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:29:54.749083 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-c878daa4-b50c-48b7-9424-500716cf08d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:54.749737 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-c878daa4-b50c-48b7-9424-500716cf08d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:54.751243 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1324/2655] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:29:54 2022] DELETE /identity/v3/projects/318a28e665e84e27a06fdb4a477319a4 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:29:54.756465 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec33f2c-9dea-45ea-b4f3-902b07f43a06 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:54.756755 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec33f2c-9dea-45ea-b4f3-902b07f43a06 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:54.757084 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec33f2c-9dea-45ea-b4f3-902b07f43a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:54.776668 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-0ec33f2c-9dea-45ea-b4f3-902b07f43a06 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:29:54.777865 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0ec33f2c-9dea-45ea-b4f3-902b07f43a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:29:54.841261 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1332/2656] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:29:54.849895 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd41523-d195-4545-9f82-7481674a6b93 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:54.851077 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd41523-d195-4545-9f82-7481674a6b93 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:54.851077 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd41523-d195-4545-9f82-7481674a6b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:54.871429 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-1dd41523-d195-4545-9f82-7481674a6b93 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:29:54.872656 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1dd41523-d195-4545-9f82-7481674a6b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:29:54.880779 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1325/2657] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:29:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:29:54.885471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec33f2c-9dea-45ea-b4f3-902b07f43a06 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:54.896432 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec33f2c-9dea-45ea-b4f3-902b07f43a06 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:54.902692 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2d71b-fd36-431d-b29d-ae47f998da5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:54.903588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2d71b-fd36-431d-b29d-ae47f998da5f admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:54.904062 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2d71b-fd36-431d-b29d-ae47f998da5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:54.904604 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2d71b-fd36-431d-b29d-ae47f998da5f admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:54.905448 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2d71b-fd36-431d-b29d-ae47f998da5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:29:54.905971 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2d71b-fd36-431d-b29d-ae47f998da5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:54.907988 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2d71b-fd36-431d-b29d-ae47f998da5f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:54.923002 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1333/2658] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:29:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:29:54.928048 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd41523-d195-4545-9f82-7481674a6b93 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:54.944322 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd41523-d195-4545-9f82-7481674a6b93 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:54.944322 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccf55d-ff2f-4a36-a386-5001c89f6952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:54.944322 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccf55d-ff2f-4a36-a386-5001c89f6952 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:54.944322 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccf55d-ff2f-4a36-a386-5001c89f6952 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:54.945301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ccf55d-ff2f-4a36-a386-5001c89f6952 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:54.945301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ccf55d-ff2f-4a36-a386-5001c89f6952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:54.946741 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ccf55d-ff2f-4a36-a386-5001c89f6952 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:55.068056 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1326/2659] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:29:54 2022] POST /identity/v3/projects => generated 367 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:29:55.072681 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2d71b-fd36-431d-b29d-ae47f998da5f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:55.083143 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2d71b-fd36-431d-b29d-ae47f998da5f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:55.139070 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ac115-9781-4e71-a9f1-54acd01b9233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:55.139570 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ac115-9781-4e71-a9f1-54acd01b9233 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:55.139850 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ac115-9781-4e71-a9f1-54acd01b9233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:55.140155 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ac115-9781-4e71-a9f1-54acd01b9233 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:55.140791 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ac115-9781-4e71-a9f1-54acd01b9233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:55.142681 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ac115-9781-4e71-a9f1-54acd01b9233 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:55.249788 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1334/2660] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:29:55 2022] POST /identity/v3/users => generated 284 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:29:55.256969 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccf55d-ff2f-4a36-a386-5001c89f6952 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:55.266712 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ccf55d-ff2f-4a36-a386-5001c89f6952 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:55.271936 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc9a83-0ad1-4af2-8191-9f7fcbed5f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:55.272579 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc9a83-0ad1-4af2-8191-9f7fcbed5f3c admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:55.272832 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc9a83-0ad1-4af2-8191-9f7fcbed5f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:55.273104 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafc9a83-0ad1-4af2-8191-9f7fcbed5f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:55.273746 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc9a83-0ad1-4af2-8191-9f7fcbed5f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:55.276076 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafc9a83-0ad1-4af2-8191-9f7fcbed5f3c admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:55.287414 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1327/2661] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:29:55.291570 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ac115-9781-4e71-a9f1-54acd01b9233 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:55.301939 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ac115-9781-4e71-a9f1-54acd01b9233 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:55.307283 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd65daa1-5557-460d-bedd-7103f02ea9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:55.307593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65daa1-5557-460d-bedd-7103f02ea9cd admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:55.307872 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65daa1-5557-460d-bedd-7103f02ea9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:55.308198 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd65daa1-5557-460d-bedd-7103f02ea9cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:55.309272 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd65daa1-5557-460d-bedd-7103f02ea9cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:55.310440 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd65daa1-5557-460d-bedd-7103f02ea9cd admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:55.321531 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1335/2662] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:29:55.326189 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc9a83-0ad1-4af2-8191-9f7fcbed5f3c admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:55.336335 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafc9a83-0ad1-4af2-8191-9f7fcbed5f3c admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:55.341646 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39040c5-56f9-4a46-b5cd-a73de060a24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:55.342288 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39040c5-56f9-4a46-b5cd-a73de060a24d admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:55.342566 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39040c5-56f9-4a46-b5cd-a73de060a24d admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:55.342839 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39040c5-56f9-4a46-b5cd-a73de060a24d admin admin] PATH_INFO: `/v3/projects/ea201581d8bd440e8b3072044b890394/users/7fb1f8d6f97240a39c13d477e3be437e/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:55.357459 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39040c5-56f9-4a46-b5cd-a73de060a24d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea201581d8bd440e8b3072044b890394, user_id=7fb1f8d6f97240a39c13d477e3be437e, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:55.360324 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39040c5-56f9-4a46-b5cd-a73de060a24d admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:55.456229 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1328/2663] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:29:55 2022] PUT /identity/v3/projects/ea201581d8bd440e8b3072044b890394/users/7fb1f8d6f97240a39c13d477e3be437e/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:29:55.466572 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede07847-b218-4167-ba95-f1b4e7ab5e0a None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:55.466863 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede07847-b218-4167-ba95-f1b4e7ab5e0a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:55.467139 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede07847-b218-4167-ba95-f1b4e7ab5e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:55.496149 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ede07847-b218-4167-ba95-f1b4e7ab5e0a None None] MFA Rules not processed for user `7fb1f8d6f97240a39c13d477e3be437e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:29:55.497375 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ede07847-b218-4167-ba95-f1b4e7ab5e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:29:55.529773 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:29:55.561558 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1336/2664] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:29:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:29:55.566061 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39040c5-56f9-4a46-b5cd-a73de060a24d admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:55.628049 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39040c5-56f9-4a46-b5cd-a73de060a24d admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:55.632778 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60a918-1caa-4cb5-b9fa-b8efd146dad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:55.633383 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60a918-1caa-4cb5-b9fa-b8efd146dad8 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:55.633657 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60a918-1caa-4cb5-b9fa-b8efd146dad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:55.633925 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60a918-1caa-4cb5-b9fa-b8efd146dad8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:55.634549 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e60a918-1caa-4cb5-b9fa-b8efd146dad8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:55.637232 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e60a918-1caa-4cb5-b9fa-b8efd146dad8 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:55.736632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1329/2665] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:29:55 2022] POST /identity/v3/projects => generated 369 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:29:55.740619 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede07847-b218-4167-ba95-f1b4e7ab5e0a None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:55.752536 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede07847-b218-4167-ba95-f1b4e7ab5e0a None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:55.815344 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10968bfd-6a35-4f62-862c-2e3f92357fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:55.815963 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10968bfd-6a35-4f62-862c-2e3f92357fe2 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:55.816276 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10968bfd-6a35-4f62-862c-2e3f92357fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:55.816548 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10968bfd-6a35-4f62-862c-2e3f92357fe2 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:55.817188 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10968bfd-6a35-4f62-862c-2e3f92357fe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:55.819088 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10968bfd-6a35-4f62-862c-2e3f92357fe2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:55.923249 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1337/2666] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:29:55 2022] POST /identity/v3/users => generated 291 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:29:55.927275 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60a918-1caa-4cb5-b9fa-b8efd146dad8 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:55.938373 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60a918-1caa-4cb5-b9fa-b8efd146dad8 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:55.943016 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f841ae-4300-486f-bdbc-f5a4b0618024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:55.943685 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f841ae-4300-486f-bdbc-f5a4b0618024 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:55.943959 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f841ae-4300-486f-bdbc-f5a4b0618024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:55.944267 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f841ae-4300-486f-bdbc-f5a4b0618024 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:55.944902 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f841ae-4300-486f-bdbc-f5a4b0618024 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:55.946517 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f841ae-4300-486f-bdbc-f5a4b0618024 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:55.961436 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1330/2667] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:29:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:29:55.963038 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10968bfd-6a35-4f62-862c-2e3f92357fe2 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:55.974024 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10968bfd-6a35-4f62-862c-2e3f92357fe2 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:55.979355 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f4642-c973-41a9-a677-9fdd553f7700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:55.980028 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f4642-c973-41a9-a677-9fdd553f7700 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:55.980375 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f4642-c973-41a9-a677-9fdd553f7700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:55.980651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f4642-c973-41a9-a677-9fdd553f7700 admin admin] PATH_INFO: `/v3/projects/2089fb0eb90b465eb94f6360e2439304/users/12f0a72bc3414d5bae5bfee3dab0dd47/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:55.997718 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f4642-c973-41a9-a677-9fdd553f7700 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2089fb0eb90b465eb94f6360e2439304, user_id=12f0a72bc3414d5bae5bfee3dab0dd47, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:56.000321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f4642-c973-41a9-a677-9fdd553f7700 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:56.125780 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1338/2668] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:29:55 2022] PUT /identity/v3/projects/2089fb0eb90b465eb94f6360e2439304/users/12f0a72bc3414d5bae5bfee3dab0dd47/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:29:56.129713 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f841ae-4300-486f-bdbc-f5a4b0618024 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:56.139774 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f841ae-4300-486f-bdbc-f5a4b0618024 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:56.189430 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:29:56.198104 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a25e8-4adf-4410-8dec-a2cf8442db89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:56.198707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a25e8-4adf-4410-8dec-a2cf8442db89 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:56.198987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a25e8-4adf-4410-8dec-a2cf8442db89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:56.199259 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a25e8-4adf-4410-8dec-a2cf8442db89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:56.199886 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a25e8-4adf-4410-8dec-a2cf8442db89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:56.201534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a25e8-4adf-4410-8dec-a2cf8442db89 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:56.211051 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1331/2669] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:29:56 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:29:56.215166 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f4642-c973-41a9-a677-9fdd553f7700 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:56.225293 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f4642-c973-41a9-a677-9fdd553f7700 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:56.230383 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d0424-879e-4760-b08f-abba6c5a376b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:56.231030 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d0424-879e-4760-b08f-abba6c5a376b admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:56.231311 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d0424-879e-4760-b08f-abba6c5a376b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:56.231588 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d0424-879e-4760-b08f-abba6c5a376b admin admin] PATH_INFO: `/v3/projects/2089fb0eb90b465eb94f6360e2439304/users/12f0a72bc3414d5bae5bfee3dab0dd47/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:56.233541 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d0424-879e-4760-b08f-abba6c5a376b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2089fb0eb90b465eb94f6360e2439304, user_id=12f0a72bc3414d5bae5bfee3dab0dd47, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:56.236183 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d0424-879e-4760-b08f-abba6c5a376b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:56.247403 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1339/2670] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:29:56 2022] PUT /identity/v3/projects/2089fb0eb90b465eb94f6360e2439304/users/12f0a72bc3414d5bae5bfee3dab0dd47/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:29:56.257848 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb92d5d-069b-4c26-a957-c09437c33d7e None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:56.258055 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb92d5d-069b-4c26-a957-c09437c33d7e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:56.258288 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb92d5d-069b-4c26-a957-c09437c33d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:56.287530 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-2fb92d5d-069b-4c26-a957-c09437c33d7e None None] MFA Rules not processed for user `12f0a72bc3414d5bae5bfee3dab0dd47`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:29:56.288773 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-2fb92d5d-069b-4c26-a957-c09437c33d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:29:56.358117 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1332/2671] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:29:56 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:29:56.371610 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d0424-879e-4760-b08f-abba6c5a376b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:56.371610 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-152d0424-879e-4760-b08f-abba6c5a376b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:29:56.432532 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d0424-879e-4760-b08f-abba6c5a376b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:56.436708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6beb22-b389-4d36-af1f-62c4e14ad31e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:56.442920 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6beb22-b389-4d36-af1f-62c4e14ad31e service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:56.442920 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6beb22-b389-4d36-af1f-62c4e14ad31e service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:56.442920 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6beb22-b389-4d36-af1f-62c4e14ad31e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:56.447282 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6beb22-b389-4d36-af1f-62c4e14ad31e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:56.448804 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6beb22-b389-4d36-af1f-62c4e14ad31e service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:56.458478 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1340/2672] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:29:56 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:29:59.438398 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb92d5d-069b-4c26-a957-c09437c33d7e None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:59.514664 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb92d5d-069b-4c26-a957-c09437c33d7e None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:59.519396 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec809b4e-f56b-46d4-a10e-654affebd872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:59.520034 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec809b4e-f56b-46d4-a10e-654affebd872 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:59.520342 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec809b4e-f56b-46d4-a10e-654affebd872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:59.520619 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec809b4e-f56b-46d4-a10e-654affebd872 admin admin] PATH_INFO: `/v3/users/7fb1f8d6f97240a39c13d477e3be437e` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:59.521754 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec809b4e-f56b-46d4-a10e-654affebd872 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fb1f8d6f97240a39c13d477e3be437e)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:59.523667 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec809b4e-f56b-46d4-a10e-654affebd872 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:59.695490 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ec809b4e-f56b-46d4-a10e-654affebd872 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fb1f8d6f97240a39c13d477e3be437e'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:59.758186 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ec809b4e-f56b-46d4-a10e-654affebd872 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fb1f8d6f97240a39c13d477e3be437e'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:59.770890 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ec809b4e-f56b-46d4-a10e-654affebd872 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fb1f8d6f97240a39c13d477e3be437e'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:59.771468 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ec809b4e-f56b-46d4-a10e-654affebd872 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fb1f8d6f97240a39c13d477e3be437e'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:59.775946 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:29:59.778770 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-ec809b4e-f56b-46d4-a10e-654affebd872 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fb1f8d6f97240a39c13d477e3be437e'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:29:59.784706 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1333/2673] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:29:59 2022] DELETE /identity/v3/users/7fb1f8d6f97240a39c13d477e3be437e => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:29:59.789308 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4d506-78e0-4b25-bacc-b6f99b704954 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:59.789778 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4d506-78e0-4b25-bacc-b6f99b704954 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:59.789876 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4d506-78e0-4b25-bacc-b6f99b704954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:59.810348 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-e1f4d506-78e0-4b25-bacc-b6f99b704954 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:29:59.811671 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e1f4d506-78e0-4b25-bacc-b6f99b704954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:29:59.836327 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:29:59.872557 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1341/2674] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:29:59.882468 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec809b4e-f56b-46d4-a10e-654affebd872 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:29:59.883877 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ec809b4e-f56b-46d4-a10e-654affebd872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:29:59.941595 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec809b4e-f56b-46d4-a10e-654affebd872 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:29:59.945312 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce444d-2764-472f-8528-e1aae1dbb260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:29:59.945903 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce444d-2764-472f-8528-e1aae1dbb260 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:29:59.946176 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce444d-2764-472f-8528-e1aae1dbb260 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:29:59.946445 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce444d-2764-472f-8528-e1aae1dbb260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:29:59.955162 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce444d-2764-472f-8528-e1aae1dbb260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:29:59.956690 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce444d-2764-472f-8528-e1aae1dbb260 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:29:59.965949 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1334/2675] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:29:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:30:00.610881 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4d506-78e0-4b25-bacc-b6f99b704954 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:00.612402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e1f4d506-78e0-4b25-bacc-b6f99b704954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:00.626678 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4d506-78e0-4b25-bacc-b6f99b704954 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:00.631387 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3625ba-260b-4c33-ae8d-92c8d08aae7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:00.632123 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3625ba-260b-4c33-ae8d-92c8d08aae7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:00.632508 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3625ba-260b-4c33-ae8d-92c8d08aae7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:00.632849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3625ba-260b-4c33-ae8d-92c8d08aae7d admin admin] PATH_INFO: `/v3/projects/ea201581d8bd440e8b3072044b890394` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:00.634125 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3625ba-260b-4c33-ae8d-92c8d08aae7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea201581d8bd440e8b3072044b890394)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:00.637660 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3625ba-260b-4c33-ae8d-92c8d08aae7d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:00.730797 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0f3625ba-260b-4c33-ae8d-92c8d08aae7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea201581d8bd440e8b3072044b890394', 'request_id': 'req-0f3625ba-260b-4c33-ae8d-92c8d08aae7d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:00.736426 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0f3625ba-260b-4c33-ae8d-92c8d08aae7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea201581d8bd440e8b3072044b890394', 'request_id': 'req-0f3625ba-260b-4c33-ae8d-92c8d08aae7d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:00.742620 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0f3625ba-260b-4c33-ae8d-92c8d08aae7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea201581d8bd440e8b3072044b890394', 'request_id': 'req-0f3625ba-260b-4c33-ae8d-92c8d08aae7d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:00.797345 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0f3625ba-260b-4c33-ae8d-92c8d08aae7d admin admin] The token cache is being invalidate because project ea201581d8bd440e8b3072044b890394 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:30:00.798044 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0f3625ba-260b-4c33-ae8d-92c8d08aae7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:00.798262 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-0f3625ba-260b-4c33-ae8d-92c8d08aae7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:00.799955 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1342/2676] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:30:00 2022] DELETE /identity/v3/projects/ea201581d8bd440e8b3072044b890394 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:30:00.808511 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce444d-2764-472f-8528-e1aae1dbb260 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:00.819356 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce444d-2764-472f-8528-e1aae1dbb260 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:00.881261 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b60bf-47bc-4b1e-96e8-ad3f3b59a090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:00.881904 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b60bf-47bc-4b1e-96e8-ad3f3b59a090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:00.882186 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b60bf-47bc-4b1e-96e8-ad3f3b59a090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:00.882461 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b60bf-47bc-4b1e-96e8-ad3f3b59a090 admin admin] PATH_INFO: `/v3/users/12f0a72bc3414d5bae5bfee3dab0dd47` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:00.883579 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b60bf-47bc-4b1e-96e8-ad3f3b59a090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12f0a72bc3414d5bae5bfee3dab0dd47)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:00.886066 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b60bf-47bc-4b1e-96e8-ad3f3b59a090 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:01.068849 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-332b60bf-47bc-4b1e-96e8-ad3f3b59a090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12f0a72bc3414d5bae5bfee3dab0dd47'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:01.145987 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-332b60bf-47bc-4b1e-96e8-ad3f3b59a090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12f0a72bc3414d5bae5bfee3dab0dd47'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:01.158458 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-332b60bf-47bc-4b1e-96e8-ad3f3b59a090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12f0a72bc3414d5bae5bfee3dab0dd47'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:01.164671 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-332b60bf-47bc-4b1e-96e8-ad3f3b59a090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12f0a72bc3414d5bae5bfee3dab0dd47'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:01.167066 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-332b60bf-47bc-4b1e-96e8-ad3f3b59a090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12f0a72bc3414d5bae5bfee3dab0dd47'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:01.173149 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1335/2677] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:30:00 2022] DELETE /identity/v3/users/12f0a72bc3414d5bae5bfee3dab0dd47 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:30:01.570518 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3625ba-260b-4c33-ae8d-92c8d08aae7d admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:01.572184 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-0f3625ba-260b-4c33-ae8d-92c8d08aae7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:01.585183 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3625ba-260b-4c33-ae8d-92c8d08aae7d admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:01.642243 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4608f23-7c4f-4464-8821-c33cd6b54086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:01.642875 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4608f23-7c4f-4464-8821-c33cd6b54086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:01.643154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4608f23-7c4f-4464-8821-c33cd6b54086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:01.643437 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4608f23-7c4f-4464-8821-c33cd6b54086 admin admin] PATH_INFO: `/v3/projects/2089fb0eb90b465eb94f6360e2439304` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:01.644551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4608f23-7c4f-4464-8821-c33cd6b54086 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2089fb0eb90b465eb94f6360e2439304)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:01.646430 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4608f23-7c4f-4464-8821-c33cd6b54086 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:01.763522 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f4608f23-7c4f-4464-8821-c33cd6b54086 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2089fb0eb90b465eb94f6360e2439304', 'request_id': 'req-f4608f23-7c4f-4464-8821-c33cd6b54086'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:01.767548 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:30:01.769829 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f4608f23-7c4f-4464-8821-c33cd6b54086 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2089fb0eb90b465eb94f6360e2439304', 'request_id': 'req-f4608f23-7c4f-4464-8821-c33cd6b54086'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:01.776573 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f4608f23-7c4f-4464-8821-c33cd6b54086 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2089fb0eb90b465eb94f6360e2439304', 'request_id': 'req-f4608f23-7c4f-4464-8821-c33cd6b54086'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:01.860253 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f4608f23-7c4f-4464-8821-c33cd6b54086 admin admin] The token cache is being invalidate because project 2089fb0eb90b465eb94f6360e2439304 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:30:01.861015 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f4608f23-7c4f-4464-8821-c33cd6b54086 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:01.861116 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-f4608f23-7c4f-4464-8821-c33cd6b54086 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:01.862567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1343/2678] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:30:01 2022] DELETE /identity/v3/projects/2089fb0eb90b465eb94f6360e2439304 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:30:01.867533 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a644b6-9da9-4bab-87d7-440863d68bd1 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:01.867977 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a644b6-9da9-4bab-87d7-440863d68bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:01.868070 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a644b6-9da9-4bab-87d7-440863d68bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:01.888493 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-24a644b6-9da9-4bab-87d7-440863d68bd1 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:30:01.890076 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-24a644b6-9da9-4bab-87d7-440863d68bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:01.901027 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:30:01.951479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1336/2679] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:30:01.959494 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8687b41-075b-44a4-b306-25b2ddce7517 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:01.959783 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8687b41-075b-44a4-b306-25b2ddce7517 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:01.960066 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8687b41-075b-44a4-b306-25b2ddce7517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:01.981081 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d8687b41-075b-44a4-b306-25b2ddce7517 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:30:01.982308 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d8687b41-075b-44a4-b306-25b2ddce7517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:01.990489 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1344/2680] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:30:01.994703 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a644b6-9da9-4bab-87d7-440863d68bd1 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:02.004146 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a644b6-9da9-4bab-87d7-440863d68bd1 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:02.009088 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35ab6c-f8bb-40ec-8dcf-4718edef987b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:02.010693 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35ab6c-f8bb-40ec-8dcf-4718edef987b admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:02.010693 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35ab6c-f8bb-40ec-8dcf-4718edef987b admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:02.010999 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35ab6c-f8bb-40ec-8dcf-4718edef987b admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:02.011387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35ab6c-f8bb-40ec-8dcf-4718edef987b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:30:02.011696 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35ab6c-f8bb-40ec-8dcf-4718edef987b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:02.013340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35ab6c-f8bb-40ec-8dcf-4718edef987b admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:02.026689 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1337/2681] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:30:02.031190 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8687b41-075b-44a4-b306-25b2ddce7517 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:02.040362 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8687b41-075b-44a4-b306-25b2ddce7517 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:02.045055 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c1831-c4cc-45c6-8a84-5fb6dfa02689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:02.045916 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c1831-c4cc-45c6-8a84-5fb6dfa02689 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:02.046196 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c1831-c4cc-45c6-8a84-5fb6dfa02689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:02.046471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94c1831-c4cc-45c6-8a84-5fb6dfa02689 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:02.047111 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c1831-c4cc-45c6-8a84-5fb6dfa02689 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:02.049049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94c1831-c4cc-45c6-8a84-5fb6dfa02689 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:02.136610 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1345/2682] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:30:02 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:30:02.140698 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35ab6c-f8bb-40ec-8dcf-4718edef987b admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:02.151401 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35ab6c-f8bb-40ec-8dcf-4718edef987b admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:02.207446 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc53bd0-3e0d-48af-ad55-dbad3ad031c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:02.208051 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc53bd0-3e0d-48af-ad55-dbad3ad031c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:02.208360 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc53bd0-3e0d-48af-ad55-dbad3ad031c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:02.208632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc53bd0-3e0d-48af-ad55-dbad3ad031c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:02.209259 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc53bd0-3e0d-48af-ad55-dbad3ad031c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:02.211147 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc53bd0-3e0d-48af-ad55-dbad3ad031c1 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:02.289507 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1338/2683] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:30:02 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:30:02.293596 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c1831-c4cc-45c6-8a84-5fb6dfa02689 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:02.304163 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94c1831-c4cc-45c6-8a84-5fb6dfa02689 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:02.309649 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de5e7d-b10b-469e-9d96-6771bf1611b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:02.310291 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de5e7d-b10b-469e-9d96-6771bf1611b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:02.310578 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de5e7d-b10b-469e-9d96-6771bf1611b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:02.310857 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52de5e7d-b10b-469e-9d96-6771bf1611b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:02.311531 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de5e7d-b10b-469e-9d96-6771bf1611b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:02.313193 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52de5e7d-b10b-469e-9d96-6771bf1611b2 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:02.324136 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1346/2684] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:30:02.328245 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc53bd0-3e0d-48af-ad55-dbad3ad031c1 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:02.338252 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc53bd0-3e0d-48af-ad55-dbad3ad031c1 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:02.342810 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e43b3-6225-474a-bb14-b3adef3c40a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:02.344792 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e43b3-6225-474a-bb14-b3adef3c40a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:02.344792 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e43b3-6225-474a-bb14-b3adef3c40a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:02.344792 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e43b3-6225-474a-bb14-b3adef3c40a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:02.344792 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e43b3-6225-474a-bb14-b3adef3c40a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:02.346316 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e43b3-6225-474a-bb14-b3adef3c40a4 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:02.356856 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1339/2685] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:30:02.360895 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de5e7d-b10b-469e-9d96-6771bf1611b2 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:02.371712 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52de5e7d-b10b-469e-9d96-6771bf1611b2 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:02.376362 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aff29b-9d48-44ed-b86b-737169f3f6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:02.377026 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aff29b-9d48-44ed-b86b-737169f3f6cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:02.377303 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aff29b-9d48-44ed-b86b-737169f3f6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:02.377586 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aff29b-9d48-44ed-b86b-737169f3f6cb admin admin] PATH_INFO: `/v3/projects/7e05e73e7bb24b29a768610f2c02af35/users/6405c711e3934cddba8e5e2efea59076/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:02.392793 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aff29b-9d48-44ed-b86b-737169f3f6cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e05e73e7bb24b29a768610f2c02af35, user_id=6405c711e3934cddba8e5e2efea59076, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:02.395398 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00aff29b-9d48-44ed-b86b-737169f3f6cb admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:02.501525 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1347/2686] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:30:02 2022] PUT /identity/v3/projects/7e05e73e7bb24b29a768610f2c02af35/users/6405c711e3934cddba8e5e2efea59076/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:30:02.512869 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b4c94-609b-4d83-bc72-276df3f46989 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:02.513357 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b4c94-609b-4d83-bc72-276df3f46989 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:02.513714 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69b4c94-609b-4d83-bc72-276df3f46989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:02.542284 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f69b4c94-609b-4d83-bc72-276df3f46989 None None] MFA Rules not processed for user `6405c711e3934cddba8e5e2efea59076`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:30:02.543650 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f69b4c94-609b-4d83-bc72-276df3f46989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:02.610057 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1340/2687] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:30:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:30:02.614786 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aff29b-9d48-44ed-b86b-737169f3f6cb admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:02.678610 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aff29b-9d48-44ed-b86b-737169f3f6cb admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:02.684018 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534bf38e-d2be-49aa-a06f-dfcabeb915da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:02.684654 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bf38e-d2be-49aa-a06f-dfcabeb915da admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:02.684937 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bf38e-d2be-49aa-a06f-dfcabeb915da admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:02.685209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534bf38e-d2be-49aa-a06f-dfcabeb915da admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:02.685833 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534bf38e-d2be-49aa-a06f-dfcabeb915da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:02.687774 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534bf38e-d2be-49aa-a06f-dfcabeb915da admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:02.805205 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1348/2688] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:30:02 2022] POST /identity/v3/projects => generated 377 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:30:02.809776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b4c94-609b-4d83-bc72-276df3f46989 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:02.821609 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69b4c94-609b-4d83-bc72-276df3f46989 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:02.829421 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:30:02.887012 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86038ee2-ea74-475e-9c5a-27a2dad17ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:02.887718 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86038ee2-ea74-475e-9c5a-27a2dad17ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:02.887901 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86038ee2-ea74-475e-9c5a-27a2dad17ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:02.888216 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86038ee2-ea74-475e-9c5a-27a2dad17ce7 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:02.888860 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86038ee2-ea74-475e-9c5a-27a2dad17ce7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:02.890770 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86038ee2-ea74-475e-9c5a-27a2dad17ce7 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:02.998032 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1341/2689] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:30:02 2022] POST /identity/v3/users => generated 295 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:30:03.002294 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534bf38e-d2be-49aa-a06f-dfcabeb915da admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:03.014508 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534bf38e-d2be-49aa-a06f-dfcabeb915da admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:03.019168 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2309c3c-7cf0-4707-ad60-3fa281f61e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:03.019765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2309c3c-7cf0-4707-ad60-3fa281f61e18 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:03.020046 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2309c3c-7cf0-4707-ad60-3fa281f61e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:03.020361 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2309c3c-7cf0-4707-ad60-3fa281f61e18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:03.021005 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2309c3c-7cf0-4707-ad60-3fa281f61e18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:03.022587 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2309c3c-7cf0-4707-ad60-3fa281f61e18 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:03.034191 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1349/2690] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:30:03.038480 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86038ee2-ea74-475e-9c5a-27a2dad17ce7 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:03.049514 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86038ee2-ea74-475e-9c5a-27a2dad17ce7 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:03.054218 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fad612-845a-4656-ae26-129766ebc0bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:03.054877 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fad612-845a-4656-ae26-129766ebc0bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:03.055156 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fad612-845a-4656-ae26-129766ebc0bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:03.057022 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fad612-845a-4656-ae26-129766ebc0bf admin admin] PATH_INFO: `/v3/projects/d96fc98d51a34431b6d9e737bc53c707/users/79a57682b85542008fddfaf6d7f98b85/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:03.072975 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fad612-845a-4656-ae26-129766ebc0bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d96fc98d51a34431b6d9e737bc53c707, user_id=79a57682b85542008fddfaf6d7f98b85, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:03.075572 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fad612-845a-4656-ae26-129766ebc0bf admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:03.140736 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1342/2691] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:30:03 2022] PUT /identity/v3/projects/d96fc98d51a34431b6d9e737bc53c707/users/79a57682b85542008fddfaf6d7f98b85/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:30:03.144632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2309c3c-7cf0-4707-ad60-3fa281f61e18 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:03.155332 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2309c3c-7cf0-4707-ad60-3fa281f61e18 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:03.205659 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:30:03.214916 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e3307-cfee-4602-b781-8d3deba84806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:03.220621 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e3307-cfee-4602-b781-8d3deba84806 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:03.220621 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e3307-cfee-4602-b781-8d3deba84806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:03.220621 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e3307-cfee-4602-b781-8d3deba84806 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:03.220621 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e3307-cfee-4602-b781-8d3deba84806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:03.220621 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e3307-cfee-4602-b781-8d3deba84806 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:03.228665 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1350/2692] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:30:03.233242 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fad612-845a-4656-ae26-129766ebc0bf admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:03.243640 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fad612-845a-4656-ae26-129766ebc0bf admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:03.248690 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc1ff4-b9cb-485c-b6cb-5d2a9274581b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:03.249396 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc1ff4-b9cb-485c-b6cb-5d2a9274581b admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:03.249739 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc1ff4-b9cb-485c-b6cb-5d2a9274581b admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:03.250019 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc1ff4-b9cb-485c-b6cb-5d2a9274581b admin admin] PATH_INFO: `/v3/projects/d96fc98d51a34431b6d9e737bc53c707/users/79a57682b85542008fddfaf6d7f98b85/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:03.251927 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc1ff4-b9cb-485c-b6cb-5d2a9274581b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d96fc98d51a34431b6d9e737bc53c707, user_id=79a57682b85542008fddfaf6d7f98b85, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:03.254759 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc1ff4-b9cb-485c-b6cb-5d2a9274581b admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:03.265344 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1343/2693] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:30:03 2022] PUT /identity/v3/projects/d96fc98d51a34431b6d9e737bc53c707/users/79a57682b85542008fddfaf6d7f98b85/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:30:03.277508 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a2583-e7fc-4b0b-8421-23a5f6d5849c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:03.277794 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a2583-e7fc-4b0b-8421-23a5f6d5849c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:03.278067 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a2583-e7fc-4b0b-8421-23a5f6d5849c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:03.306794 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-da5a2583-e7fc-4b0b-8421-23a5f6d5849c None None] MFA Rules not processed for user `79a57682b85542008fddfaf6d7f98b85`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:30:03.308061 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-da5a2583-e7fc-4b0b-8421-23a5f6d5849c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:03.374851 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1351/2694] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:30:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:30:03.386290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc1ff4-b9cb-485c-b6cb-5d2a9274581b admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:03.391054 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-0dfc1ff4-b9cb-485c-b6cb-5d2a9274581b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:03.444811 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc1ff4-b9cb-485c-b6cb-5d2a9274581b admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:03.449154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aaaa87-160a-45bb-be07-4f50010a1cd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:03.449854 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aaaa87-160a-45bb-be07-4f50010a1cd5 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:03.450134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aaaa87-160a-45bb-be07-4f50010a1cd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:03.450400 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aaaa87-160a-45bb-be07-4f50010a1cd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:03.504766 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aaaa87-160a-45bb-be07-4f50010a1cd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:03.506114 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aaaa87-160a-45bb-be07-4f50010a1cd5 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:03.515122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1344/2695] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:30:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:30:06.772551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a2583-e7fc-4b0b-8421-23a5f6d5849c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:06.782738 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a2583-e7fc-4b0b-8421-23a5f6d5849c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:06.786582 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84f054-1dbb-4bab-9ab7-ae4b7b4fdd3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:06.787191 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84f054-1dbb-4bab-9ab7-ae4b7b4fdd3a service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:06.787471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84f054-1dbb-4bab-9ab7-ae4b7b4fdd3a service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:06.787745 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84f054-1dbb-4bab-9ab7-ae4b7b4fdd3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:06.797895 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84f054-1dbb-4bab-9ab7-ae4b7b4fdd3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:06.799347 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84f054-1dbb-4bab-9ab7-ae4b7b4fdd3a service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:06.808977 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1352/2696] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:30:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:30:13.510827 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=87,keystone:INSERT=5 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:30:16.805225 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=45 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:30:22.138427 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aaaa87-160a-45bb-be07-4f50010a1cd5 service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:22.205083 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aaaa87-160a-45bb-be07-4f50010a1cd5 service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:22.209855 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ed6a1-b399-467c-b018-5b141912bfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:22.210491 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ed6a1-b399-467c-b018-5b141912bfbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:22.210782 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ed6a1-b399-467c-b018-5b141912bfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:22.211028 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ed6a1-b399-467c-b018-5b141912bfbb admin admin] PATH_INFO: `/v3/users/6405c711e3934cddba8e5e2efea59076` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:22.212211 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ed6a1-b399-467c-b018-5b141912bfbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6405c711e3934cddba8e5e2efea59076)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:22.214158 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ed6a1-b399-467c-b018-5b141912bfbb admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:22.455960 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-320ed6a1-b399-467c-b018-5b141912bfbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6405c711e3934cddba8e5e2efea59076'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:22.574281 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-320ed6a1-b399-467c-b018-5b141912bfbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6405c711e3934cddba8e5e2efea59076'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:22.587965 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-320ed6a1-b399-467c-b018-5b141912bfbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6405c711e3934cddba8e5e2efea59076'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:22.588672 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-320ed6a1-b399-467c-b018-5b141912bfbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6405c711e3934cddba8e5e2efea59076'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:22.595859 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-320ed6a1-b399-467c-b018-5b141912bfbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6405c711e3934cddba8e5e2efea59076'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:22.601978 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1345/2697] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:30:22 2022] DELETE /identity/v3/users/6405c711e3934cddba8e5e2efea59076 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:30:22.606719 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f9a69-5420-4b31-b326-f858aad17bc9 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:22.607194 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f9a69-5420-4b31-b326-f858aad17bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:22.607305 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4f9a69-5420-4b31-b326-f858aad17bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:22.627973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8f4f9a69-5420-4b31-b326-f858aad17bc9 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:30:22.629239 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8f4f9a69-5420-4b31-b326-f858aad17bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:22.690250 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1353/2698] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:30:22.700355 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ed6a1-b399-467c-b018-5b141912bfbb admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:22.701814 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-320ed6a1-b399-467c-b018-5b141912bfbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:22.759820 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ed6a1-b399-467c-b018-5b141912bfbb admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:22.763338 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657ab2f-e1a6-4943-975d-f4a775fdd07e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:22.763941 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657ab2f-e1a6-4943-975d-f4a775fdd07e service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:22.764261 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657ab2f-e1a6-4943-975d-f4a775fdd07e service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:22.764539 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657ab2f-e1a6-4943-975d-f4a775fdd07e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:22.774038 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657ab2f-e1a6-4943-975d-f4a775fdd07e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:22.775488 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657ab2f-e1a6-4943-975d-f4a775fdd07e service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:22.785960 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1346/2699] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:30:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:30:23.284678 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f9a69-5420-4b31-b326-f858aad17bc9 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:23.286290 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8f4f9a69-5420-4b31-b326-f858aad17bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:23.303531 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4f9a69-5420-4b31-b326-f858aad17bc9 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:23.307491 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a5322-a541-490e-a438-a3426dd75fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:23.308691 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a5322-a541-490e-a438-a3426dd75fd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:23.309152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a5322-a541-490e-a438-a3426dd75fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:23.309585 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a5322-a541-490e-a438-a3426dd75fd8 admin admin] PATH_INFO: `/v3/projects/7e05e73e7bb24b29a768610f2c02af35` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:23.311060 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a5322-a541-490e-a438-a3426dd75fd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e05e73e7bb24b29a768610f2c02af35)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:23.313291 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a5322-a541-490e-a438-a3426dd75fd8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:23.479248 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d01a5322-a541-490e-a438-a3426dd75fd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e05e73e7bb24b29a768610f2c02af35', 'request_id': 'req-d01a5322-a541-490e-a438-a3426dd75fd8'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:23.485073 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d01a5322-a541-490e-a438-a3426dd75fd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e05e73e7bb24b29a768610f2c02af35', 'request_id': 'req-d01a5322-a541-490e-a438-a3426dd75fd8'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:23.492053 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d01a5322-a541-490e-a438-a3426dd75fd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e05e73e7bb24b29a768610f2c02af35', 'request_id': 'req-d01a5322-a541-490e-a438-a3426dd75fd8'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:23.608213 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d01a5322-a541-490e-a438-a3426dd75fd8 admin admin] The token cache is being invalidate because project 7e05e73e7bb24b29a768610f2c02af35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:30:23.608903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d01a5322-a541-490e-a438-a3426dd75fd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:23.609087 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d01a5322-a541-490e-a438-a3426dd75fd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:23.610580 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1354/2700] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:30:23 2022] DELETE /identity/v3/projects/7e05e73e7bb24b29a768610f2c02af35 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:30:23.614781 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657ab2f-e1a6-4943-975d-f4a775fdd07e service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:23.624426 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657ab2f-e1a6-4943-975d-f4a775fdd07e service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:23.646530 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:30:23.687343 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3856db3-e189-4421-b613-8e8567a0a66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:23.688001 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3856db3-e189-4421-b613-8e8567a0a66b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:23.688380 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3856db3-e189-4421-b613-8e8567a0a66b admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:23.688681 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3856db3-e189-4421-b613-8e8567a0a66b admin admin] PATH_INFO: `/v3/users/79a57682b85542008fddfaf6d7f98b85` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:23.689869 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3856db3-e189-4421-b613-8e8567a0a66b admin admin] RBAC: Authorizing `identity:delete_user(user_id=79a57682b85542008fddfaf6d7f98b85)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:23.692210 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3856db3-e189-4421-b613-8e8567a0a66b admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:23.933622 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f3856db3-e189-4421-b613-8e8567a0a66b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79a57682b85542008fddfaf6d7f98b85'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:24.021748 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f3856db3-e189-4421-b613-8e8567a0a66b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79a57682b85542008fddfaf6d7f98b85'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:24.045371 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f3856db3-e189-4421-b613-8e8567a0a66b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79a57682b85542008fddfaf6d7f98b85'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:24.045371 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f3856db3-e189-4421-b613-8e8567a0a66b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79a57682b85542008fddfaf6d7f98b85'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:24.049704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f3856db3-e189-4421-b613-8e8567a0a66b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79a57682b85542008fddfaf6d7f98b85'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:24.057011 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1347/2701] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:30:23 2022] DELETE /identity/v3/users/79a57682b85542008fddfaf6d7f98b85 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:30:24.689140 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a5322-a541-490e-a438-a3426dd75fd8 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:24.690835 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d01a5322-a541-490e-a438-a3426dd75fd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:24.706724 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a5322-a541-490e-a438-a3426dd75fd8 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:24.850284 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d856844c-f50f-41bd-b2a7-896bb8679d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:24.850945 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856844c-f50f-41bd-b2a7-896bb8679d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:24.851235 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856844c-f50f-41bd-b2a7-896bb8679d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:24.851504 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d856844c-f50f-41bd-b2a7-896bb8679d6d admin admin] PATH_INFO: `/v3/projects/d96fc98d51a34431b6d9e737bc53c707` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:24.852669 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856844c-f50f-41bd-b2a7-896bb8679d6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d96fc98d51a34431b6d9e737bc53c707)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:24.854574 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d856844c-f50f-41bd-b2a7-896bb8679d6d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:25.117739 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:30:25.135018 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d856844c-f50f-41bd-b2a7-896bb8679d6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd96fc98d51a34431b6d9e737bc53c707', 'request_id': 'req-d856844c-f50f-41bd-b2a7-896bb8679d6d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:25.140689 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d856844c-f50f-41bd-b2a7-896bb8679d6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd96fc98d51a34431b6d9e737bc53c707', 'request_id': 'req-d856844c-f50f-41bd-b2a7-896bb8679d6d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:25.147956 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d856844c-f50f-41bd-b2a7-896bb8679d6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd96fc98d51a34431b6d9e737bc53c707', 'request_id': 'req-d856844c-f50f-41bd-b2a7-896bb8679d6d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:25.300870 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d856844c-f50f-41bd-b2a7-896bb8679d6d admin admin] The token cache is being invalidate because project d96fc98d51a34431b6d9e737bc53c707 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:30:25.303096 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d856844c-f50f-41bd-b2a7-896bb8679d6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:25.303096 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-d856844c-f50f-41bd-b2a7-896bb8679d6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:25.303612 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1355/2702] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:30:24 2022] DELETE /identity/v3/projects/d96fc98d51a34431b6d9e737bc53c707 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:30:25.308669 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09766f0a-d7b9-4250-b934-322c8c802bc4 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:25.309193 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09766f0a-d7b9-4250-b934-322c8c802bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:25.309298 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09766f0a-d7b9-4250-b934-322c8c802bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:25.330620 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-09766f0a-d7b9-4250-b934-322c8c802bc4 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:30:25.331825 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-09766f0a-d7b9-4250-b934-322c8c802bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:25.447308 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1348/2703] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:30:25.456370 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b907e01-0969-4c02-b41d-c2041ab70e2c None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:25.463953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b907e01-0969-4c02-b41d-c2041ab70e2c None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:25.463953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b907e01-0969-4c02-b41d-c2041ab70e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:25.477335 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-4b907e01-0969-4c02-b41d-c2041ab70e2c None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:30:25.478585 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4b907e01-0969-4c02-b41d-c2041ab70e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:25.486983 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1356/2704] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:30:25.491426 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09766f0a-d7b9-4250-b934-322c8c802bc4 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:25.501774 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09766f0a-d7b9-4250-b934-322c8c802bc4 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:25.506577 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf171fd7-3628-470b-951f-49c0ab172d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:25.507189 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf171fd7-3628-470b-951f-49c0ab172d40 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:25.507469 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf171fd7-3628-470b-951f-49c0ab172d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:25.507744 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf171fd7-3628-470b-951f-49c0ab172d40 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:25.508434 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf171fd7-3628-470b-951f-49c0ab172d40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:30:25.508742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf171fd7-3628-470b-951f-49c0ab172d40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:25.510404 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf171fd7-3628-470b-951f-49c0ab172d40 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:25.523306 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1349/2705] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:30:25.528546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b907e01-0969-4c02-b41d-c2041ab70e2c None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:25.538832 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b907e01-0969-4c02-b41d-c2041ab70e2c None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:25.543712 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a8a90-d269-4ff4-a59a-1278356827d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:25.544380 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a8a90-d269-4ff4-a59a-1278356827d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:25.544663 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a8a90-d269-4ff4-a59a-1278356827d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:25.544940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a8a90-d269-4ff4-a59a-1278356827d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:25.545926 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a8a90-d269-4ff4-a59a-1278356827d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:25.547928 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a8a90-d269-4ff4-a59a-1278356827d6 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:25.684334 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1357/2706] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:30:25 2022] POST /identity/v3/projects => generated 377 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:30:25.689912 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf171fd7-3628-470b-951f-49c0ab172d40 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:25.700730 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf171fd7-3628-470b-951f-49c0ab172d40 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:25.731938 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:30:25.766524 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef512345-4706-4b6b-8277-4adf72e1b70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:25.767163 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef512345-4706-4b6b-8277-4adf72e1b70e admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:25.767439 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef512345-4706-4b6b-8277-4adf72e1b70e admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:25.767712 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef512345-4706-4b6b-8277-4adf72e1b70e admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:25.768432 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef512345-4706-4b6b-8277-4adf72e1b70e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:25.770422 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef512345-4706-4b6b-8277-4adf72e1b70e admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:25.846006 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1350/2707] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:30:25 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:30:25.847559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a8a90-d269-4ff4-a59a-1278356827d6 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:25.858686 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a8a90-d269-4ff4-a59a-1278356827d6 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:25.864011 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e899d-c81a-4d45-b17b-f830572c2363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:25.865688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e899d-c81a-4d45-b17b-f830572c2363 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:25.865688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e899d-c81a-4d45-b17b-f830572c2363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:25.865688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e899d-c81a-4d45-b17b-f830572c2363 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:25.866135 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e899d-c81a-4d45-b17b-f830572c2363 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:25.867601 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e899d-c81a-4d45-b17b-f830572c2363 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:25.879311 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1358/2708] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:30:25.883438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef512345-4706-4b6b-8277-4adf72e1b70e admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:25.899904 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef512345-4706-4b6b-8277-4adf72e1b70e admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:25.899904 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e8334-bad5-4bfa-84d0-5e41090e59aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:25.900329 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e8334-bad5-4bfa-84d0-5e41090e59aa admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:25.900543 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e8334-bad5-4bfa-84d0-5e41090e59aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:25.900817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e8334-bad5-4bfa-84d0-5e41090e59aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:25.901462 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e8334-bad5-4bfa-84d0-5e41090e59aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:25.903082 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e8334-bad5-4bfa-84d0-5e41090e59aa admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:25.914988 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1351/2709] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:30:25.919320 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e899d-c81a-4d45-b17b-f830572c2363 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:25.929989 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e899d-c81a-4d45-b17b-f830572c2363 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:25.935040 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55af668-2cc6-46c7-a95f-8852950733d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:25.935704 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55af668-2cc6-46c7-a95f-8852950733d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:25.935987 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55af668-2cc6-46c7-a95f-8852950733d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:25.936309 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55af668-2cc6-46c7-a95f-8852950733d6 admin admin] PATH_INFO: `/v3/projects/fcc0ad1fa6254eccb458518a35f9c48d/users/b96c9dbfe4914eb4b63b036ea739d193/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:25.951021 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55af668-2cc6-46c7-a95f-8852950733d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcc0ad1fa6254eccb458518a35f9c48d, user_id=b96c9dbfe4914eb4b63b036ea739d193, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:25.954231 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55af668-2cc6-46c7-a95f-8852950733d6 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:26.163527 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1359/2710] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:30:25 2022] PUT /identity/v3/projects/fcc0ad1fa6254eccb458518a35f9c48d/users/b96c9dbfe4914eb4b63b036ea739d193/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:30:26.175449 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8d0b1-6b33-42c7-9f78-16f3babd53b3 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:26.175738 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8d0b1-6b33-42c7-9f78-16f3babd53b3 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:26.176018 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b8d0b1-6b33-42c7-9f78-16f3babd53b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:26.207438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-79b8d0b1-6b33-42c7-9f78-16f3babd53b3 None None] MFA Rules not processed for user `b96c9dbfe4914eb4b63b036ea739d193`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:30:26.208690 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-79b8d0b1-6b33-42c7-9f78-16f3babd53b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:26.273908 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1352/2711] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:30:26 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:30:26.280369 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55af668-2cc6-46c7-a95f-8852950733d6 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:26.342544 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55af668-2cc6-46c7-a95f-8852950733d6 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:26.348399 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c8b2d-03b8-4f6e-86e8-96db4d18e893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:26.349000 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c8b2d-03b8-4f6e-86e8-96db4d18e893 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:26.349277 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c8b2d-03b8-4f6e-86e8-96db4d18e893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:26.349547 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28c8b2d-03b8-4f6e-86e8-96db4d18e893 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:26.350237 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c8b2d-03b8-4f6e-86e8-96db4d18e893 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:26.352152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28c8b2d-03b8-4f6e-86e8-96db4d18e893 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:26.639744 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1360/2712] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:30:26 2022] POST /identity/v3/projects => generated 377 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:30:26.644124 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8d0b1-6b33-42c7-9f78-16f3babd53b3 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:26.654875 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b8d0b1-6b33-42c7-9f78-16f3babd53b3 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:26.710968 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43df65-03a7-4ed6-b419-39fa225ab8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:26.711573 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43df65-03a7-4ed6-b419-39fa225ab8ef admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:26.711854 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43df65-03a7-4ed6-b419-39fa225ab8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:26.712146 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab43df65-03a7-4ed6-b419-39fa225ab8ef admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:26.712769 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43df65-03a7-4ed6-b419-39fa225ab8ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:26.714674 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab43df65-03a7-4ed6-b419-39fa225ab8ef admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:26.797375 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1353/2713] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:30:26 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:30:26.802099 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c8b2d-03b8-4f6e-86e8-96db4d18e893 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:26.813814 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28c8b2d-03b8-4f6e-86e8-96db4d18e893 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:26.819258 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce4c42-8564-4d59-b2d1-f55860ff2a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:26.831246 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce4c42-8564-4d59-b2d1-f55860ff2a8e admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:26.831246 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce4c42-8564-4d59-b2d1-f55860ff2a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:26.831246 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ce4c42-8564-4d59-b2d1-f55860ff2a8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:26.831246 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce4c42-8564-4d59-b2d1-f55860ff2a8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:26.831246 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ce4c42-8564-4d59-b2d1-f55860ff2a8e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:26.835823 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1361/2714] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:30:26.839906 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43df65-03a7-4ed6-b419-39fa225ab8ef admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:26.850104 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab43df65-03a7-4ed6-b419-39fa225ab8ef admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:26.854753 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca2323-aa55-436b-9661-7a2df2446b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:26.855350 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca2323-aa55-436b-9661-7a2df2446b54 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:26.855630 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca2323-aa55-436b-9661-7a2df2446b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:26.855906 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca2323-aa55-436b-9661-7a2df2446b54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:26.856583 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca2323-aa55-436b-9661-7a2df2446b54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:26.858166 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca2323-aa55-436b-9661-7a2df2446b54 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:26.868493 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1354/2715] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:30:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:30:26.872740 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce4c42-8564-4d59-b2d1-f55860ff2a8e admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:26.883406 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ce4c42-8564-4d59-b2d1-f55860ff2a8e admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:26.889219 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be38836-f486-4bf7-85db-c80bbfa750cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:26.889973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be38836-f486-4bf7-85db-c80bbfa750cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:26.890175 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be38836-f486-4bf7-85db-c80bbfa750cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:26.890445 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be38836-f486-4bf7-85db-c80bbfa750cd admin admin] PATH_INFO: `/v3/projects/61f530ce76af4a568abfc1d30bf7d7b5/users/1b069139f4404d31b16fe6b248ef057a/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:26.906618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be38836-f486-4bf7-85db-c80bbfa750cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=61f530ce76af4a568abfc1d30bf7d7b5, user_id=1b069139f4404d31b16fe6b248ef057a, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:26.915745 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be38836-f486-4bf7-85db-c80bbfa750cd admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:27.056738 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:30:27.062045 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1362/2716] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:30:26 2022] PUT /identity/v3/projects/61f530ce76af4a568abfc1d30bf7d7b5/users/1b069139f4404d31b16fe6b248ef057a/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:30:27.073228 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e026c-2a7b-4756-97d9-3e61c3e129a0 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:27.073436 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e026c-2a7b-4756-97d9-3e61c3e129a0 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:27.073633 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e026c-2a7b-4756-97d9-3e61c3e129a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:27.101945 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-b85e026c-2a7b-4756-97d9-3e61c3e129a0 None None] MFA Rules not processed for user `1b069139f4404d31b16fe6b248ef057a`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:30:27.103170 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b85e026c-2a7b-4756-97d9-3e61c3e129a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:27.107153 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:30:27.175282 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1355/2717] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:30:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:30:27.181233 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be38836-f486-4bf7-85db-c80bbfa750cd admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:27.257260 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be38836-f486-4bf7-85db-c80bbfa750cd admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:27.262082 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b218eb-a85a-484f-9ab4-d5d50f697929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:27.262735 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b218eb-a85a-484f-9ab4-d5d50f697929 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:27.263020 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b218eb-a85a-484f-9ab4-d5d50f697929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:27.263726 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b218eb-a85a-484f-9ab4-d5d50f697929 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:27.263948 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b218eb-a85a-484f-9ab4-d5d50f697929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:27.265963 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b218eb-a85a-484f-9ab4-d5d50f697929 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:27.478957 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1363/2718] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:30:27 2022] POST /identity/v3/projects => generated 379 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:30:27.483306 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e026c-2a7b-4756-97d9-3e61c3e129a0 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:27.496144 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e026c-2a7b-4756-97d9-3e61c3e129a0 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:27.562212 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d9c09-e5d7-4774-b30e-e5965375f7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:27.562830 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d9c09-e5d7-4774-b30e-e5965375f7dd admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:27.563113 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d9c09-e5d7-4774-b30e-e5965375f7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:27.563388 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d9c09-e5d7-4774-b30e-e5965375f7dd admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:27.564026 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d9c09-e5d7-4774-b30e-e5965375f7dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:27.566006 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d9c09-e5d7-4774-b30e-e5965375f7dd admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:27.757716 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1356/2719] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:30:27 2022] POST /identity/v3/users => generated 296 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:30:27.761753 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b218eb-a85a-484f-9ab4-d5d50f697929 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:27.772924 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b218eb-a85a-484f-9ab4-d5d50f697929 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:27.781109 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eeda13-190c-4698-a812-d878c21ca545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:27.781109 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eeda13-190c-4698-a812-d878c21ca545 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:27.781109 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eeda13-190c-4698-a812-d878c21ca545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:27.781109 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eeda13-190c-4698-a812-d878c21ca545 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:27.781681 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eeda13-190c-4698-a812-d878c21ca545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:27.781681 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eeda13-190c-4698-a812-d878c21ca545 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:27.793719 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1364/2720] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:30:27.798198 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d9c09-e5d7-4774-b30e-e5965375f7dd admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:27.809073 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d9c09-e5d7-4774-b30e-e5965375f7dd admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:27.813956 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c598a-0a2e-4990-9c23-a763417e21f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:27.814636 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c598a-0a2e-4990-9c23-a763417e21f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:27.814916 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c598a-0a2e-4990-9c23-a763417e21f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:27.815195 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c598a-0a2e-4990-9c23-a763417e21f1 admin admin] PATH_INFO: `/v3/projects/de41c95704ee4e1790d953c0f68bc208/users/912f313f3ffe4426964cee02f316972f/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:27.834485 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c598a-0a2e-4990-9c23-a763417e21f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de41c95704ee4e1790d953c0f68bc208, user_id=912f313f3ffe4426964cee02f316972f, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:27.837249 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c598a-0a2e-4990-9c23-a763417e21f1 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:27.929857 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1357/2721] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:30:27 2022] PUT /identity/v3/projects/de41c95704ee4e1790d953c0f68bc208/users/912f313f3ffe4426964cee02f316972f/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:30:27.934171 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eeda13-190c-4698-a812-d878c21ca545 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:27.944668 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eeda13-190c-4698-a812-d878c21ca545 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:28.001509 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1fc51b-785c-42f2-b20e-cb91829eab84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:28.002350 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fc51b-785c-42f2-b20e-cb91829eab84 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:28.002629 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fc51b-785c-42f2-b20e-cb91829eab84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:28.002900 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1fc51b-785c-42f2-b20e-cb91829eab84 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:28.003539 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1fc51b-785c-42f2-b20e-cb91829eab84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:28.005299 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1fc51b-785c-42f2-b20e-cb91829eab84 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:28.016045 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1365/2722] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:30:28.020256 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c598a-0a2e-4990-9c23-a763417e21f1 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:28.031297 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c598a-0a2e-4990-9c23-a763417e21f1 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:28.036537 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec29ff9-7f3f-4619-90ab-87e15f90aa87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:28.037196 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec29ff9-7f3f-4619-90ab-87e15f90aa87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:28.037478 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec29ff9-7f3f-4619-90ab-87e15f90aa87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:28.037754 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec29ff9-7f3f-4619-90ab-87e15f90aa87 admin admin] PATH_INFO: `/v3/projects/de41c95704ee4e1790d953c0f68bc208/users/912f313f3ffe4426964cee02f316972f/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:28.039684 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec29ff9-7f3f-4619-90ab-87e15f90aa87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de41c95704ee4e1790d953c0f68bc208, user_id=912f313f3ffe4426964cee02f316972f, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:28.044516 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec29ff9-7f3f-4619-90ab-87e15f90aa87 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:28.056044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1358/2723] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:30:28 2022] PUT /identity/v3/projects/de41c95704ee4e1790d953c0f68bc208/users/912f313f3ffe4426964cee02f316972f/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:30:28.066638 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f32c1-e057-445d-8552-7977aefc0ff8 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:28.066923 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f32c1-e057-445d-8552-7977aefc0ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:28.067198 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f32c1-e057-445d-8552-7977aefc0ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:28.096323 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-721f32c1-e057-445d-8552-7977aefc0ff8 None None] MFA Rules not processed for user `912f313f3ffe4426964cee02f316972f`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:30:28.097560 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-721f32c1-e057-445d-8552-7977aefc0ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:28.159087 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:30:28.168935 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1366/2724] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:30:28 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:30:28.181141 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec29ff9-7f3f-4619-90ab-87e15f90aa87 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:28.182692 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-aec29ff9-7f3f-4619-90ab-87e15f90aa87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:28.243003 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec29ff9-7f3f-4619-90ab-87e15f90aa87 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:28.246743 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f84ef-b706-4abb-b046-dccabba6c9c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:28.247376 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f84ef-b706-4abb-b046-dccabba6c9c8 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:28.247654 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f84ef-b706-4abb-b046-dccabba6c9c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:28.248012 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f84ef-b706-4abb-b046-dccabba6c9c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:28.257914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f84ef-b706-4abb-b046-dccabba6c9c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:28.259438 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f84ef-b706-4abb-b046-dccabba6c9c8 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:28.265315 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:30:28.270732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1359/2725] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:30:28 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:30:28.371785 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f32c1-e057-445d-8552-7977aefc0ff8 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:28.373208 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-721f32c1-e057-445d-8552-7977aefc0ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:28.385658 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f32c1-e057-445d-8552-7977aefc0ff8 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:28.389196 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae6f0e-45b3-4b3a-a374-18a5373cf049 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:28.389819 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae6f0e-45b3-4b3a-a374-18a5373cf049 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:28.390095 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae6f0e-45b3-4b3a-a374-18a5373cf049 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:28.390364 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae6f0e-45b3-4b3a-a374-18a5373cf049 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:28.447090 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae6f0e-45b3-4b3a-a374-18a5373cf049 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:28.448543 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae6f0e-45b3-4b3a-a374-18a5373cf049 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:28.457951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1367/2726] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:30:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:30:32.744203 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f84ef-b706-4abb-b046-dccabba6c9c8 service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:32.807782 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f84ef-b706-4abb-b046-dccabba6c9c8 service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:32.812783 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ff5da-c7cf-43e9-b774-d71d67361f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:32.813480 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ff5da-c7cf-43e9-b774-d71d67361f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:32.813798 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ff5da-c7cf-43e9-b774-d71d67361f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:32.814101 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06ff5da-c7cf-43e9-b774-d71d67361f79 admin admin] PATH_INFO: `/v3/users/b96c9dbfe4914eb4b63b036ea739d193` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:32.815375 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ff5da-c7cf-43e9-b774-d71d67361f79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b96c9dbfe4914eb4b63b036ea739d193)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:32.817493 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06ff5da-c7cf-43e9-b774-d71d67361f79 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:33.039237 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d06ff5da-c7cf-43e9-b774-d71d67361f79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b96c9dbfe4914eb4b63b036ea739d193'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:33.111802 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d06ff5da-c7cf-43e9-b774-d71d67361f79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b96c9dbfe4914eb4b63b036ea739d193'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:33.124756 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d06ff5da-c7cf-43e9-b774-d71d67361f79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b96c9dbfe4914eb4b63b036ea739d193'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:33.125471 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d06ff5da-c7cf-43e9-b774-d71d67361f79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b96c9dbfe4914eb4b63b036ea739d193'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:33.132732 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-d06ff5da-c7cf-43e9-b774-d71d67361f79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b96c9dbfe4914eb4b63b036ea739d193'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:33.138571 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1360/2727] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:30:32 2022] DELETE /identity/v3/users/b96c9dbfe4914eb4b63b036ea739d193 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:30:33.143119 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fce82b-130d-474a-ae7c-2846799a23df None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:33.143649 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fce82b-130d-474a-ae7c-2846799a23df None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:33.143778 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fce82b-130d-474a-ae7c-2846799a23df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:33.163248 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-63fce82b-130d-474a-ae7c-2846799a23df None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:30:33.164473 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-63fce82b-130d-474a-ae7c-2846799a23df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:33.227492 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1368/2728] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:30:33.237919 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ff5da-c7cf-43e9-b774-d71d67361f79 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:33.239658 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d06ff5da-c7cf-43e9-b774-d71d67361f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:33.304273 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06ff5da-c7cf-43e9-b774-d71d67361f79 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:33.307801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e94b16-1c76-4582-b7b6-edeb79b7e143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:33.308446 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e94b16-1c76-4582-b7b6-edeb79b7e143 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:33.308724 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e94b16-1c76-4582-b7b6-edeb79b7e143 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:33.308992 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e94b16-1c76-4582-b7b6-edeb79b7e143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:33.320663 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e94b16-1c76-4582-b7b6-edeb79b7e143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:33.322092 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e94b16-1c76-4582-b7b6-edeb79b7e143 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:33.332083 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1361/2729] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:30:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:30:33.776110 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fce82b-130d-474a-ae7c-2846799a23df None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:33.777555 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-63fce82b-130d-474a-ae7c-2846799a23df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:33.789953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fce82b-130d-474a-ae7c-2846799a23df None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:33.794447 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed3f75-84d7-42a7-8d83-7347c15eebca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:33.795057 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed3f75-84d7-42a7-8d83-7347c15eebca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:33.795333 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed3f75-84d7-42a7-8d83-7347c15eebca admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:33.795905 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ed3f75-84d7-42a7-8d83-7347c15eebca admin admin] PATH_INFO: `/v3/projects/fcc0ad1fa6254eccb458518a35f9c48d` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:33.797185 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed3f75-84d7-42a7-8d83-7347c15eebca admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcc0ad1fa6254eccb458518a35f9c48d)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:33.799081 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ed3f75-84d7-42a7-8d83-7347c15eebca admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:33.894171 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-28ed3f75-84d7-42a7-8d83-7347c15eebca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcc0ad1fa6254eccb458518a35f9c48d', 'request_id': 'req-28ed3f75-84d7-42a7-8d83-7347c15eebca'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:33.899484 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-28ed3f75-84d7-42a7-8d83-7347c15eebca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcc0ad1fa6254eccb458518a35f9c48d', 'request_id': 'req-28ed3f75-84d7-42a7-8d83-7347c15eebca'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:33.905591 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-28ed3f75-84d7-42a7-8d83-7347c15eebca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcc0ad1fa6254eccb458518a35f9c48d', 'request_id': 'req-28ed3f75-84d7-42a7-8d83-7347c15eebca'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:33.961744 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-28ed3f75-84d7-42a7-8d83-7347c15eebca admin admin] The token cache is being invalidate because project fcc0ad1fa6254eccb458518a35f9c48d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:30:33.962085 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-28ed3f75-84d7-42a7-8d83-7347c15eebca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:33.962826 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-28ed3f75-84d7-42a7-8d83-7347c15eebca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:33.964506 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1369/2730] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:30:33 2022] DELETE /identity/v3/projects/fcc0ad1fa6254eccb458518a35f9c48d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:30:33.968770 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e94b16-1c76-4582-b7b6-edeb79b7e143 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:33.978666 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e94b16-1c76-4582-b7b6-edeb79b7e143 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:33.996602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:30:34.033450 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a563c-b1c0-4432-aff0-f15a918336ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:34.034077 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a563c-b1c0-4432-aff0-f15a918336ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:34.034356 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a563c-b1c0-4432-aff0-f15a918336ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:34.034628 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a563c-b1c0-4432-aff0-f15a918336ee admin admin] PATH_INFO: `/v3/users/1b069139f4404d31b16fe6b248ef057a` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:34.035737 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a563c-b1c0-4432-aff0-f15a918336ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b069139f4404d31b16fe6b248ef057a)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:34.037675 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a563c-b1c0-4432-aff0-f15a918336ee admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:34.206055 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-da2a563c-b1c0-4432-aff0-f15a918336ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b069139f4404d31b16fe6b248ef057a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:34.293921 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-da2a563c-b1c0-4432-aff0-f15a918336ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b069139f4404d31b16fe6b248ef057a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:34.307668 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-da2a563c-b1c0-4432-aff0-f15a918336ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b069139f4404d31b16fe6b248ef057a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:34.308364 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-da2a563c-b1c0-4432-aff0-f15a918336ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b069139f4404d31b16fe6b248ef057a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:34.315315 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-da2a563c-b1c0-4432-aff0-f15a918336ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b069139f4404d31b16fe6b248ef057a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:34.321233 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1362/2731] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:30:33 2022] DELETE /identity/v3/users/1b069139f4404d31b16fe6b248ef057a => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:30:34.752597 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed3f75-84d7-42a7-8d83-7347c15eebca admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:34.754072 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-28ed3f75-84d7-42a7-8d83-7347c15eebca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:34.770326 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ed3f75-84d7-42a7-8d83-7347c15eebca admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:34.785819 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:30:34.830906 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e40d9-2a64-4148-af80-fbd4c15792c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:34.831547 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e40d9-2a64-4148-af80-fbd4c15792c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:34.831827 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e40d9-2a64-4148-af80-fbd4c15792c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:34.832133 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64e40d9-2a64-4148-af80-fbd4c15792c6 admin admin] PATH_INFO: `/v3/projects/61f530ce76af4a568abfc1d30bf7d7b5` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:34.833250 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e40d9-2a64-4148-af80-fbd4c15792c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61f530ce76af4a568abfc1d30bf7d7b5)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:34.835206 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64e40d9-2a64-4148-af80-fbd4c15792c6 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:34.952133 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e64e40d9-2a64-4148-af80-fbd4c15792c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61f530ce76af4a568abfc1d30bf7d7b5', 'request_id': 'req-e64e40d9-2a64-4148-af80-fbd4c15792c6'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:34.959163 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e64e40d9-2a64-4148-af80-fbd4c15792c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61f530ce76af4a568abfc1d30bf7d7b5', 'request_id': 'req-e64e40d9-2a64-4148-af80-fbd4c15792c6'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:34.965353 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e64e40d9-2a64-4148-af80-fbd4c15792c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61f530ce76af4a568abfc1d30bf7d7b5', 'request_id': 'req-e64e40d9-2a64-4148-af80-fbd4c15792c6'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:35.042366 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e64e40d9-2a64-4148-af80-fbd4c15792c6 admin admin] The token cache is being invalidate because project 61f530ce76af4a568abfc1d30bf7d7b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:30:35.042691 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e64e40d9-2a64-4148-af80-fbd4c15792c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:35.043273 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e64e40d9-2a64-4148-af80-fbd4c15792c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:35.044785 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1370/2732] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:30:34 2022] DELETE /identity/v3/projects/61f530ce76af4a568abfc1d30bf7d7b5 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:30:35.049302 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a563c-b1c0-4432-aff0-f15a918336ee admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:35.051441 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-da2a563c-b1c0-4432-aff0-f15a918336ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:35.064873 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a563c-b1c0-4432-aff0-f15a918336ee admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:35.125597 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075da038-16a4-4fc4-a1c2-9fea114b9c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:35.126232 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075da038-16a4-4fc4-a1c2-9fea114b9c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:35.126509 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075da038-16a4-4fc4-a1c2-9fea114b9c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:35.126849 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075da038-16a4-4fc4-a1c2-9fea114b9c68 admin admin] PATH_INFO: `/v3/users/912f313f3ffe4426964cee02f316972f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:35.128817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075da038-16a4-4fc4-a1c2-9fea114b9c68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=912f313f3ffe4426964cee02f316972f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:35.130542 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075da038-16a4-4fc4-a1c2-9fea114b9c68 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:35.335782 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:30:35.338619 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-075da038-16a4-4fc4-a1c2-9fea114b9c68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '912f313f3ffe4426964cee02f316972f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:35.419579 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-075da038-16a4-4fc4-a1c2-9fea114b9c68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '912f313f3ffe4426964cee02f316972f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:35.432884 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-075da038-16a4-4fc4-a1c2-9fea114b9c68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '912f313f3ffe4426964cee02f316972f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:35.433570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-075da038-16a4-4fc4-a1c2-9fea114b9c68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '912f313f3ffe4426964cee02f316972f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:35.441004 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-075da038-16a4-4fc4-a1c2-9fea114b9c68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '912f313f3ffe4426964cee02f316972f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:35.447325 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1363/2733] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:30:35 2022] DELETE /identity/v3/users/912f313f3ffe4426964cee02f316972f => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:30:35.900870 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e40d9-2a64-4148-af80-fbd4c15792c6 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:35.902405 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e64e40d9-2a64-4148-af80-fbd4c15792c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:35.919953 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64e40d9-2a64-4148-af80-fbd4c15792c6 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:35.981882 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f95951-89e3-4970-9685-251098f2adc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:35.982530 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f95951-89e3-4970-9685-251098f2adc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:35.982819 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f95951-89e3-4970-9685-251098f2adc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:35.983096 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f95951-89e3-4970-9685-251098f2adc1 admin admin] PATH_INFO: `/v3/projects/de41c95704ee4e1790d953c0f68bc208` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:35.984836 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f95951-89e3-4970-9685-251098f2adc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de41c95704ee4e1790d953c0f68bc208)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:35.986770 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f95951-89e3-4970-9685-251098f2adc1 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:36.072562 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-63f95951-89e3-4970-9685-251098f2adc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de41c95704ee4e1790d953c0f68bc208', 'request_id': 'req-63f95951-89e3-4970-9685-251098f2adc1'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:36.073744 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:30:36.078966 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-63f95951-89e3-4970-9685-251098f2adc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de41c95704ee4e1790d953c0f68bc208', 'request_id': 'req-63f95951-89e3-4970-9685-251098f2adc1'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:36.087216 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-63f95951-89e3-4970-9685-251098f2adc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de41c95704ee4e1790d953c0f68bc208', 'request_id': 'req-63f95951-89e3-4970-9685-251098f2adc1'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:36.155739 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-63f95951-89e3-4970-9685-251098f2adc1 admin admin] The token cache is being invalidate because project de41c95704ee4e1790d953c0f68bc208 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:30:36.156025 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-63f95951-89e3-4970-9685-251098f2adc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:36.156528 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-63f95951-89e3-4970-9685-251098f2adc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:36.158023 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1371/2734] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:30:35 2022] DELETE /identity/v3/projects/de41c95704ee4e1790d953c0f68bc208 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:30:36.164826 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a587b1-42d7-4e3e-9567-85b2084dc602 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:36.165753 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a587b1-42d7-4e3e-9567-85b2084dc602 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:36.166030 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a587b1-42d7-4e3e-9567-85b2084dc602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:36.186218 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-a5a587b1-42d7-4e3e-9567-85b2084dc602 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:30:36.187461 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a5a587b1-42d7-4e3e-9567-85b2084dc602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:36.248361 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1364/2735] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:30:36.257940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9d399-9e50-41bf-bdd4-5e64495df85f None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:36.258227 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9d399-9e50-41bf-bdd4-5e64495df85f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:36.258503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9d399-9e50-41bf-bdd4-5e64495df85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:36.281148 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-bac9d399-9e50-41bf-bdd4-5e64495df85f None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:30:36.282423 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-bac9d399-9e50-41bf-bdd4-5e64495df85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:36.290944 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1372/2736] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:30:36.295516 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a587b1-42d7-4e3e-9567-85b2084dc602 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:36.305801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a587b1-42d7-4e3e-9567-85b2084dc602 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:36.310444 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3c715-062d-4d11-8211-21ccb6e17b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:36.314719 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3c715-062d-4d11-8211-21ccb6e17b39 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:36.314719 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3c715-062d-4d11-8211-21ccb6e17b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:36.314719 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e3c715-062d-4d11-8211-21ccb6e17b39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:36.314719 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3c715-062d-4d11-8211-21ccb6e17b39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:30:36.314719 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3c715-062d-4d11-8211-21ccb6e17b39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:36.314719 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e3c715-062d-4d11-8211-21ccb6e17b39 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:36.325870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1365/2737] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:30:36.330634 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9d399-9e50-41bf-bdd4-5e64495df85f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:36.340466 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9d399-9e50-41bf-bdd4-5e64495df85f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:36.345154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690bfaf-ab86-4d55-bbab-be31bd9747da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:36.345748 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690bfaf-ab86-4d55-bbab-be31bd9747da admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:36.346025 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690bfaf-ab86-4d55-bbab-be31bd9747da admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:36.346292 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690bfaf-ab86-4d55-bbab-be31bd9747da admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:36.346919 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b690bfaf-ab86-4d55-bbab-be31bd9747da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:36.349617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b690bfaf-ab86-4d55-bbab-be31bd9747da admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:36.473691 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1373/2738] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:30:36 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:30:36.478433 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3c715-062d-4d11-8211-21ccb6e17b39 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:36.490343 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e3c715-062d-4d11-8211-21ccb6e17b39 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:36.550017 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280c2cd-fc28-44e5-b567-e482358b700c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:36.550704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280c2cd-fc28-44e5-b567-e482358b700c admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:36.551017 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280c2cd-fc28-44e5-b567-e482358b700c admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:36.551407 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280c2cd-fc28-44e5-b567-e482358b700c admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:36.552014 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b280c2cd-fc28-44e5-b567-e482358b700c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:36.553969 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b280c2cd-fc28-44e5-b567-e482358b700c admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:36.649244 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1366/2739] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:30:36 2022] POST /identity/v3/users => generated 292 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:30:36.653618 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690bfaf-ab86-4d55-bbab-be31bd9747da admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:36.664269 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690bfaf-ab86-4d55-bbab-be31bd9747da admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:36.669182 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bd526-c519-4559-9e21-df004f3e0bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:36.669796 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bd526-c519-4559-9e21-df004f3e0bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:36.670077 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bd526-c519-4559-9e21-df004f3e0bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:36.670347 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bd526-c519-4559-9e21-df004f3e0bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:36.671245 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3bd526-c519-4559-9e21-df004f3e0bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:36.672895 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3bd526-c519-4559-9e21-df004f3e0bc5 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:36.683702 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1374/2740] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:30:36.688025 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280c2cd-fc28-44e5-b567-e482358b700c admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:36.698742 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280c2cd-fc28-44e5-b567-e482358b700c admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:36.703771 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e44f2-4a32-4f8c-911e-0ff5d756fddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:36.704406 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e44f2-4a32-4f8c-911e-0ff5d756fddf admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:36.704689 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e44f2-4a32-4f8c-911e-0ff5d756fddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:36.704964 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e44f2-4a32-4f8c-911e-0ff5d756fddf admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:36.705603 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e44f2-4a32-4f8c-911e-0ff5d756fddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:36.707894 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9e44f2-4a32-4f8c-911e-0ff5d756fddf admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:36.719000 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1367/2741] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:30:36.723412 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bd526-c519-4559-9e21-df004f3e0bc5 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:36.733452 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bd526-c519-4559-9e21-df004f3e0bc5 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:36.738847 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661a2a4-ca4b-47de-b54d-9d1ddeb366cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:36.739492 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661a2a4-ca4b-47de-b54d-9d1ddeb366cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:36.739774 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661a2a4-ca4b-47de-b54d-9d1ddeb366cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:36.740049 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661a2a4-ca4b-47de-b54d-9d1ddeb366cf admin admin] PATH_INFO: `/v3/projects/edaa4e5940614719aecbb007a20ce0e7/users/32d8c130ca004d619273617bdfe60fc1/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:36.754941 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661a2a4-ca4b-47de-b54d-9d1ddeb366cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=edaa4e5940614719aecbb007a20ce0e7, user_id=32d8c130ca004d619273617bdfe60fc1, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:36.757593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9661a2a4-ca4b-47de-b54d-9d1ddeb366cf admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:36.848820 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1375/2742] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:30:36 2022] PUT /identity/v3/projects/edaa4e5940614719aecbb007a20ce0e7/users/32d8c130ca004d619273617bdfe60fc1/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:30:36.860566 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbde3c4-1f4d-4f9a-a4a6-1e9c462b7a44 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:36.860851 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbde3c4-1f4d-4f9a-a4a6-1e9c462b7a44 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:36.861122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbde3c4-1f4d-4f9a-a4a6-1e9c462b7a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:36.890730 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-8cbde3c4-1f4d-4f9a-a4a6-1e9c462b7a44 None None] MFA Rules not processed for user `32d8c130ca004d619273617bdfe60fc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:30:36.891956 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8cbde3c4-1f4d-4f9a-a4a6-1e9c462b7a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:36.907628 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:30:36.963703 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1368/2743] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:30:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:30:36.968244 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661a2a4-ca4b-47de-b54d-9d1ddeb366cf admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:37.036623 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661a2a4-ca4b-47de-b54d-9d1ddeb366cf admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:37.043076 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d22d6-3ccd-4e3a-abd4-776c604d617d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:37.043076 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d22d6-3ccd-4e3a-abd4-776c604d617d admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:37.043076 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d22d6-3ccd-4e3a-abd4-776c604d617d admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:37.043076 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d22d6-3ccd-4e3a-abd4-776c604d617d admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:37.043522 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d22d6-3ccd-4e3a-abd4-776c604d617d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:37.045455 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d22d6-3ccd-4e3a-abd4-776c604d617d admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:37.117724 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1376/2744] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:30:36 2022] POST /identity/v3/projects => generated 381 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:30:37.122014 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbde3c4-1f4d-4f9a-a4a6-1e9c462b7a44 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:37.134600 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbde3c4-1f4d-4f9a-a4a6-1e9c462b7a44 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:37.195197 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192cbb38-2acc-4c9b-b0b7-40e0c6126ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:37.195833 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cbb38-2acc-4c9b-b0b7-40e0c6126ccf admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:37.196073 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cbb38-2acc-4c9b-b0b7-40e0c6126ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:37.196375 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192cbb38-2acc-4c9b-b0b7-40e0c6126ccf admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:37.197005 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192cbb38-2acc-4c9b-b0b7-40e0c6126ccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:37.198889 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192cbb38-2acc-4c9b-b0b7-40e0c6126ccf admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:37.291100 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1369/2745] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:30:37 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:30:37.292312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d22d6-3ccd-4e3a-abd4-776c604d617d admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:37.303995 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d22d6-3ccd-4e3a-abd4-776c604d617d admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:37.308902 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95addb-17c2-416d-90db-06c27af9380c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:37.309622 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95addb-17c2-416d-90db-06c27af9380c admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:37.309769 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95addb-17c2-416d-90db-06c27af9380c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:37.310041 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95addb-17c2-416d-90db-06c27af9380c admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:37.310681 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95addb-17c2-416d-90db-06c27af9380c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:37.312383 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95addb-17c2-416d-90db-06c27af9380c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:37.324962 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1377/2746] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:30:37.329304 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192cbb38-2acc-4c9b-b0b7-40e0c6126ccf admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:37.340668 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192cbb38-2acc-4c9b-b0b7-40e0c6126ccf admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:37.345984 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c3348-eb05-49fb-b47f-cce8253115f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:37.346683 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c3348-eb05-49fb-b47f-cce8253115f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:37.346963 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c3348-eb05-49fb-b47f-cce8253115f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:37.347454 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c3348-eb05-49fb-b47f-cce8253115f2 admin admin] PATH_INFO: `/v3/projects/386980c7ff3546cdb74d78e5e04fda2e/users/36de3a33e6c442e3aa990d2e9176c3ae/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:37.364557 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c3348-eb05-49fb-b47f-cce8253115f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=386980c7ff3546cdb74d78e5e04fda2e, user_id=36de3a33e6c442e3aa990d2e9176c3ae, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:37.367224 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c3348-eb05-49fb-b47f-cce8253115f2 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:37.461854 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1370/2747] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:30:37 2022] PUT /identity/v3/projects/386980c7ff3546cdb74d78e5e04fda2e/users/36de3a33e6c442e3aa990d2e9176c3ae/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:30:37.466631 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95addb-17c2-416d-90db-06c27af9380c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:37.480725 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95addb-17c2-416d-90db-06c27af9380c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:37.531304 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:30:37.549672 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272059af-9570-4fe0-b6f5-f354b19d22ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:37.550394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272059af-9570-4fe0-b6f5-f354b19d22ec admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:37.550853 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272059af-9570-4fe0-b6f5-f354b19d22ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:37.551567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272059af-9570-4fe0-b6f5-f354b19d22ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:37.552316 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272059af-9570-4fe0-b6f5-f354b19d22ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:37.553991 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272059af-9570-4fe0-b6f5-f354b19d22ec admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:37.565167 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1378/2748] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:30:37.570335 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c3348-eb05-49fb-b47f-cce8253115f2 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:37.584584 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c3348-eb05-49fb-b47f-cce8253115f2 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:37.590190 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aadedd-3a95-4b5e-a5e4-23696f733046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:37.590911 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aadedd-3a95-4b5e-a5e4-23696f733046 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:37.591188 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aadedd-3a95-4b5e-a5e4-23696f733046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:37.591466 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aadedd-3a95-4b5e-a5e4-23696f733046 admin admin] PATH_INFO: `/v3/projects/386980c7ff3546cdb74d78e5e04fda2e/users/36de3a33e6c442e3aa990d2e9176c3ae/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:37.593511 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aadedd-3a95-4b5e-a5e4-23696f733046 admin admin] RBAC: Authorizing `identity:create_grant(project_id=386980c7ff3546cdb74d78e5e04fda2e, user_id=36de3a33e6c442e3aa990d2e9176c3ae, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:37.596366 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aadedd-3a95-4b5e-a5e4-23696f733046 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:37.607630 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1371/2749] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:30:37 2022] PUT /identity/v3/projects/386980c7ff3546cdb74d78e5e04fda2e/users/36de3a33e6c442e3aa990d2e9176c3ae/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:30:37.618920 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33256b-55db-4659-908a-936dd48fc674 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:37.621206 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33256b-55db-4659-908a-936dd48fc674 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:37.621206 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33256b-55db-4659-908a-936dd48fc674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:37.650527 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-fe33256b-55db-4659-908a-936dd48fc674 None None] MFA Rules not processed for user `36de3a33e6c442e3aa990d2e9176c3ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:30:37.651752 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fe33256b-55db-4659-908a-936dd48fc674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:37.729193 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1379/2750] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:30:37 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:30:37.742479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aadedd-3a95-4b5e-a5e4-23696f733046 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:37.745382 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-20aadedd-3a95-4b5e-a5e4-23696f733046 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:37.808859 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aadedd-3a95-4b5e-a5e4-23696f733046 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:37.812880 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45882334-6536-4c92-8578-1fe19ca25eb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:37.813581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45882334-6536-4c92-8578-1fe19ca25eb5 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:37.813932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45882334-6536-4c92-8578-1fe19ca25eb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:37.814278 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45882334-6536-4c92-8578-1fe19ca25eb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:37.825334 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45882334-6536-4c92-8578-1fe19ca25eb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:37.827283 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45882334-6536-4c92-8578-1fe19ca25eb5 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:37.837867 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1372/2751] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:30:37 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:30:38.036293 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33256b-55db-4659-908a-936dd48fc674 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:38.046725 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33256b-55db-4659-908a-936dd48fc674 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:38.051993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8753a83-103d-463a-a9fa-acc27eabbd27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:38.052759 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8753a83-103d-463a-a9fa-acc27eabbd27 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:38.053141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8753a83-103d-463a-a9fa-acc27eabbd27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:38.053480 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8753a83-103d-463a-a9fa-acc27eabbd27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:38.119051 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8753a83-103d-463a-a9fa-acc27eabbd27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:38.120459 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8753a83-103d-463a-a9fa-acc27eabbd27 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:38.130145 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1380/2752] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:30:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 06 21:30:38.749384 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45882334-6536-4c92-8578-1fe19ca25eb5 service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:38.764914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:30:38.819500 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45882334-6536-4c92-8578-1fe19ca25eb5 service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:38.824404 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d94f2-c45f-4743-bc4b-8f63966db098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:38.825054 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d94f2-c45f-4743-bc4b-8f63966db098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:38.825347 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d94f2-c45f-4743-bc4b-8f63966db098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:38.825619 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d94f2-c45f-4743-bc4b-8f63966db098 admin admin] PATH_INFO: `/v3/users/32d8c130ca004d619273617bdfe60fc1` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:38.826809 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d94f2-c45f-4743-bc4b-8f63966db098 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32d8c130ca004d619273617bdfe60fc1)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:38.828845 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d94f2-c45f-4743-bc4b-8f63966db098 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:39.065004 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-869d94f2-c45f-4743-bc4b-8f63966db098 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32d8c130ca004d619273617bdfe60fc1'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:39.151091 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-869d94f2-c45f-4743-bc4b-8f63966db098 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32d8c130ca004d619273617bdfe60fc1'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:39.167626 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-869d94f2-c45f-4743-bc4b-8f63966db098 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32d8c130ca004d619273617bdfe60fc1'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:39.168630 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-869d94f2-c45f-4743-bc4b-8f63966db098 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32d8c130ca004d619273617bdfe60fc1'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:39.176354 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-869d94f2-c45f-4743-bc4b-8f63966db098 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32d8c130ca004d619273617bdfe60fc1'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:39.182631 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1373/2753] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:30:38 2022] DELETE /identity/v3/users/32d8c130ca004d619273617bdfe60fc1 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:30:39.187359 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14093c7f-6e33-42e8-b39b-a8a269a413fb None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:39.187820 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14093c7f-6e33-42e8-b39b-a8a269a413fb None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:39.188237 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14093c7f-6e33-42e8-b39b-a8a269a413fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:39.211376 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-14093c7f-6e33-42e8-b39b-a8a269a413fb None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:30:39.212613 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-14093c7f-6e33-42e8-b39b-a8a269a413fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:39.278918 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1381/2754] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:30:39.290282 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d94f2-c45f-4743-bc4b-8f63966db098 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:39.291932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-869d94f2-c45f-4743-bc4b-8f63966db098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:39.359102 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d94f2-c45f-4743-bc4b-8f63966db098 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:39.364889 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cbb463-b36e-4aca-8089-956cf1a529b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:39.365621 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbb463-b36e-4aca-8089-956cf1a529b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:39.366018 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbb463-b36e-4aca-8089-956cf1a529b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:39.366534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbb463-b36e-4aca-8089-956cf1a529b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:39.377091 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cbb463-b36e-4aca-8089-956cf1a529b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:39.378511 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cbb463-b36e-4aca-8089-956cf1a529b2 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:39.395247 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1374/2755] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:30:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:30:39.855940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14093c7f-6e33-42e8-b39b-a8a269a413fb None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:39.857160 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-14093c7f-6e33-42e8-b39b-a8a269a413fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:39.872554 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14093c7f-6e33-42e8-b39b-a8a269a413fb None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:39.880549 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d6e97-c159-4516-95f7-760ed73210dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:39.881537 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d6e97-c159-4516-95f7-760ed73210dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:39.881819 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d6e97-c159-4516-95f7-760ed73210dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:39.882859 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d6e97-c159-4516-95f7-760ed73210dc admin admin] PATH_INFO: `/v3/projects/edaa4e5940614719aecbb007a20ce0e7` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:39.887517 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d6e97-c159-4516-95f7-760ed73210dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=edaa4e5940614719aecbb007a20ce0e7)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:39.887517 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d6e97-c159-4516-95f7-760ed73210dc admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:39.890427 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=100 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:30:40.032926 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ee0d6e97-c159-4516-95f7-760ed73210dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edaa4e5940614719aecbb007a20ce0e7', 'request_id': 'req-ee0d6e97-c159-4516-95f7-760ed73210dc'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:40.039364 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ee0d6e97-c159-4516-95f7-760ed73210dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edaa4e5940614719aecbb007a20ce0e7', 'request_id': 'req-ee0d6e97-c159-4516-95f7-760ed73210dc'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:40.045935 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ee0d6e97-c159-4516-95f7-760ed73210dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edaa4e5940614719aecbb007a20ce0e7', 'request_id': 'req-ee0d6e97-c159-4516-95f7-760ed73210dc'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:40.151419 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ee0d6e97-c159-4516-95f7-760ed73210dc admin admin] The token cache is being invalidate because project edaa4e5940614719aecbb007a20ce0e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:30:40.151717 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ee0d6e97-c159-4516-95f7-760ed73210dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:40.152362 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-ee0d6e97-c159-4516-95f7-760ed73210dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:40.154085 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1382/2756] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:30:39 2022] DELETE /identity/v3/projects/edaa4e5940614719aecbb007a20ce0e7 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:30:40.167261 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cbb463-b36e-4aca-8089-956cf1a529b2 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:40.172381 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cbb463-b36e-4aca-8089-956cf1a529b2 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:40.206980 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:30:40.233387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72e522-6108-4614-9150-f7833ebcd557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:40.234146 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72e522-6108-4614-9150-f7833ebcd557 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:40.234454 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72e522-6108-4614-9150-f7833ebcd557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:40.234777 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72e522-6108-4614-9150-f7833ebcd557 admin admin] PATH_INFO: `/v3/users/36de3a33e6c442e3aa990d2e9176c3ae` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:40.236126 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72e522-6108-4614-9150-f7833ebcd557 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36de3a33e6c442e3aa990d2e9176c3ae)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:40.238161 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72e522-6108-4614-9150-f7833ebcd557 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:40.566342 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-7d72e522-6108-4614-9150-f7833ebcd557 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36de3a33e6c442e3aa990d2e9176c3ae'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:40.693914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-7d72e522-6108-4614-9150-f7833ebcd557 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36de3a33e6c442e3aa990d2e9176c3ae'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:40.708710 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-7d72e522-6108-4614-9150-f7833ebcd557 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36de3a33e6c442e3aa990d2e9176c3ae'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:40.709486 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-7d72e522-6108-4614-9150-f7833ebcd557 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36de3a33e6c442e3aa990d2e9176c3ae'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:40.718667 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-7d72e522-6108-4614-9150-f7833ebcd557 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36de3a33e6c442e3aa990d2e9176c3ae'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:40.727506 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1375/2757] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:30:40 2022] DELETE /identity/v3/users/36de3a33e6c442e3aa990d2e9176c3ae => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:30:41.171225 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d6e97-c159-4516-95f7-760ed73210dc admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:41.172829 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ee0d6e97-c159-4516-95f7-760ed73210dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:41.187191 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d6e97-c159-4516-95f7-760ed73210dc admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:41.251332 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91444d09-1dfe-48b7-9712-4e239e4ca03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:41.251973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91444d09-1dfe-48b7-9712-4e239e4ca03a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:41.252296 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91444d09-1dfe-48b7-9712-4e239e4ca03a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:41.252571 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91444d09-1dfe-48b7-9712-4e239e4ca03a admin admin] PATH_INFO: `/v3/projects/386980c7ff3546cdb74d78e5e04fda2e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:41.253916 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91444d09-1dfe-48b7-9712-4e239e4ca03a admin admin] RBAC: Authorizing `identity:delete_project(project_id=386980c7ff3546cdb74d78e5e04fda2e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:41.255867 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91444d09-1dfe-48b7-9712-4e239e4ca03a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:41.433321 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-91444d09-1dfe-48b7-9712-4e239e4ca03a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '386980c7ff3546cdb74d78e5e04fda2e', 'request_id': 'req-91444d09-1dfe-48b7-9712-4e239e4ca03a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:41.434583 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-91444d09-1dfe-48b7-9712-4e239e4ca03a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '386980c7ff3546cdb74d78e5e04fda2e', 'request_id': 'req-91444d09-1dfe-48b7-9712-4e239e4ca03a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:41.441114 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-91444d09-1dfe-48b7-9712-4e239e4ca03a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '386980c7ff3546cdb74d78e5e04fda2e', 'request_id': 'req-91444d09-1dfe-48b7-9712-4e239e4ca03a'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:41.528200 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-91444d09-1dfe-48b7-9712-4e239e4ca03a admin admin] The token cache is being invalidate because project 386980c7ff3546cdb74d78e5e04fda2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:30:41.528486 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-91444d09-1dfe-48b7-9712-4e239e4ca03a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:41.529124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-91444d09-1dfe-48b7-9712-4e239e4ca03a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:30:41.530605 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1383/2758] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:30:41 2022] DELETE /identity/v3/projects/386980c7ff3546cdb74d78e5e04fda2e => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:30:41.536317 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c56dc5-9633-4e80-ae86-3a35519cd3bb None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:41.540082 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c56dc5-9633-4e80-ae86-3a35519cd3bb None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:41.540082 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c56dc5-9633-4e80-ae86-3a35519cd3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:41.557513 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-71c56dc5-9633-4e80-ae86-3a35519cd3bb None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:30:41.558697 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-71c56dc5-9633-4e80-ae86-3a35519cd3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:41.627648 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1376/2759] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:30:41.693862 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cc8f1-a9d4-49cf-986b-1418e9196081 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:41.694053 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cc8f1-a9d4-49cf-986b-1418e9196081 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:41.694328 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406cc8f1-a9d4-49cf-986b-1418e9196081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:41.717002 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-406cc8f1-a9d4-49cf-986b-1418e9196081 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:30:41.718199 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-406cc8f1-a9d4-49cf-986b-1418e9196081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:41.727463 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1384/2760] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:30:41.731629 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c56dc5-9633-4e80-ae86-3a35519cd3bb None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:41.741626 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c56dc5-9633-4e80-ae86-3a35519cd3bb None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:41.747005 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919548d-1d99-49ba-80dd-e7549dbbfe4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:41.747733 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919548d-1d99-49ba-80dd-e7549dbbfe4c admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:41.747894 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919548d-1d99-49ba-80dd-e7549dbbfe4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:41.748225 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919548d-1d99-49ba-80dd-e7549dbbfe4c admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:41.748882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919548d-1d99-49ba-80dd-e7549dbbfe4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:30:41.749184 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919548d-1d99-49ba-80dd-e7549dbbfe4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:41.750793 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919548d-1d99-49ba-80dd-e7549dbbfe4c admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:41.763850 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1377/2761] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:30:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:30:41.768541 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cc8f1-a9d4-49cf-986b-1418e9196081 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:41.778900 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406cc8f1-a9d4-49cf-986b-1418e9196081 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:41.784932 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb7100-c8df-4278-b2d7-57c1e6a789c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:41.785634 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb7100-c8df-4278-b2d7-57c1e6a789c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:41.785870 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb7100-c8df-4278-b2d7-57c1e6a789c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:41.786141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb7100-c8df-4278-b2d7-57c1e6a789c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:41.786785 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb7100-c8df-4278-b2d7-57c1e6a789c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:41.788997 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbb7100-c8df-4278-b2d7-57c1e6a789c6 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:41.806101 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:30:41.954008 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1385/2762] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:30:41 2022] POST /identity/v3/projects => generated 371 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:30:41.959574 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919548d-1d99-49ba-80dd-e7549dbbfe4c admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:41.970283 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919548d-1d99-49ba-80dd-e7549dbbfe4c admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:42.015556 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:30:42.037264 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2d22a-0d71-45ce-a794-4f544f8a58e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:42.037889 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2d22a-0d71-45ce-a794-4f544f8a58e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:42.038178 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2d22a-0d71-45ce-a794-4f544f8a58e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:42.038464 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2d22a-0d71-45ce-a794-4f544f8a58e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:42.039098 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2d22a-0d71-45ce-a794-4f544f8a58e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:42.042527 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2d22a-0d71-45ce-a794-4f544f8a58e0 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:42.313982 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1378/2763] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:30:41 2022] POST /identity/v3/users => generated 286 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:30:42.317564 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb7100-c8df-4278-b2d7-57c1e6a789c6 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:42.328467 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbb7100-c8df-4278-b2d7-57c1e6a789c6 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:42.337154 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a072c-2a29-4f83-a38d-a77bd42b9770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:42.337930 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a072c-2a29-4f83-a38d-a77bd42b9770 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:42.338238 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a072c-2a29-4f83-a38d-a77bd42b9770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:42.338521 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a072c-2a29-4f83-a38d-a77bd42b9770 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:42.339170 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a072c-2a29-4f83-a38d-a77bd42b9770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:42.340939 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a072c-2a29-4f83-a38d-a77bd42b9770 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:42.352347 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1386/2764] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:30:42.359698 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2d22a-0d71-45ce-a794-4f544f8a58e0 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:42.370808 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2d22a-0d71-45ce-a794-4f544f8a58e0 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:42.375563 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd688ed-a06a-417e-b068-a4b36a68366a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:42.376290 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd688ed-a06a-417e-b068-a4b36a68366a admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:42.376596 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd688ed-a06a-417e-b068-a4b36a68366a admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:42.376869 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd688ed-a06a-417e-b068-a4b36a68366a admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:42.377530 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd688ed-a06a-417e-b068-a4b36a68366a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:42.379822 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd688ed-a06a-417e-b068-a4b36a68366a admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:42.392030 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1379/2765] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:30:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:30:42.403933 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a072c-2a29-4f83-a38d-a77bd42b9770 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:42.414554 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a072c-2a29-4f83-a38d-a77bd42b9770 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:42.419653 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d304bc3-b520-43a3-8a5a-acc8ec3dce53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:42.420349 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d304bc3-b520-43a3-8a5a-acc8ec3dce53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:42.420887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d304bc3-b520-43a3-8a5a-acc8ec3dce53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:42.421156 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d304bc3-b520-43a3-8a5a-acc8ec3dce53 admin admin] PATH_INFO: `/v3/projects/00442c9576074f6a8e4fe7e6838d031b/users/4f2d8df7c24744e38f9b43b41791a7c3/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:42.437688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d304bc3-b520-43a3-8a5a-acc8ec3dce53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00442c9576074f6a8e4fe7e6838d031b, user_id=4f2d8df7c24744e38f9b43b41791a7c3, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:42.449011 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d304bc3-b520-43a3-8a5a-acc8ec3dce53 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:42.568774 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1387/2766] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:30:42 2022] PUT /identity/v3/projects/00442c9576074f6a8e4fe7e6838d031b/users/4f2d8df7c24744e38f9b43b41791a7c3/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:30:42.579112 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b796c-2aa9-4eed-b8f9-af9c25b474ce None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:42.579628 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b796c-2aa9-4eed-b8f9-af9c25b474ce None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:42.579628 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b796c-2aa9-4eed-b8f9-af9c25b474ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:42.614961 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-9d6b796c-2aa9-4eed-b8f9-af9c25b474ce None None] MFA Rules not processed for user `4f2d8df7c24744e38f9b43b41791a7c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:30:42.616161 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-9d6b796c-2aa9-4eed-b8f9-af9c25b474ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:42.685313 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1380/2767] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:30:42 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:30:42.696362 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d304bc3-b520-43a3-8a5a-acc8ec3dce53 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:42.699903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4d304bc3-b520-43a3-8a5a-acc8ec3dce53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:42.762775 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d304bc3-b520-43a3-8a5a-acc8ec3dce53 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:42.766446 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8d289-a211-4ebb-ac04-ce0d49f2c28b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c2ba30d9c40641bf8abb580a219b5352', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:42.767917 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8d289-a211-4ebb-ac04-ce0d49f2c28b service glance] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:42.767917 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8d289-a211-4ebb-ac04-ce0d49f2c28b service glance] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:42.767917 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8d289-a211-4ebb-ac04-ce0d49f2c28b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:42.776494 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8d289-a211-4ebb-ac04-ce0d49f2c28b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:42.777940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8d289-a211-4ebb-ac04-ce0d49f2c28b service glance] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:42.787778 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1388/2768] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:30:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:30:45.033674 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b796c-2aa9-4eed-b8f9-af9c25b474ce None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:30:45.035803 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-9d6b796c-2aa9-4eed-b8f9-af9c25b474ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:45.150634 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b796c-2aa9-4eed-b8f9-af9c25b474ce None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:30:45.155682 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d19f9-fab1-444c-9065-e751bc45d4c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3295306746f4552837f1bb12b2c500f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:30:45.156316 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d19f9-fab1-444c-9065-e751bc45d4c2 service placement] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:45.156598 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d19f9-fab1-444c-9065-e751bc45d4c2 service placement] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:45.156892 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d19f9-fab1-444c-9065-e751bc45d4c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:45.158603 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5a6d19f9-fab1-444c-9065-e751bc45d4c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:45.171969 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d19f9-fab1-444c-9065-e751bc45d4c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:30:45.175194 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d19f9-fab1-444c-9065-e751bc45d4c2 service placement] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:30:45.193944 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1381/2769] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:30:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:30:52.782958 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:INSERT=2,keystone:SELECT=43 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:30:55.183173 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:30:59.242824 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195c95a-50a3-48f9-98e0-ef8966623a65 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:30:59.243339 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195c95a-50a3-48f9-98e0-ef8966623a65 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:30:59.243446 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4195c95a-50a3-48f9-98e0-ef8966623a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:30:59.261968 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-4195c95a-50a3-48f9-98e0-ef8966623a65 None None] MFA Rules not processed for user `c4eae7912af24007ba5a099abe3a36b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:30:59.263357 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-4195c95a-50a3-48f9-98e0-ef8966623a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:30:59.320316 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1389/2770] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:30:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:31:07.199493 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d19f9-fab1-444c-9065-e751bc45d4c2 service placement] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:31:07.260673 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d19f9-fab1-444c-9065-e751bc45d4c2 service placement] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:31:07.265136 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465952b6-3146-4d10-bb5b-8036d3446a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:31:07.265757 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465952b6-3146-4d10-bb5b-8036d3446a92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:31:07.266054 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465952b6-3146-4d10-bb5b-8036d3446a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:31:07.266310 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465952b6-3146-4d10-bb5b-8036d3446a92 admin admin] PATH_INFO: `/v3/users/4f2d8df7c24744e38f9b43b41791a7c3` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:31:07.267422 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465952b6-3146-4d10-bb5b-8036d3446a92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f2d8df7c24744e38f9b43b41791a7c3)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:31:07.269355 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465952b6-3146-4d10-bb5b-8036d3446a92 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:31:07.500352 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-465952b6-3146-4d10-bb5b-8036d3446a92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f2d8df7c24744e38f9b43b41791a7c3'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:31:07.561143 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-465952b6-3146-4d10-bb5b-8036d3446a92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f2d8df7c24744e38f9b43b41791a7c3'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:31:07.574360 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-465952b6-3146-4d10-bb5b-8036d3446a92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f2d8df7c24744e38f9b43b41791a7c3'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:31:07.575027 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-465952b6-3146-4d10-bb5b-8036d3446a92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f2d8df7c24744e38f9b43b41791a7c3'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:31:07.582147 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-465952b6-3146-4d10-bb5b-8036d3446a92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f2d8df7c24744e38f9b43b41791a7c3'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:31:07.588008 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1382/2771] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:31:07 2022] DELETE /identity/v3/users/4f2d8df7c24744e38f9b43b41791a7c3 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:31:07.592585 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683e868-45a4-4c00-852d-7d2856fed966 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:31:07.593077 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683e868-45a4-4c00-852d-7d2856fed966 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:31:07.593189 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683e868-45a4-4c00-852d-7d2856fed966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:31:07.612276 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8683e868-45a4-4c00-852d-7d2856fed966 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:31:07.613471 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8683e868-45a4-4c00-852d-7d2856fed966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:31:07.671705 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1390/2772] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:31:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:31:07.682034 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465952b6-3146-4d10-bb5b-8036d3446a92 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:31:07.683465 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-465952b6-3146-4d10-bb5b-8036d3446a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:31:07.742909 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465952b6-3146-4d10-bb5b-8036d3446a92 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:31:07.746411 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0ab0a-6daf-42ed-b2bb-c85174eb282c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:31:07.747025 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0ab0a-6daf-42ed-b2bb-c85174eb282c service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:31:07.747306 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0ab0a-6daf-42ed-b2bb-c85174eb282c service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:31:07.747579 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0ab0a-6daf-42ed-b2bb-c85174eb282c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:31:07.757612 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0ab0a-6daf-42ed-b2bb-c85174eb282c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:31:07.759073 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0ab0a-6daf-42ed-b2bb-c85174eb282c service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:31:07.776299 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1383/2773] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:31:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:31:08.277643 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683e868-45a4-4c00-852d-7d2856fed966 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:31:08.279074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8683e868-45a4-4c00-852d-7d2856fed966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:31:08.291951 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683e868-45a4-4c00-852d-7d2856fed966 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:31:08.296987 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febd0304-bffe-4f97-b398-795aeac8b92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:31:08.297780 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd0304-bffe-4f97-b398-795aeac8b92f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:31:08.298149 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd0304-bffe-4f97-b398-795aeac8b92f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:31:08.302727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febd0304-bffe-4f97-b398-795aeac8b92f admin admin] PATH_INFO: `/v3/projects/00442c9576074f6a8e4fe7e6838d031b` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:31:08.302727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd0304-bffe-4f97-b398-795aeac8b92f admin admin] RBAC: Authorizing `identity:delete_project(project_id=00442c9576074f6a8e4fe7e6838d031b)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:31:08.302727 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febd0304-bffe-4f97-b398-795aeac8b92f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:31:08.413458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-febd0304-bffe-4f97-b398-795aeac8b92f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00442c9576074f6a8e4fe7e6838d031b', 'request_id': 'req-febd0304-bffe-4f97-b398-795aeac8b92f'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:31:08.419044 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-febd0304-bffe-4f97-b398-795aeac8b92f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00442c9576074f6a8e4fe7e6838d031b', 'request_id': 'req-febd0304-bffe-4f97-b398-795aeac8b92f'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:31:08.425442 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-febd0304-bffe-4f97-b398-795aeac8b92f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00442c9576074f6a8e4fe7e6838d031b', 'request_id': 'req-febd0304-bffe-4f97-b398-795aeac8b92f'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:31:08.509109 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-febd0304-bffe-4f97-b398-795aeac8b92f admin admin] The token cache is being invalidate because project 00442c9576074f6a8e4fe7e6838d031b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:31:08.509404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-febd0304-bffe-4f97-b398-795aeac8b92f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:31:08.510040 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-febd0304-bffe-4f97-b398-795aeac8b92f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:31:08.511517 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1391/2774] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:31:08 2022] DELETE /identity/v3/projects/00442c9576074f6a8e4fe7e6838d031b => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:31:08.516543 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f7fbe-a3ae-41e9-8bf8-21af7ac53e5d None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:31:08.519670 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f7fbe-a3ae-41e9-8bf8-21af7ac53e5d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:31:08.519670 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f7fbe-a3ae-41e9-8bf8-21af7ac53e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:31:08.536520 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-728f7fbe-a3ae-41e9-8bf8-21af7ac53e5d None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:31:08.538275 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-728f7fbe-a3ae-41e9-8bf8-21af7ac53e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:31:08.555914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:31:08.597991 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1384/2775] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:31:08.607636 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f08c5-97a2-4d8c-9568-a98d23682fe9 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:31:08.608138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f08c5-97a2-4d8c-9568-a98d23682fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:31:08.608239 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92f08c5-97a2-4d8c-9568-a98d23682fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:31:08.629718 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-a92f08c5-97a2-4d8c-9568-a98d23682fe9 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:31:08.630918 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a92f08c5-97a2-4d8c-9568-a98d23682fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:31:08.638983 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1392/2776] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:31:08.643240 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f7fbe-a3ae-41e9-8bf8-21af7ac53e5d None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:31:08.652969 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f7fbe-a3ae-41e9-8bf8-21af7ac53e5d None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:31:08.657540 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a4e6d-9ba2-4f32-aaba-a620f4dfa605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:31:08.658134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a4e6d-9ba2-4f32-aaba-a620f4dfa605 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:31:08.658415 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a4e6d-9ba2-4f32-aaba-a620f4dfa605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:31:08.658691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a4e6d-9ba2-4f32-aaba-a620f4dfa605 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:31:08.659325 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a4e6d-9ba2-4f32-aaba-a620f4dfa605 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:31:08.659627 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a4e6d-9ba2-4f32-aaba-a620f4dfa605 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:31:08.661253 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a4e6d-9ba2-4f32-aaba-a620f4dfa605 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:31:08.673948 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1385/2777] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:31:08.678024 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f08c5-97a2-4d8c-9568-a98d23682fe9 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:31:08.687887 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92f08c5-97a2-4d8c-9568-a98d23682fe9 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:31:08.692431 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b0058-62c3-457b-a177-44cbeb298c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:31:08.693020 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b0058-62c3-457b-a177-44cbeb298c25 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:31:08.693297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b0058-62c3-457b-a177-44cbeb298c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:31:08.693583 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b0058-62c3-457b-a177-44cbeb298c25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:31:08.694253 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b0058-62c3-457b-a177-44cbeb298c25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:31:08.696122 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b0058-62c3-457b-a177-44cbeb298c25 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:31:08.813613 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:31:08.819829 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1393/2778] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:31:08 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:31:08.823988 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a4e6d-9ba2-4f32-aaba-a620f4dfa605 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:31:08.834175 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a4e6d-9ba2-4f32-aaba-a620f4dfa605 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:31:08.893391 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614245a4-4e3e-4476-bcba-06b206e2dd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:31:08.894005 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614245a4-4e3e-4476-bcba-06b206e2dd8e admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:31:08.894284 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614245a4-4e3e-4476-bcba-06b206e2dd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:31:08.894556 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614245a4-4e3e-4476-bcba-06b206e2dd8e admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:31:08.895184 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614245a4-4e3e-4476-bcba-06b206e2dd8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:31:08.897663 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614245a4-4e3e-4476-bcba-06b206e2dd8e admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:31:08.995565 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1386/2779] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:31:08 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:31:08.999849 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b0058-62c3-457b-a177-44cbeb298c25 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:31:09.010394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b0058-62c3-457b-a177-44cbeb298c25 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:31:09.015114 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e04f0-0ea1-4377-a099-de7b9d161358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:31:09.015723 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e04f0-0ea1-4377-a099-de7b9d161358 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:31:09.016005 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e04f0-0ea1-4377-a099-de7b9d161358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:31:09.016312 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e04f0-0ea1-4377-a099-de7b9d161358 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:31:09.017169 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e04f0-0ea1-4377-a099-de7b9d161358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:31:09.019163 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3e04f0-0ea1-4377-a099-de7b9d161358 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:31:09.030805 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1394/2780] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:31:09.035142 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614245a4-4e3e-4476-bcba-06b206e2dd8e admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:31:09.046231 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614245a4-4e3e-4476-bcba-06b206e2dd8e admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:31:09.050935 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac4b61-56d9-45a4-9635-a2be8c72572e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:31:09.051538 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac4b61-56d9-45a4-9635-a2be8c72572e admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:31:09.051821 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac4b61-56d9-45a4-9635-a2be8c72572e admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:31:09.052122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac4b61-56d9-45a4-9635-a2be8c72572e admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:31:09.052780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac4b61-56d9-45a4-9635-a2be8c72572e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:31:09.054372 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac4b61-56d9-45a4-9635-a2be8c72572e admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:31:09.065149 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1387/2781] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:31:09.069868 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e04f0-0ea1-4377-a099-de7b9d161358 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:31:09.079729 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e04f0-0ea1-4377-a099-de7b9d161358 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:31:09.084310 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107c644-5f5b-43b0-8293-46b58b8bf99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:31:09.085617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107c644-5f5b-43b0-8293-46b58b8bf99a admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:31:09.085993 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107c644-5f5b-43b0-8293-46b58b8bf99a admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:31:09.086165 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107c644-5f5b-43b0-8293-46b58b8bf99a admin admin] PATH_INFO: `/v3/projects/9097ec16166b45199e58bd3f8f21f537/users/a255f647d6fd4f209621be4d9e8548e0/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:31:09.100861 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107c644-5f5b-43b0-8293-46b58b8bf99a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9097ec16166b45199e58bd3f8f21f537, user_id=a255f647d6fd4f209621be4d9e8548e0, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:31:09.103506 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107c644-5f5b-43b0-8293-46b58b8bf99a admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:31:09.214660 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1395/2782] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:31:09 2022] PUT /identity/v3/projects/9097ec16166b45199e58bd3f8f21f537/users/a255f647d6fd4f209621be4d9e8548e0/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:31:09.219607 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242623e7-9b7b-41e5-8ddb-4e9749eb69ce None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:31:09.222235 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242623e7-9b7b-41e5-8ddb-4e9749eb69ce None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:31:09.222235 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242623e7-9b7b-41e5-8ddb-4e9749eb69ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:31:09.240222 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-242623e7-9b7b-41e5-8ddb-4e9749eb69ce None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:31:09.241427 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-242623e7-9b7b-41e5-8ddb-4e9749eb69ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:31:09.306802 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1388/2783] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:31:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:31:09.316758 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107c644-5f5b-43b0-8293-46b58b8bf99a admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:31:09.318582 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-7107c644-5f5b-43b0-8293-46b58b8bf99a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:31:09.386318 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107c644-5f5b-43b0-8293-46b58b8bf99a admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:31:09.390034 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be50ab-1ebd-456f-a71f-2021cbe84f10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:31:09.390645 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be50ab-1ebd-456f-a71f-2021cbe84f10 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:31:09.390925 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be50ab-1ebd-456f-a71f-2021cbe84f10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:31:09.391197 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be50ab-1ebd-456f-a71f-2021cbe84f10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:31:09.401004 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be50ab-1ebd-456f-a71f-2021cbe84f10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:31:09.402436 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be50ab-1ebd-456f-a71f-2021cbe84f10 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:31:09.412242 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1396/2784] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:31:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:31:10.649428 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49551f39-3f2c-44b1-a95a-86c313b82b38 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:31:10.650015 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49551f39-3f2c-44b1-a95a-86c313b82b38 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:31:10.650123 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49551f39-3f2c-44b1-a95a-86c313b82b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:31:10.679030 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-49551f39-3f2c-44b1-a95a-86c313b82b38 None None] MFA Rules not processed for user `a255f647d6fd4f209621be4d9e8548e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:31:10.680351 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-49551f39-3f2c-44b1-a95a-86c313b82b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:31:10.698828 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:31:10.746985 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1389/2785] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:31:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:31:10.758173 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be50ab-1ebd-456f-a71f-2021cbe84f10 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:31:10.759708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-84be50ab-1ebd-456f-a71f-2021cbe84f10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:31:10.816477 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be50ab-1ebd-456f-a71f-2021cbe84f10 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:31:10.820744 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1881dc-16d5-4155-969d-003e8659c976 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:31:10.821882 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1881dc-16d5-4155-969d-003e8659c976 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:31:10.821882 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1881dc-16d5-4155-969d-003e8659c976 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:31:10.821882 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1881dc-16d5-4155-969d-003e8659c976 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:31:10.829971 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1881dc-16d5-4155-969d-003e8659c976 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:31:10.831370 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1881dc-16d5-4155-969d-003e8659c976 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:31:10.841000 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1397/2786] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:31:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:31:12.739688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db59cb-10f6-4749-bf4a-bed76683c37e None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:31:12.740244 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db59cb-10f6-4749-bf4a-bed76683c37e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:31:12.740379 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3db59cb-10f6-4749-bf4a-bed76683c37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:31:12.760000 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-d3db59cb-10f6-4749-bf4a-bed76683c37e None None] MFA Rules not processed for user `a255f647d6fd4f209621be4d9e8548e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:31:12.761226 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d3db59cb-10f6-4749-bf4a-bed76683c37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:31:12.767927 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1390/2787] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:31:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:31:20.836984 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=67,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:31:22.754030 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=22 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:31:28.829210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1881dc-16d5-4155-969d-003e8659c976 service cinder] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:31:28.839943 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1881dc-16d5-4155-969d-003e8659c976 service cinder] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:31:28.843503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47e18c-16df-4adc-aa4d-f18bf0281145 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:31:28.844202 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47e18c-16df-4adc-aa4d-f18bf0281145 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:31:28.844482 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47e18c-16df-4adc-aa4d-f18bf0281145 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:31:28.844744 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47e18c-16df-4adc-aa4d-f18bf0281145 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:31:28.846681 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9a47e18c-16df-4adc-aa4d-f18bf0281145 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:31:28.857046 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a47e18c-16df-4adc-aa4d-f18bf0281145 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:31:28.858514 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a47e18c-16df-4adc-aa4d-f18bf0281145 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:31:28.869501 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1398/2788] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:31:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:31:28.948538 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db59cb-10f6-4749-bf4a-bed76683c37e None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:31:28.959045 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3db59cb-10f6-4749-bf4a-bed76683c37e None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:31:28.962774 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1c61c-91cb-4a9a-b61d-06de8c0e2081 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:31:28.963375 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1c61c-91cb-4a9a-b61d-06de8c0e2081 service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:31:28.963670 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1c61c-91cb-4a9a-b61d-06de8c0e2081 service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:31:28.963924 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1c61c-91cb-4a9a-b61d-06de8c0e2081 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:31:28.965719 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-93f1c61c-91cb-4a9a-b61d-06de8c0e2081 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:31:29.059927 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1c61c-91cb-4a9a-b61d-06de8c0e2081 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:31:29.061370 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1c61c-91cb-4a9a-b61d-06de8c0e2081 service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:31:29.082595 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1391/2789] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:31:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:31:38.863115 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=6 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:31:39.079700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=46 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:31:45.119518 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb62433-4249-4194-a5ff-987bdeeb8970 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:31:45.120085 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb62433-4249-4194-a5ff-987bdeeb8970 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:31:45.120085 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb62433-4249-4194-a5ff-987bdeeb8970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:31:45.139773 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-2eb62433-4249-4194-a5ff-987bdeeb8970 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:31:45.141025 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2eb62433-4249-4194-a5ff-987bdeeb8970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:31:45.148833 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1399/2790] 10.222.0.75 () {58 vars in 1016 bytes} [Tue Sep 6 21:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:31:45.162883 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1c61c-91cb-4a9a-b61d-06de8c0e2081 service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:31:45.164347 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-93f1c61c-91cb-4a9a-b61d-06de8c0e2081 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:31:45.178047 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1c61c-91cb-4a9a-b61d-06de8c0e2081 service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:31:45.183357 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b256ba-18ec-4b58-bad6-075c8bb80c5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:31:45.183945 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b256ba-18ec-4b58-bad6-075c8bb80c5b service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:31:45.184261 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b256ba-18ec-4b58-bad6-075c8bb80c5b service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:31:45.184534 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b256ba-18ec-4b58-bad6-075c8bb80c5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:31:45.192600 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b256ba-18ec-4b58-bad6-075c8bb80c5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:31:45.194226 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b256ba-18ec-4b58-bad6-075c8bb80c5b service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:31:45.204272 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1392/2791] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:31:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:31:49.385507 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a088cf0-6a50-44ff-845d-1ded7c047a0a None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:31:49.386075 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a088cf0-6a50-44ff-845d-1ded7c047a0a None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:31:49.386075 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a088cf0-6a50-44ff-845d-1ded7c047a0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:31:49.405836 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-1a088cf0-6a50-44ff-845d-1ded7c047a0a None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:31:49.407015 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1a088cf0-6a50-44ff-845d-1ded7c047a0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:31:49.414922 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1400/2792] 10.222.0.75 () {58 vars in 1016 bytes} [Tue Sep 6 21:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:31:49.433545 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b256ba-18ec-4b58-bad6-075c8bb80c5b service nova] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:31:49.435207 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e7b256ba-18ec-4b58-bad6-075c8bb80c5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:31:49.449946 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b256ba-18ec-4b58-bad6-075c8bb80c5b service nova] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:31:49.455364 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9dca12-00fa-4877-83d9-76fa3df9ed04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:31:49.455958 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9dca12-00fa-4877-83d9-76fa3df9ed04 service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:31:49.456277 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9dca12-00fa-4877-83d9-76fa3df9ed04 service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:31:49.456556 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9dca12-00fa-4877-83d9-76fa3df9ed04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:31:49.465015 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9dca12-00fa-4877-83d9-76fa3df9ed04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:31:49.466581 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9dca12-00fa-4877-83d9-76fa3df9ed04 service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:31:49.475851 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1393/2793] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:31:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:31:52.828885 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f37c1-27b3-4f44-8d38-1222522cae4b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:31:52.829506 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f37c1-27b3-4f44-8d38-1222522cae4b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:31:52.829660 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f37c1-27b3-4f44-8d38-1222522cae4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:31:52.849753 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f00f37c1-27b3-4f44-8d38-1222522cae4b None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:31:52.851000 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f00f37c1-27b3-4f44-8d38-1222522cae4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:31:52.859124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1401/2794] 10.222.0.75 () {58 vars in 1016 bytes} [Tue Sep 6 21:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:31:52.881939 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9dca12-00fa-4877-83d9-76fa3df9ed04 service nova] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:31:52.893706 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9dca12-00fa-4877-83d9-76fa3df9ed04 service nova] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:31:52.899138 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e168e-de6f-4d7d-8a64-433d74feb144 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:31:52.899725 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e168e-de6f-4d7d-8a64-433d74feb144 service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:31:52.900883 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e168e-de6f-4d7d-8a64-433d74feb144 service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:31:52.900883 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e168e-de6f-4d7d-8a64-433d74feb144 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:31:52.908698 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e168e-de6f-4d7d-8a64-433d74feb144 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:31:52.910261 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e168e-de6f-4d7d-8a64-433d74feb144 service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:31:52.920004 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1394/2795] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:31:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:31:55.688638 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f56dea-ad2d-450f-8c1e-b541d01b811f None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:31:55.689152 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f56dea-ad2d-450f-8c1e-b541d01b811f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:31:55.689254 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f56dea-ad2d-450f-8c1e-b541d01b811f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:31:55.708720 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-45f56dea-ad2d-450f-8c1e-b541d01b811f None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:31:55.709935 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-45f56dea-ad2d-450f-8c1e-b541d01b811f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:31:55.717847 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1402/2796] 10.222.0.75 () {58 vars in 1016 bytes} [Tue Sep 6 21:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:31:55.734753 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e168e-de6f-4d7d-8a64-433d74feb144 service nova] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:31:55.746475 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e168e-de6f-4d7d-8a64-433d74feb144 service nova] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:31:55.752018 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab7990-c7ff-4a76-8e40-b61b1bd68eb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:31:55.752649 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab7990-c7ff-4a76-8e40-b61b1bd68eb6 service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:31:55.752932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab7990-c7ff-4a76-8e40-b61b1bd68eb6 service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:31:55.753203 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ab7990-c7ff-4a76-8e40-b61b1bd68eb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:31:55.761523 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ab7990-c7ff-4a76-8e40-b61b1bd68eb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:31:55.763082 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ab7990-c7ff-4a76-8e40-b61b1bd68eb6 service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:31:55.784063 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1395/2797] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:31:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:31:58.904414 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36249f23-ea8a-471e-a8b1-c509a6c39799 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:31:58.905017 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36249f23-ea8a-471e-a8b1-c509a6c39799 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:31:58.905017 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36249f23-ea8a-471e-a8b1-c509a6c39799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:31:58.926123 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-36249f23-ea8a-471e-a8b1-c509a6c39799 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:31:58.928211 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-36249f23-ea8a-471e-a8b1-c509a6c39799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:31:58.936982 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1403/2798] 10.222.0.75 () {58 vars in 1016 bytes} [Tue Sep 6 21:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:31:58.954242 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab7990-c7ff-4a76-8e40-b61b1bd68eb6 service nova] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:31:58.965681 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ab7990-c7ff-4a76-8e40-b61b1bd68eb6 service nova] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:31:58.971963 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d76050-e379-4553-b641-a319444fdd8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:31:58.972554 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d76050-e379-4553-b641-a319444fdd8f service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:31:58.972834 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d76050-e379-4553-b641-a319444fdd8f service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:31:58.973106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d76050-e379-4553-b641-a319444fdd8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:31:58.981697 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d76050-e379-4553-b641-a319444fdd8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:31:58.988241 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d76050-e379-4553-b641-a319444fdd8f service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:31:58.992795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1396/2799] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:31:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:32:03.155450 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb16a46-9ab3-484d-adbc-12ef19fb8a2e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:32:03.155995 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb16a46-9ab3-484d-adbc-12ef19fb8a2e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:32:03.155995 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb16a46-9ab3-484d-adbc-12ef19fb8a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:32:03.177510 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-2cb16a46-9ab3-484d-adbc-12ef19fb8a2e None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:32:03.178994 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2cb16a46-9ab3-484d-adbc-12ef19fb8a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:32:03.189211 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1404/2800] 10.222.0.75 () {58 vars in 1016 bytes} [Tue Sep 6 21:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:32:03.206014 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d76050-e379-4553-b641-a319444fdd8f service nova] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:32:03.219190 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d76050-e379-4553-b641-a319444fdd8f service nova] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:32:03.225080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7e641-79b8-4645-8da0-3bd56ad4a5fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:32:03.225700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7e641-79b8-4645-8da0-3bd56ad4a5fe service nova] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:32:03.226070 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7e641-79b8-4645-8da0-3bd56ad4a5fe service nova] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:32:03.226708 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7e641-79b8-4645-8da0-3bd56ad4a5fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:32:03.237817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7e641-79b8-4645-8da0-3bd56ad4a5fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:32:03.239485 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7e641-79b8-4645-8da0-3bd56ad4a5fe service nova] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:32:03.262160 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1397/2801] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:32:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:32:08.744654 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405f03d-0b0e-42f7-8402-31c763c16ab5 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:32:08.745169 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405f03d-0b0e-42f7-8402-31c763c16ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:32:08.745279 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405f03d-0b0e-42f7-8402-31c763c16ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:32:08.764712 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8405f03d-0b0e-42f7-8402-31c763c16ab5 None None] MFA Rules not processed for user `c4eae7912af24007ba5a099abe3a36b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:32:08.765896 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8405f03d-0b0e-42f7-8402-31c763c16ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:32:08.819405 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1405/2802] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:32:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:32:13.249592 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=36 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:32:18.812638 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=43 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:32:19.427366 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734e003-76cc-43e3-a26c-a0093540fb5d None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:32:19.427872 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734e003-76cc-43e3-a26c-a0093540fb5d None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:32:19.427972 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734e003-76cc-43e3-a26c-a0093540fb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:32:19.447879 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-8734e003-76cc-43e3-a26c-a0093540fb5d None None] MFA Rules not processed for user `a255f647d6fd4f209621be4d9e8548e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:32:19.450083 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8734e003-76cc-43e3-a26c-a0093540fb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:32:19.456990 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1398/2803] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:32:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:32:24.961496 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405f03d-0b0e-42f7-8402-31c763c16ab5 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:32:24.978389 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405f03d-0b0e-42f7-8402-31c763c16ab5 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:32:24.984647 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda54a14-9deb-4f4e-8efb-2b9ed570e0dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:32:24.985523 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda54a14-9deb-4f4e-8efb-2b9ed570e0dc service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:32:24.985806 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda54a14-9deb-4f4e-8efb-2b9ed570e0dc service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:32:24.986137 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda54a14-9deb-4f4e-8efb-2b9ed570e0dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:32:24.988038 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-dda54a14-9deb-4f4e-8efb-2b9ed570e0dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:32:25.004454 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda54a14-9deb-4f4e-8efb-2b9ed570e0dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:32:25.007194 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda54a14-9deb-4f4e-8efb-2b9ed570e0dc service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:32:25.019623 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1406/2804] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:32:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:32:29.442716 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:32:35.015166 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=6 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:32:37.884121 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ea9cf-4957-450c-9dbf-070b8c56ed5a None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:32:37.884691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ea9cf-4957-450c-9dbf-070b8c56ed5a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:32:37.884691 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ea9cf-4957-450c-9dbf-070b8c56ed5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:32:37.904440 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-787ea9cf-4957-450c-9dbf-070b8c56ed5a None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:32:37.905674 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-787ea9cf-4957-450c-9dbf-070b8c56ed5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:32:37.913556 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1399/2805] 10.222.0.75 () {58 vars in 1016 bytes} [Tue Sep 6 21:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:32:37.930859 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda54a14-9deb-4f4e-8efb-2b9ed570e0dc service nova] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:32:37.942540 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda54a14-9deb-4f4e-8efb-2b9ed570e0dc service nova] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:32:37.948058 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340987d9-c268-4046-8601-41a705a4b27c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:32:37.948897 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340987d9-c268-4046-8601-41a705a4b27c service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:32:37.949180 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340987d9-c268-4046-8601-41a705a4b27c service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:32:37.949454 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340987d9-c268-4046-8601-41a705a4b27c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:32:37.959617 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340987d9-c268-4046-8601-41a705a4b27c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:32:37.961226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340987d9-c268-4046-8601-41a705a4b27c service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:32:37.971075 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1407/2806] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:32:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:32:41.361117 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed5797-a7bf-49e9-b8b4-50e5329c655e None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:32:41.361582 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed5797-a7bf-49e9-b8b4-50e5329c655e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:32:41.361700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed5797-a7bf-49e9-b8b4-50e5329c655e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:32:41.381418 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-e1ed5797-a7bf-49e9-b8b4-50e5329c655e None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:32:41.385557 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-e1ed5797-a7bf-49e9-b8b4-50e5329c655e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:32:41.391281 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1400/2807] 10.222.0.75 () {58 vars in 1016 bytes} [Tue Sep 6 21:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:32:41.408542 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340987d9-c268-4046-8601-41a705a4b27c service nova] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:32:41.419744 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340987d9-c268-4046-8601-41a705a4b27c service nova] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:32:41.425809 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773881c-34d4-421b-8368-41c9f4ab12d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:32:41.426447 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773881c-34d4-421b-8368-41c9f4ab12d1 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:32:41.426730 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773881c-34d4-421b-8368-41c9f4ab12d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:32:41.427009 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d773881c-34d4-421b-8368-41c9f4ab12d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:32:41.435286 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d773881c-34d4-421b-8368-41c9f4ab12d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:32:41.436900 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d773881c-34d4-421b-8368-41c9f4ab12d1 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:32:41.446145 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1408/2808] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:32:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:32:44.266666 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b05fe1-288f-44a7-9d64-0fab41f0a9e2 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:32:44.267228 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b05fe1-288f-44a7-9d64-0fab41f0a9e2 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:32:44.267228 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b05fe1-288f-44a7-9d64-0fab41f0a9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:32:44.286872 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-48b05fe1-288f-44a7-9d64-0fab41f0a9e2 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:32:44.288064 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-48b05fe1-288f-44a7-9d64-0fab41f0a9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:32:44.297375 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1401/2809] 10.222.0.75 () {58 vars in 1016 bytes} [Tue Sep 6 21:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:32:44.314596 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773881c-34d4-421b-8368-41c9f4ab12d1 service nova] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:32:44.325480 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d773881c-34d4-421b-8368-41c9f4ab12d1 service nova] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:32:44.331346 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f3465-d819-4c6c-9725-733f3209773d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:32:44.336925 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f3465-d819-4c6c-9725-733f3209773d service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:32:44.336925 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f3465-d819-4c6c-9725-733f3209773d service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:32:44.336925 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83f3465-d819-4c6c-9725-733f3209773d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:32:44.341117 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f3465-d819-4c6c-9725-733f3209773d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:32:44.342738 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83f3465-d819-4c6c-9725-733f3209773d service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:32:44.352386 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1409/2810] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:32:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:32:47.511271 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c813d67-4f62-4ebb-a895-e1a4e9a4a4b4 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:32:47.511749 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c813d67-4f62-4ebb-a895-e1a4e9a4a4b4 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:32:47.511959 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c813d67-4f62-4ebb-a895-e1a4e9a4a4b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:32:47.531912 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-7c813d67-4f62-4ebb-a895-e1a4e9a4a4b4 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:32:47.533044 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-7c813d67-4f62-4ebb-a895-e1a4e9a4a4b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:32:47.541844 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1402/2811] 10.222.0.75 () {58 vars in 1016 bytes} [Tue Sep 6 21:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:32:47.558162 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f3465-d819-4c6c-9725-733f3209773d service nova] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:32:47.569093 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83f3465-d819-4c6c-9725-733f3209773d service nova] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:32:47.574629 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8dbb64-e739-4a6f-ab7a-6214424a06c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:32:47.575410 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dbb64-e739-4a6f-ab7a-6214424a06c8 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:32:47.575539 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dbb64-e739-4a6f-ab7a-6214424a06c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:32:47.575754 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8dbb64-e739-4a6f-ab7a-6214424a06c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:32:47.583712 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8dbb64-e739-4a6f-ab7a-6214424a06c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:32:47.585305 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8dbb64-e739-4a6f-ab7a-6214424a06c8 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:32:47.595261 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1410/2812] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:32:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:32:50.698234 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866288ae-833c-4350-be76-d4115647e875 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:32:50.698712 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866288ae-833c-4350-be76-d4115647e875 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:32:50.698819 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866288ae-833c-4350-be76-d4115647e875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:32:50.718611 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-866288ae-833c-4350-be76-d4115647e875 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:32:50.719810 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-866288ae-833c-4350-be76-d4115647e875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:32:50.727675 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1403/2813] 10.222.0.75 () {58 vars in 1016 bytes} [Tue Sep 6 21:32:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:32:50.742210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8dbb64-e739-4a6f-ab7a-6214424a06c8 service nova] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:32:50.753804 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8dbb64-e739-4a6f-ab7a-6214424a06c8 service nova] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:32:50.759262 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bc30a-f32d-4d01-a089-35975ca93100 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4441d8fea57f401a96fb8cbd2b501059', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:32:50.759853 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bc30a-f32d-4d01-a089-35975ca93100 service nova] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:32:50.760163 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bc30a-f32d-4d01-a089-35975ca93100 service nova] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:32:50.760443 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959bc30a-f32d-4d01-a089-35975ca93100 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:32:50.769184 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959bc30a-f32d-4d01-a089-35975ca93100 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:32:50.770752 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959bc30a-f32d-4d01-a089-35975ca93100 service nova] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:32:50.780042 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1411/2814] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:32:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:32:53.823717 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866288ae-833c-4350-be76-d4115647e875 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:32:53.834153 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866288ae-833c-4350-be76-d4115647e875 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:32:53.837724 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005f018-99ec-4eae-8160-23df9e8d5ab0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:32:53.838324 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005f018-99ec-4eae-8160-23df9e8d5ab0 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:32:53.838599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005f018-99ec-4eae-8160-23df9e8d5ab0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:32:53.838877 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005f018-99ec-4eae-8160-23df9e8d5ab0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:32:53.840658 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a005f018-99ec-4eae-8160-23df9e8d5ab0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:32:53.854077 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005f018-99ec-4eae-8160-23df9e8d5ab0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:32:53.855515 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005f018-99ec-4eae-8160-23df9e8d5ab0 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:32:53.866453 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1404/2815] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:32:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:32:59.178408 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bc30a-f32d-4d01-a089-35975ca93100 service nova] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:32:59.179732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-959bc30a-f32d-4d01-a089-35975ca93100 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:32:59.191433 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959bc30a-f32d-4d01-a089-35975ca93100 service nova] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:32:59.194939 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2956d9-b4d1-41a0-9f23-5bda627e09f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:32:59.195536 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2956d9-b4d1-41a0-9f23-5bda627e09f8 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:32:59.195812 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2956d9-b4d1-41a0-9f23-5bda627e09f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:32:59.196079 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2956d9-b4d1-41a0-9f23-5bda627e09f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:32:59.197793 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-eb2956d9-b4d1-41a0-9f23-5bda627e09f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:32:59.213293 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2956d9-b4d1-41a0-9f23-5bda627e09f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:32:59.214788 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2956d9-b4d1-41a0-9f23-5bda627e09f8 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:32:59.232280 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1412/2816] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:32:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:33:03.861636 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=21 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:33:08.398488 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005f018-99ec-4eae-8160-23df9e8d5ab0 service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:08.399937 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a005f018-99ec-4eae-8160-23df9e8d5ab0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:08.470877 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005f018-99ec-4eae-8160-23df9e8d5ab0 service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:08.475974 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d1622-ecbc-4bc7-be09-538f579c5781 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3295306746f4552837f1bb12b2c500f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:08.476571 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d1622-ecbc-4bc7-be09-538f579c5781 service placement] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:08.476853 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d1622-ecbc-4bc7-be09-538f579c5781 service placement] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:08.477187 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d1622-ecbc-4bc7-be09-538f579c5781 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:08.478902 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-6b0d1622-ecbc-4bc7-be09-538f579c5781 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:08.491875 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d1622-ecbc-4bc7-be09-538f579c5781 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:08.494125 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d1622-ecbc-4bc7-be09-538f579c5781 service placement] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:08.504776 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1405/2817] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:33:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:33:09.222751 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=36 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:33:13.457759 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2956d9-b4d1-41a0-9f23-5bda627e09f8 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:13.459973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-eb2956d9-b4d1-41a0-9f23-5bda627e09f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:13.474654 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2956d9-b4d1-41a0-9f23-5bda627e09f8 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:13.479936 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e34956-6f55-485f-9310-17872cd50022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:13.480632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e34956-6f55-485f-9310-17872cd50022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:13.480908 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e34956-6f55-485f-9310-17872cd50022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:13.481179 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e34956-6f55-485f-9310-17872cd50022 admin admin] PATH_INFO: `/v3/users/8ff58811b016456ab3e51711a69f2d9d` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:13.482815 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e34956-6f55-485f-9310-17872cd50022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff58811b016456ab3e51711a69f2d9d)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:13.484790 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e34956-6f55-485f-9310-17872cd50022 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:13.692242 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a7e34956-6f55-485f-9310-17872cd50022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff58811b016456ab3e51711a69f2d9d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:13.775828 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a7e34956-6f55-485f-9310-17872cd50022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff58811b016456ab3e51711a69f2d9d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:13.789327 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a7e34956-6f55-485f-9310-17872cd50022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff58811b016456ab3e51711a69f2d9d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:13.790022 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a7e34956-6f55-485f-9310-17872cd50022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff58811b016456ab3e51711a69f2d9d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:13.797149 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-a7e34956-6f55-485f-9310-17872cd50022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff58811b016456ab3e51711a69f2d9d'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:13.803111 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1413/2818] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:33:13 2022] DELETE /identity/v3/users/8ff58811b016456ab3e51711a69f2d9d => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:33:14.115597 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d1622-ecbc-4bc7-be09-538f579c5781 service placement] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:14.127051 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d1622-ecbc-4bc7-be09-538f579c5781 service placement] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:14.186891 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a459c-59c1-45e6-83c3-55e9aef43cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:14.187536 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a459c-59c1-45e6-83c3-55e9aef43cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:14.187818 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a459c-59c1-45e6-83c3-55e9aef43cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:14.188115 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a459c-59c1-45e6-83c3-55e9aef43cc0 admin admin] PATH_INFO: `/v3/projects/5fdec4349e24426ca0b2aeb7b6029759` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:14.189287 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a459c-59c1-45e6-83c3-55e9aef43cc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fdec4349e24426ca0b2aeb7b6029759)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:14.191214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a459c-59c1-45e6-83c3-55e9aef43cc0 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:14.295282 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b32a459c-59c1-45e6-83c3-55e9aef43cc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fdec4349e24426ca0b2aeb7b6029759', 'request_id': 'req-b32a459c-59c1-45e6-83c3-55e9aef43cc0'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:14.358739 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b32a459c-59c1-45e6-83c3-55e9aef43cc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fdec4349e24426ca0b2aeb7b6029759', 'request_id': 'req-b32a459c-59c1-45e6-83c3-55e9aef43cc0'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:14.364829 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b32a459c-59c1-45e6-83c3-55e9aef43cc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fdec4349e24426ca0b2aeb7b6029759', 'request_id': 'req-b32a459c-59c1-45e6-83c3-55e9aef43cc0'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:14.376734 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b32a459c-59c1-45e6-83c3-55e9aef43cc0 admin admin] The token cache is being invalidate because project 5fdec4349e24426ca0b2aeb7b6029759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:33:14.377026 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b32a459c-59c1-45e6-83c3-55e9aef43cc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:14.377696 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-b32a459c-59c1-45e6-83c3-55e9aef43cc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:14.379169 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1406/2819] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:33:14 2022] DELETE /identity/v3/projects/5fdec4349e24426ca0b2aeb7b6029759 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:33:14.383382 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e34956-6f55-485f-9310-17872cd50022 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:14.384893 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-a7e34956-6f55-485f-9310-17872cd50022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:14.398631 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e34956-6f55-485f-9310-17872cd50022 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:14.457307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4dc10a-3edc-43d0-94ce-ffee2f8d65fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:14.457944 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dc10a-3edc-43d0-94ce-ffee2f8d65fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:14.458539 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dc10a-3edc-43d0-94ce-ffee2f8d65fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:14.458539 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4dc10a-3edc-43d0-94ce-ffee2f8d65fe admin admin] PATH_INFO: `/v3/users/81a82c298b26449b84ad702d842b7932` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:14.459609 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4dc10a-3edc-43d0-94ce-ffee2f8d65fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=81a82c298b26449b84ad702d842b7932)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:14.461603 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4dc10a-3edc-43d0-94ce-ffee2f8d65fe admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:14.652708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9d4dc10a-3edc-43d0-94ce-ffee2f8d65fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81a82c298b26449b84ad702d842b7932'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:14.695233 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9d4dc10a-3edc-43d0-94ce-ffee2f8d65fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81a82c298b26449b84ad702d842b7932'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:14.708083 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9d4dc10a-3edc-43d0-94ce-ffee2f8d65fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81a82c298b26449b84ad702d842b7932'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:14.708786 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9d4dc10a-3edc-43d0-94ce-ffee2f8d65fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81a82c298b26449b84ad702d842b7932'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:14.710847 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:33:14.716612 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9d4dc10a-3edc-43d0-94ce-ffee2f8d65fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81a82c298b26449b84ad702d842b7932'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:14.722307 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1414/2820] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:33:14 2022] DELETE /identity/v3/users/81a82c298b26449b84ad702d842b7932 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:33:14.971976 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a459c-59c1-45e6-83c3-55e9aef43cc0 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:14.974494 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b32a459c-59c1-45e6-83c3-55e9aef43cc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:14.988387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a459c-59c1-45e6-83c3-55e9aef43cc0 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:15.019258 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:33:15.065023 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c235b-36b1-4eab-aa75-0d0cba67eba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:15.065844 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c235b-36b1-4eab-aa75-0d0cba67eba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:15.066386 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c235b-36b1-4eab-aa75-0d0cba67eba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:15.066860 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c235b-36b1-4eab-aa75-0d0cba67eba9 admin admin] PATH_INFO: `/v3/projects/3e1008e1fdc843d0b00f6aba1af09131` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:15.068345 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c235b-36b1-4eab-aa75-0d0cba67eba9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e1008e1fdc843d0b00f6aba1af09131)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:15.070348 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c235b-36b1-4eab-aa75-0d0cba67eba9 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:15.170053 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-4e0c235b-36b1-4eab-aa75-0d0cba67eba9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e1008e1fdc843d0b00f6aba1af09131', 'request_id': 'req-4e0c235b-36b1-4eab-aa75-0d0cba67eba9'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:15.226957 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-4e0c235b-36b1-4eab-aa75-0d0cba67eba9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e1008e1fdc843d0b00f6aba1af09131', 'request_id': 'req-4e0c235b-36b1-4eab-aa75-0d0cba67eba9'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:15.232967 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-4e0c235b-36b1-4eab-aa75-0d0cba67eba9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e1008e1fdc843d0b00f6aba1af09131', 'request_id': 'req-4e0c235b-36b1-4eab-aa75-0d0cba67eba9'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:15.244028 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-4e0c235b-36b1-4eab-aa75-0d0cba67eba9 admin admin] The token cache is being invalidate because project 3e1008e1fdc843d0b00f6aba1af09131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:33:15.244359 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-4e0c235b-36b1-4eab-aa75-0d0cba67eba9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:15.245009 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-4e0c235b-36b1-4eab-aa75-0d0cba67eba9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:15.253155 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1407/2821] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:33:14 2022] DELETE /identity/v3/projects/3e1008e1fdc843d0b00f6aba1af09131 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:33:21.554337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4dc10a-3edc-43d0-94ce-ffee2f8d65fe admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:21.557289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9d4dc10a-3edc-43d0-94ce-ffee2f8d65fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:21.571945 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4dc10a-3edc-43d0-94ce-ffee2f8d65fe admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:21.632632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aea325-e2c2-4a60-ba02-f455dfc68671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:21.633342 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aea325-e2c2-4a60-ba02-f455dfc68671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:21.634122 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aea325-e2c2-4a60-ba02-f455dfc68671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:21.634122 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aea325-e2c2-4a60-ba02-f455dfc68671 admin admin] PATH_INFO: `/v3/users/c4eae7912af24007ba5a099abe3a36b2` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:21.635161 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aea325-e2c2-4a60-ba02-f455dfc68671 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4eae7912af24007ba5a099abe3a36b2)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:21.637151 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aea325-e2c2-4a60-ba02-f455dfc68671 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:21.811962 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c7aea325-e2c2-4a60-ba02-f455dfc68671 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4eae7912af24007ba5a099abe3a36b2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:21.890134 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c7aea325-e2c2-4a60-ba02-f455dfc68671 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4eae7912af24007ba5a099abe3a36b2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:21.902599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c7aea325-e2c2-4a60-ba02-f455dfc68671 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4eae7912af24007ba5a099abe3a36b2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:21.903251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c7aea325-e2c2-4a60-ba02-f455dfc68671 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4eae7912af24007ba5a099abe3a36b2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:21.910676 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c7aea325-e2c2-4a60-ba02-f455dfc68671 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4eae7912af24007ba5a099abe3a36b2'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:21.916556 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1415/2822] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:33:21 2022] DELETE /identity/v3/users/c4eae7912af24007ba5a099abe3a36b2 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:33:22.182733 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c235b-36b1-4eab-aa75-0d0cba67eba9 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:22.184281 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-4e0c235b-36b1-4eab-aa75-0d0cba67eba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:22.201497 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c235b-36b1-4eab-aa75-0d0cba67eba9 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:22.260125 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa67db-d0a5-433e-a330-3c0e9e422990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:22.260789 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa67db-d0a5-433e-a330-3c0e9e422990 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:22.261122 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa67db-d0a5-433e-a330-3c0e9e422990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:22.261398 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa67db-d0a5-433e-a330-3c0e9e422990 admin admin] PATH_INFO: `/v3/projects/255b7b897a9a4ee4a47fd039b4416be0` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:22.262521 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa67db-d0a5-433e-a330-3c0e9e422990 admin admin] RBAC: Authorizing `identity:delete_project(project_id=255b7b897a9a4ee4a47fd039b4416be0)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:22.265121 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa67db-d0a5-433e-a330-3c0e9e422990 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:22.393891 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-beaa67db-d0a5-433e-a330-3c0e9e422990 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '255b7b897a9a4ee4a47fd039b4416be0', 'request_id': 'req-beaa67db-d0a5-433e-a330-3c0e9e422990'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:22.396416 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:33:22.472292 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-beaa67db-d0a5-433e-a330-3c0e9e422990 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '255b7b897a9a4ee4a47fd039b4416be0', 'request_id': 'req-beaa67db-d0a5-433e-a330-3c0e9e422990'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:22.478217 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-beaa67db-d0a5-433e-a330-3c0e9e422990 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '255b7b897a9a4ee4a47fd039b4416be0', 'request_id': 'req-beaa67db-d0a5-433e-a330-3c0e9e422990'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:22.491214 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-beaa67db-d0a5-433e-a330-3c0e9e422990 admin admin] The token cache is being invalidate because project 255b7b897a9a4ee4a47fd039b4416be0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:33:22.491508 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-beaa67db-d0a5-433e-a330-3c0e9e422990 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:22.492179 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-beaa67db-d0a5-433e-a330-3c0e9e422990 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:22.493652 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1408/2823] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:33:22 2022] DELETE /identity/v3/projects/255b7b897a9a4ee4a47fd039b4416be0 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:33:22.499165 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b35186-2a25-4f1d-b6ab-b8a6e86abf3d None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:22.499450 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b35186-2a25-4f1d-b6ab-b8a6e86abf3d None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:22.499753 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b35186-2a25-4f1d-b6ab-b8a6e86abf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:22.519124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-d6b35186-2a25-4f1d-b6ab-b8a6e86abf3d None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:33:22.520366 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-d6b35186-2a25-4f1d-b6ab-b8a6e86abf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:22.579391 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1416/2824] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:33:22.587093 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef8d35-9c2e-48c3-87d9-451cb510d4d4 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:22.587409 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef8d35-9c2e-48c3-87d9-451cb510d4d4 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:22.587683 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef8d35-9c2e-48c3-87d9-451cb510d4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:22.608062 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-b7ef8d35-9c2e-48c3-87d9-451cb510d4d4 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:33:22.610632 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b7ef8d35-9c2e-48c3-87d9-451cb510d4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:22.617332 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1409/2825] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:33:22.621519 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b35186-2a25-4f1d-b6ab-b8a6e86abf3d None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:22.632020 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b35186-2a25-4f1d-b6ab-b8a6e86abf3d None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:22.636722 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68155d92-8a9e-447e-a9e2-85c96ecefb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:22.637352 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68155d92-8a9e-447e-a9e2-85c96ecefb6e admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:22.637630 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68155d92-8a9e-447e-a9e2-85c96ecefb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:22.637902 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68155d92-8a9e-447e-a9e2-85c96ecefb6e admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:22.638548 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68155d92-8a9e-447e-a9e2-85c96ecefb6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:33:22.638857 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68155d92-8a9e-447e-a9e2-85c96ecefb6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:22.640507 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68155d92-8a9e-447e-a9e2-85c96ecefb6e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:22.647214 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:33:22.652432 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1417/2826] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:33:22.656886 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef8d35-9c2e-48c3-87d9-451cb510d4d4 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:22.666475 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef8d35-9c2e-48c3-87d9-451cb510d4d4 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:22.672328 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef13b7-ddcb-44b3-8ca3-c136317d589c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:22.672940 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef13b7-ddcb-44b3-8ca3-c136317d589c admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:22.673225 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef13b7-ddcb-44b3-8ca3-c136317d589c admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:22.673499 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef13b7-ddcb-44b3-8ca3-c136317d589c admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:22.674120 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef13b7-ddcb-44b3-8ca3-c136317d589c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:22.676012 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef13b7-ddcb-44b3-8ca3-c136317d589c admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:22.801060 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1410/2827] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:33:22 2022] POST /identity/v3/projects => generated 367 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:33:22.805335 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68155d92-8a9e-447e-a9e2-85c96ecefb6e admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:22.815319 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68155d92-8a9e-447e-a9e2-85c96ecefb6e admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:22.871681 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219bffe8-c622-4430-af11-cc2dbe3347c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:22.872240 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bffe8-c622-4430-af11-cc2dbe3347c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:22.872521 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bffe8-c622-4430-af11-cc2dbe3347c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:22.872812 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219bffe8-c622-4430-af11-cc2dbe3347c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:22.873428 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219bffe8-c622-4430-af11-cc2dbe3347c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:22.875313 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219bffe8-c622-4430-af11-cc2dbe3347c0 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:22.935040 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1418/2828] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:33:22 2022] POST /identity/v3/users => generated 284 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:33:22.939373 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef13b7-ddcb-44b3-8ca3-c136317d589c admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:22.950178 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef13b7-ddcb-44b3-8ca3-c136317d589c admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:22.954851 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eff401-735b-4385-8ad2-1c88f3f45992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:22.955452 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eff401-735b-4385-8ad2-1c88f3f45992 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:22.955718 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eff401-735b-4385-8ad2-1c88f3f45992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:22.955989 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eff401-735b-4385-8ad2-1c88f3f45992 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:22.956666 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eff401-735b-4385-8ad2-1c88f3f45992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:22.958300 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eff401-735b-4385-8ad2-1c88f3f45992 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:22.968692 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1411/2829] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:33:22.972650 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219bffe8-c622-4430-af11-cc2dbe3347c0 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:22.983406 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219bffe8-c622-4430-af11-cc2dbe3347c0 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:22.988063 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9dc210-e9e1-4d32-8646-79b9f119362e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:22.988722 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9dc210-e9e1-4d32-8646-79b9f119362e admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:22.994546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9dc210-e9e1-4d32-8646-79b9f119362e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:22.994546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9dc210-e9e1-4d32-8646-79b9f119362e admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:22.994546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9dc210-e9e1-4d32-8646-79b9f119362e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:22.994546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9dc210-e9e1-4d32-8646-79b9f119362e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:23.002163 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1419/2830] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:33:23.006522 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eff401-735b-4385-8ad2-1c88f3f45992 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:23.016936 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eff401-735b-4385-8ad2-1c88f3f45992 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:23.021547 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21604d8-9d20-4922-93b3-514dfd8fce2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:23.022190 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21604d8-9d20-4922-93b3-514dfd8fce2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:23.023354 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21604d8-9d20-4922-93b3-514dfd8fce2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:23.023354 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21604d8-9d20-4922-93b3-514dfd8fce2f admin admin] PATH_INFO: `/v3/projects/00bdfd9de16b486187d826ca51babb7b/users/2348bd8f3cc04e69b043d01cd9dbab89/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:23.037976 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21604d8-9d20-4922-93b3-514dfd8fce2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=00bdfd9de16b486187d826ca51babb7b, user_id=2348bd8f3cc04e69b043d01cd9dbab89, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:23.040692 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21604d8-9d20-4922-93b3-514dfd8fce2f admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:23.105107 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1412/2831] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:33:23 2022] PUT /identity/v3/projects/00bdfd9de16b486187d826ca51babb7b/users/2348bd8f3cc04e69b043d01cd9dbab89/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:33:23.116695 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe34c87-66c0-45ff-8373-65397805bf03 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:23.116977 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe34c87-66c0-45ff-8373-65397805bf03 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:23.117253 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe34c87-66c0-45ff-8373-65397805bf03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:23.145634 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-fbe34c87-66c0-45ff-8373-65397805bf03 None None] MFA Rules not processed for user `2348bd8f3cc04e69b043d01cd9dbab89`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:33:23.146804 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fbe34c87-66c0-45ff-8373-65397805bf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:23.209890 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1420/2832] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:33:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:33:23.220802 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21604d8-9d20-4922-93b3-514dfd8fce2f admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:23.222602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-d21604d8-9d20-4922-93b3-514dfd8fce2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:23.279851 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21604d8-9d20-4922-93b3-514dfd8fce2f admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:23.283666 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357ffea-ab29-4d3c-b560-dac3fe689a2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:23.284310 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357ffea-ab29-4d3c-b560-dac3fe689a2f service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:23.284596 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357ffea-ab29-4d3c-b560-dac3fe689a2f service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:23.284876 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4357ffea-ab29-4d3c-b560-dac3fe689a2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:23.293170 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357ffea-ab29-4d3c-b560-dac3fe689a2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:23.295082 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4357ffea-ab29-4d3c-b560-dac3fe689a2f service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:23.304304 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1413/2833] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:33:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:33:25.438732 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe34c87-66c0-45ff-8373-65397805bf03 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:25.440219 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-fbe34c87-66c0-45ff-8373-65397805bf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:25.509472 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe34c87-66c0-45ff-8373-65397805bf03 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:25.514593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d351619-e3a8-44dd-ac2a-10d415b95342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:25.515289 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d351619-e3a8-44dd-ac2a-10d415b95342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:25.515576 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d351619-e3a8-44dd-ac2a-10d415b95342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:25.515848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d351619-e3a8-44dd-ac2a-10d415b95342 admin admin] PATH_INFO: `/v3/users/a255f647d6fd4f209621be4d9e8548e0` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:25.517024 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d351619-e3a8-44dd-ac2a-10d415b95342 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a255f647d6fd4f209621be4d9e8548e0)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:25.518994 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d351619-e3a8-44dd-ac2a-10d415b95342 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:25.524400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:33:25.759532 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8d351619-e3a8-44dd-ac2a-10d415b95342 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a255f647d6fd4f209621be4d9e8548e0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:25.831449 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8d351619-e3a8-44dd-ac2a-10d415b95342 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a255f647d6fd4f209621be4d9e8548e0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:25.845192 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8d351619-e3a8-44dd-ac2a-10d415b95342 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a255f647d6fd4f209621be4d9e8548e0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:25.845990 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8d351619-e3a8-44dd-ac2a-10d415b95342 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a255f647d6fd4f209621be4d9e8548e0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:25.853279 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-8d351619-e3a8-44dd-ac2a-10d415b95342 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a255f647d6fd4f209621be4d9e8548e0'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:25.860260 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1421/2834] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:33:25 2022] DELETE /identity/v3/users/a255f647d6fd4f209621be4d9e8548e0 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:33:26.096308 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357ffea-ab29-4d3c-b560-dac3fe689a2f service cinder] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:26.107354 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4357ffea-ab29-4d3c-b560-dac3fe689a2f service cinder] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:26.168795 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af93bcc1-111e-47ae-81a1-00e0b8da730c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:26.169264 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93bcc1-111e-47ae-81a1-00e0b8da730c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:26.169540 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93bcc1-111e-47ae-81a1-00e0b8da730c admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:26.169808 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af93bcc1-111e-47ae-81a1-00e0b8da730c admin admin] PATH_INFO: `/v3/projects/9097ec16166b45199e58bd3f8f21f537` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:26.170945 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93bcc1-111e-47ae-81a1-00e0b8da730c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9097ec16166b45199e58bd3f8f21f537)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:26.173329 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af93bcc1-111e-47ae-81a1-00e0b8da730c admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:26.195286 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:33:26.272566 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-af93bcc1-111e-47ae-81a1-00e0b8da730c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9097ec16166b45199e58bd3f8f21f537', 'request_id': 'req-af93bcc1-111e-47ae-81a1-00e0b8da730c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:26.351148 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-af93bcc1-111e-47ae-81a1-00e0b8da730c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9097ec16166b45199e58bd3f8f21f537', 'request_id': 'req-af93bcc1-111e-47ae-81a1-00e0b8da730c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:26.357587 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-af93bcc1-111e-47ae-81a1-00e0b8da730c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9097ec16166b45199e58bd3f8f21f537', 'request_id': 'req-af93bcc1-111e-47ae-81a1-00e0b8da730c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:26.368904 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-af93bcc1-111e-47ae-81a1-00e0b8da730c admin admin] The token cache is being invalidate because project 9097ec16166b45199e58bd3f8f21f537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:33:26.369192 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-af93bcc1-111e-47ae-81a1-00e0b8da730c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:26.369834 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-af93bcc1-111e-47ae-81a1-00e0b8da730c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:26.371496 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1414/2835] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:33:26 2022] DELETE /identity/v3/projects/9097ec16166b45199e58bd3f8f21f537 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:33:33.208013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d351619-e3a8-44dd-ac2a-10d415b95342 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:33.209458 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8d351619-e3a8-44dd-ac2a-10d415b95342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:33.222648 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d351619-e3a8-44dd-ac2a-10d415b95342 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:33.278007 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a62e5-cfe4-4d69-b685-8cbce8fd15c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:33.278639 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a62e5-cfe4-4d69-b685-8cbce8fd15c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:33.278917 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a62e5-cfe4-4d69-b685-8cbce8fd15c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:33.279191 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5a62e5-cfe4-4d69-b685-8cbce8fd15c8 admin admin] PATH_INFO: `/v3/users/2348bd8f3cc04e69b043d01cd9dbab89` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:33.280522 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a62e5-cfe4-4d69-b685-8cbce8fd15c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2348bd8f3cc04e69b043d01cd9dbab89)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:33.282925 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5a62e5-cfe4-4d69-b685-8cbce8fd15c8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:33.451239 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-3a5a62e5-cfe4-4d69-b685-8cbce8fd15c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2348bd8f3cc04e69b043d01cd9dbab89'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:33.518010 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-3a5a62e5-cfe4-4d69-b685-8cbce8fd15c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2348bd8f3cc04e69b043d01cd9dbab89'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:33.530255 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-3a5a62e5-cfe4-4d69-b685-8cbce8fd15c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2348bd8f3cc04e69b043d01cd9dbab89'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:33.530925 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-3a5a62e5-cfe4-4d69-b685-8cbce8fd15c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2348bd8f3cc04e69b043d01cd9dbab89'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:33.538411 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-3a5a62e5-cfe4-4d69-b685-8cbce8fd15c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2348bd8f3cc04e69b043d01cd9dbab89'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:33.544611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1422/2836] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:33:33 2022] DELETE /identity/v3/users/2348bd8f3cc04e69b043d01cd9dbab89 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:33:33.549756 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70c946-7d21-4ba5-b8a7-13ad5aea3c61 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:33.550270 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70c946-7d21-4ba5-b8a7-13ad5aea3c61 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:33.550270 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70c946-7d21-4ba5-b8a7-13ad5aea3c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:33.569659 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-ce70c946-7d21-4ba5-b8a7-13ad5aea3c61 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:33:33.570860 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ce70c946-7d21-4ba5-b8a7-13ad5aea3c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:33.629812 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1415/2837] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:33:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:33:33.639598 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a62e5-cfe4-4d69-b685-8cbce8fd15c8 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:33.641707 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-3a5a62e5-cfe4-4d69-b685-8cbce8fd15c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:33.648148 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:33:33.697908 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5a62e5-cfe4-4d69-b685-8cbce8fd15c8 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:33.701741 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c50e74-474d-4600-ba75-89c927e52b84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:33.702345 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c50e74-474d-4600-ba75-89c927e52b84 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:33.702626 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c50e74-474d-4600-ba75-89c927e52b84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:33.702903 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c50e74-474d-4600-ba75-89c927e52b84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:33.714138 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c50e74-474d-4600-ba75-89c927e52b84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:33.715567 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c50e74-474d-4600-ba75-89c927e52b84 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:33.726450 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1423/2838] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:33:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:33:34.114116 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70c946-7d21-4ba5-b8a7-13ad5aea3c61 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:34.115546 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-ce70c946-7d21-4ba5-b8a7-13ad5aea3c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:34.129709 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70c946-7d21-4ba5-b8a7-13ad5aea3c61 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:34.134570 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8327df31-8d0b-40a2-8b4c-b3fbce100c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:34.135209 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327df31-8d0b-40a2-8b4c-b3fbce100c3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:34.135526 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327df31-8d0b-40a2-8b4c-b3fbce100c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:34.135799 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8327df31-8d0b-40a2-8b4c-b3fbce100c3c admin admin] PATH_INFO: `/v3/projects/00bdfd9de16b486187d826ca51babb7b` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:34.137784 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327df31-8d0b-40a2-8b4c-b3fbce100c3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=00bdfd9de16b486187d826ca51babb7b)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:34.139843 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8327df31-8d0b-40a2-8b4c-b3fbce100c3c admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:34.268454 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8327df31-8d0b-40a2-8b4c-b3fbce100c3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00bdfd9de16b486187d826ca51babb7b', 'request_id': 'req-8327df31-8d0b-40a2-8b4c-b3fbce100c3c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:34.345520 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8327df31-8d0b-40a2-8b4c-b3fbce100c3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00bdfd9de16b486187d826ca51babb7b', 'request_id': 'req-8327df31-8d0b-40a2-8b4c-b3fbce100c3c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:34.351618 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8327df31-8d0b-40a2-8b4c-b3fbce100c3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00bdfd9de16b486187d826ca51babb7b', 'request_id': 'req-8327df31-8d0b-40a2-8b4c-b3fbce100c3c'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:34.364179 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8327df31-8d0b-40a2-8b4c-b3fbce100c3c admin admin] The token cache is being invalidate because project 00bdfd9de16b486187d826ca51babb7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:33:34.364488 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8327df31-8d0b-40a2-8b4c-b3fbce100c3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:34.365137 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-8327df31-8d0b-40a2-8b4c-b3fbce100c3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:34.366714 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1416/2839] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:33:34 2022] DELETE /identity/v3/projects/00bdfd9de16b486187d826ca51babb7b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:33:34.371661 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fbb92-b6e5-49f3-9824-6d2c9e826eb9 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:34.372255 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fbb92-b6e5-49f3-9824-6d2c9e826eb9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:34.372255 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fbb92-b6e5-49f3-9824-6d2c9e826eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:34.393792 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-f34fbb92-b6e5-49f3-9824-6d2c9e826eb9 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:33:34.395004 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-f34fbb92-b6e5-49f3-9824-6d2c9e826eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:34.454681 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1424/2840] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:33:34.462467 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf004e-1f51-46f2-9a58-dd505a8d228b None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:34.462760 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf004e-1f51-46f2-9a58-dd505a8d228b None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:34.463042 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf004e-1f51-46f2-9a58-dd505a8d228b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:34.482472 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-2ddf004e-1f51-46f2-9a58-dd505a8d228b None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:33:34.483675 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-2ddf004e-1f51-46f2-9a58-dd505a8d228b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:34.492032 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1417/2841] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:33:34.496288 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34fbb92-b6e5-49f3-9824-6d2c9e826eb9 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:34.506485 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34fbb92-b6e5-49f3-9824-6d2c9e826eb9 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:34.511226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b2607-f0c3-4e26-b46e-e2e4bf0b9b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:34.511665 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b2607-f0c3-4e26-b46e-e2e4bf0b9b81 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:34.511940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b2607-f0c3-4e26-b46e-e2e4bf0b9b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:34.512237 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b2607-f0c3-4e26-b46e-e2e4bf0b9b81 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:34.512871 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b2607-f0c3-4e26-b46e-e2e4bf0b9b81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:33:34.513171 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b2607-f0c3-4e26-b46e-e2e4bf0b9b81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:34.514739 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814b2607-f0c3-4e26-b46e-e2e4bf0b9b81 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:34.526078 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1425/2842] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:33:34.530421 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf004e-1f51-46f2-9a58-dd505a8d228b None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:34.539609 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf004e-1f51-46f2-9a58-dd505a8d228b None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:34.544482 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13a837-38d4-4616-9bd0-ac01c059a9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:34.545080 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13a837-38d4-4616-9bd0-ac01c059a9ff admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:34.545364 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13a837-38d4-4616-9bd0-ac01c059a9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:34.545640 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb13a837-38d4-4616-9bd0-ac01c059a9ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:34.546528 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13a837-38d4-4616-9bd0-ac01c059a9ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:34.549003 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb13a837-38d4-4616-9bd0-ac01c059a9ff admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:34.639309 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1418/2843] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:33:34 2022] POST /identity/v3/projects => generated 403 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:33:34.643454 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b2607-f0c3-4e26-b46e-e2e4bf0b9b81 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:34.653479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814b2607-f0c3-4e26-b46e-e2e4bf0b9b81 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:34.709448 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0c202-63e1-4126-a621-2f6512459c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:34.710057 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0c202-63e1-4126-a621-2f6512459c06 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:34.710337 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0c202-63e1-4126-a621-2f6512459c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:34.710615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a0c202-63e1-4126-a621-2f6512459c06 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:34.711235 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0c202-63e1-4126-a621-2f6512459c06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:34.713171 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a0c202-63e1-4126-a621-2f6512459c06 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:34.808110 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1426/2844] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:33:34 2022] POST /identity/v3/users => generated 302 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:33:34.812296 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13a837-38d4-4616-9bd0-ac01c059a9ff admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:34.819193 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:33:34.823327 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb13a837-38d4-4616-9bd0-ac01c059a9ff admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:34.828195 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89b7be-050d-4feb-9f7c-c77f79d80564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:34.828800 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89b7be-050d-4feb-9f7c-c77f79d80564 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:34.829096 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89b7be-050d-4feb-9f7c-c77f79d80564 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:34.829362 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89b7be-050d-4feb-9f7c-c77f79d80564 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:34.830100 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89b7be-050d-4feb-9f7c-c77f79d80564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:34.831700 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89b7be-050d-4feb-9f7c-c77f79d80564 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:34.841539 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1419/2845] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:33:34.846109 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0c202-63e1-4126-a621-2f6512459c06 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:34.856645 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a0c202-63e1-4126-a621-2f6512459c06 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:34.861996 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889b025-d026-4419-b17c-37c2afe35583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:34.862593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889b025-d026-4419-b17c-37c2afe35583 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:34.862874 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889b025-d026-4419-b17c-37c2afe35583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:34.863177 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889b025-d026-4419-b17c-37c2afe35583 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:34.863820 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889b025-d026-4419-b17c-37c2afe35583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:34.865436 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889b025-d026-4419-b17c-37c2afe35583 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:34.875945 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1427/2846] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:33:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:33:34.880176 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89b7be-050d-4feb-9f7c-c77f79d80564 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:34.890391 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89b7be-050d-4feb-9f7c-c77f79d80564 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:34.895677 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0046e-7955-4f99-bb8d-aec3275a2f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:34.896368 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0046e-7955-4f99-bb8d-aec3275a2f5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:34.896654 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0046e-7955-4f99-bb8d-aec3275a2f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:34.896930 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0046e-7955-4f99-bb8d-aec3275a2f5f admin admin] PATH_INFO: `/v3/projects/c959ef729d29488181608f29b8e481ed/users/5f09b57c0b944107801f76d935e59ae9/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:34.912659 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0046e-7955-4f99-bb8d-aec3275a2f5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c959ef729d29488181608f29b8e481ed, user_id=5f09b57c0b944107801f76d935e59ae9, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:34.915519 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0046e-7955-4f99-bb8d-aec3275a2f5f admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:34.997912 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1420/2847] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:33:34 2022] PUT /identity/v3/projects/c959ef729d29488181608f29b8e481ed/users/5f09b57c0b944107801f76d935e59ae9/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:33:35.009984 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd9c46-91f9-43b5-92a0-fe1fe0db087b None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:35.010276 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd9c46-91f9-43b5-92a0-fe1fe0db087b None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:35.010556 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdd9c46-91f9-43b5-92a0-fe1fe0db087b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:35.036088 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:33:35.039348 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-ecdd9c46-91f9-43b5-92a0-fe1fe0db087b None None] MFA Rules not processed for user `5f09b57c0b944107801f76d935e59ae9`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:33:35.040599 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-ecdd9c46-91f9-43b5-92a0-fe1fe0db087b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:35.105413 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1428/2848] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:33:35 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:33:35.109804 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0046e-7955-4f99-bb8d-aec3275a2f5f admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:35.174244 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0046e-7955-4f99-bb8d-aec3275a2f5f admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:35.178817 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dedcb9-7de0-4089-8b55-968a1bb2afd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:35.179419 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dedcb9-7de0-4089-8b55-968a1bb2afd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:35.179697 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dedcb9-7de0-4089-8b55-968a1bb2afd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:35.179976 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dedcb9-7de0-4089-8b55-968a1bb2afd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:35.180668 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dedcb9-7de0-4089-8b55-968a1bb2afd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:35.182551 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dedcb9-7de0-4089-8b55-968a1bb2afd4 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:35.295382 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1421/2849] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:33:35 2022] POST /identity/v3/projects => generated 403 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:33:35.299832 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd9c46-91f9-43b5-92a0-fe1fe0db087b None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:35.310678 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdd9c46-91f9-43b5-92a0-fe1fe0db087b None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:35.366822 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bbe4b-83a7-45c1-8c7b-e8c6fb80ae0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:35.367364 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bbe4b-83a7-45c1-8c7b-e8c6fb80ae0c admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:35.367647 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bbe4b-83a7-45c1-8c7b-e8c6fb80ae0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:35.367922 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bbe4b-83a7-45c1-8c7b-e8c6fb80ae0c admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:35.368601 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bbe4b-83a7-45c1-8c7b-e8c6fb80ae0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:35.370546 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bbe4b-83a7-45c1-8c7b-e8c6fb80ae0c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:35.451020 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1429/2850] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:33:35 2022] POST /identity/v3/users => generated 308 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:33:35.455949 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dedcb9-7de0-4089-8b55-968a1bb2afd4 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:35.466746 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dedcb9-7de0-4089-8b55-968a1bb2afd4 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:35.471492 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3fdd5-af19-49f4-93dd-a6cab1e48c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:35.472120 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3fdd5-af19-49f4-93dd-a6cab1e48c3b admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:35.472408 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3fdd5-af19-49f4-93dd-a6cab1e48c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:35.472682 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3fdd5-af19-49f4-93dd-a6cab1e48c3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:35.473319 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd3fdd5-af19-49f4-93dd-a6cab1e48c3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:35.474967 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd3fdd5-af19-49f4-93dd-a6cab1e48c3b admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:35.485695 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1422/2851] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:33:35.490000 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bbe4b-83a7-45c1-8c7b-e8c6fb80ae0c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:35.500188 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bbe4b-83a7-45c1-8c7b-e8c6fb80ae0c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:35.505363 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bfd0d-c165-4424-8f82-be9c87f6bb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:35.515240 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bfd0d-c165-4424-8f82-be9c87f6bb82 admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:35.515240 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bfd0d-c165-4424-8f82-be9c87f6bb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:35.515240 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9bfd0d-c165-4424-8f82-be9c87f6bb82 admin admin] PATH_INFO: `/v3/projects/92be8ad6f8124077ba999d811edfcbcc/users/0516bc1e95f14fc0a74026ed11f0239a/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:35.523243 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bfd0d-c165-4424-8f82-be9c87f6bb82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92be8ad6f8124077ba999d811edfcbcc, user_id=0516bc1e95f14fc0a74026ed11f0239a, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:35.525910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9bfd0d-c165-4424-8f82-be9c87f6bb82 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:35.598119 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1430/2852] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:33:35 2022] PUT /identity/v3/projects/92be8ad6f8124077ba999d811edfcbcc/users/0516bc1e95f14fc0a74026ed11f0239a/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:33:35.602338 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3fdd5-af19-49f4-93dd-a6cab1e48c3b admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:35.612341 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3fdd5-af19-49f4-93dd-a6cab1e48c3b admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:35.668434 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b990f045-e8d4-4067-b390-49d80e06915f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:35.669144 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990f045-e8d4-4067-b390-49d80e06915f admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:35.669313 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990f045-e8d4-4067-b390-49d80e06915f admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:35.669589 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b990f045-e8d4-4067-b390-49d80e06915f admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:35.670216 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990f045-e8d4-4067-b390-49d80e06915f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:35.672065 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b990f045-e8d4-4067-b390-49d80e06915f admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:35.681886 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1423/2853] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:33:35 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:33:35.686080 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bfd0d-c165-4424-8f82-be9c87f6bb82 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:35.696940 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9bfd0d-c165-4424-8f82-be9c87f6bb82 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:35.701557 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f2376-c7dd-442f-9c9c-2ecc0a23190c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:35.702208 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f2376-c7dd-442f-9c9c-2ecc0a23190c admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:35.702492 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f2376-c7dd-442f-9c9c-2ecc0a23190c admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:35.702782 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f2376-c7dd-442f-9c9c-2ecc0a23190c admin admin] PATH_INFO: `/v3/projects/92be8ad6f8124077ba999d811edfcbcc/users/0516bc1e95f14fc0a74026ed11f0239a/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:35.705511 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f2376-c7dd-442f-9c9c-2ecc0a23190c admin admin] RBAC: Authorizing `identity:create_grant(project_id=92be8ad6f8124077ba999d811edfcbcc, user_id=0516bc1e95f14fc0a74026ed11f0239a, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:35.708121 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f2376-c7dd-442f-9c9c-2ecc0a23190c admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:35.718252 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1431/2854] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:33:35 2022] PUT /identity/v3/projects/92be8ad6f8124077ba999d811edfcbcc/users/0516bc1e95f14fc0a74026ed11f0239a/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:33:35.728550 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f166030-cb89-47d2-9dbb-5b53d225a992 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:35.728840 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f166030-cb89-47d2-9dbb-5b53d225a992 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:35.729117 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f166030-cb89-47d2-9dbb-5b53d225a992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:35.756554 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-8f166030-cb89-47d2-9dbb-5b53d225a992 None None] MFA Rules not processed for user `0516bc1e95f14fc0a74026ed11f0239a`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:33:35.757757 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-8f166030-cb89-47d2-9dbb-5b53d225a992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:35.786988 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:33:35.825118 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1424/2855] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:33:35 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:33:35.835627 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f2376-c7dd-442f-9c9c-2ecc0a23190c admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:35.837299 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-bc3f2376-c7dd-442f-9c9c-2ecc0a23190c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:35.894317 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f2376-c7dd-442f-9c9c-2ecc0a23190c admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:35.898173 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926dda75-cc0b-4a1a-9a0a-213b04cebbf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:35.898773 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dda75-cc0b-4a1a-9a0a-213b04cebbf4 service cinder] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:35.899051 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dda75-cc0b-4a1a-9a0a-213b04cebbf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:35.899322 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dda75-cc0b-4a1a-9a0a-213b04cebbf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:35.908583 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926dda75-cc0b-4a1a-9a0a-213b04cebbf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:35.910015 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926dda75-cc0b-4a1a-9a0a-213b04cebbf4 service cinder] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:35.913926 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:33:35.919865 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1432/2856] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:33:35 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:33:36.056241 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f166030-cb89-47d2-9dbb-5b53d225a992 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:36.117641 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f166030-cb89-47d2-9dbb-5b53d225a992 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:36.122106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ce113-277e-493c-bc8a-98015170ee11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:36.122728 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ce113-277e-493c-bc8a-98015170ee11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:36.123005 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ce113-277e-493c-bc8a-98015170ee11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:36.123276 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ce113-277e-493c-bc8a-98015170ee11 admin admin] PATH_INFO: `/v3/users/5f09b57c0b944107801f76d935e59ae9` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:36.124400 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ce113-277e-493c-bc8a-98015170ee11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f09b57c0b944107801f76d935e59ae9)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:36.126920 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ce113-277e-493c-bc8a-98015170ee11 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:36.292218 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f65ce113-277e-493c-bc8a-98015170ee11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f09b57c0b944107801f76d935e59ae9'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:36.369475 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f65ce113-277e-493c-bc8a-98015170ee11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f09b57c0b944107801f76d935e59ae9'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:36.381692 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f65ce113-277e-493c-bc8a-98015170ee11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f09b57c0b944107801f76d935e59ae9'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:36.382314 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f65ce113-277e-493c-bc8a-98015170ee11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f09b57c0b944107801f76d935e59ae9'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:36.389860 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-f65ce113-277e-493c-bc8a-98015170ee11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f09b57c0b944107801f76d935e59ae9'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:36.396331 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1425/2857] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:33:36 2022] DELETE /identity/v3/users/5f09b57c0b944107801f76d935e59ae9 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:33:36.400828 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5468a6-7b54-490a-b4de-bddf3ad76fc9 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:36.401119 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5468a6-7b54-490a-b4de-bddf3ad76fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:36.401391 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5468a6-7b54-490a-b4de-bddf3ad76fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:36.420340 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-de5468a6-7b54-490a-b4de-bddf3ad76fc9 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:33:36.421792 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-de5468a6-7b54-490a-b4de-bddf3ad76fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:36.478344 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1433/2858] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:33:36.488621 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ce113-277e-493c-bc8a-98015170ee11 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:36.490226 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f65ce113-277e-493c-bc8a-98015170ee11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:36.536232 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:33:36.546656 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ce113-277e-493c-bc8a-98015170ee11 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:36.551121 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75130a4-6ec3-4c52-b2c6-7b3ad72d291e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:36.551718 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75130a4-6ec3-4c52-b2c6-7b3ad72d291e service neutron] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:36.551995 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75130a4-6ec3-4c52-b2c6-7b3ad72d291e service neutron] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:36.552305 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75130a4-6ec3-4c52-b2c6-7b3ad72d291e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:36.561050 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75130a4-6ec3-4c52-b2c6-7b3ad72d291e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:36.562468 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75130a4-6ec3-4c52-b2c6-7b3ad72d291e service neutron] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:36.573575 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1426/2859] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:33:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:33:36.954389 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5468a6-7b54-490a-b4de-bddf3ad76fc9 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:36.955957 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-de5468a6-7b54-490a-b4de-bddf3ad76fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:36.968331 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5468a6-7b54-490a-b4de-bddf3ad76fc9 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:36.973280 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a103f2f-476c-4f75-9904-942cbde18240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:36.973973 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a103f2f-476c-4f75-9904-942cbde18240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:36.974178 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a103f2f-476c-4f75-9904-942cbde18240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:36.974479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a103f2f-476c-4f75-9904-942cbde18240 admin admin] PATH_INFO: `/v3/projects/c959ef729d29488181608f29b8e481ed` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:36.975590 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a103f2f-476c-4f75-9904-942cbde18240 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c959ef729d29488181608f29b8e481ed)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:36.977533 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a103f2f-476c-4f75-9904-942cbde18240 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:37.102089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5a103f2f-476c-4f75-9904-942cbde18240 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c959ef729d29488181608f29b8e481ed', 'request_id': 'req-5a103f2f-476c-4f75-9904-942cbde18240'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:37.107878 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5a103f2f-476c-4f75-9904-942cbde18240 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c959ef729d29488181608f29b8e481ed', 'request_id': 'req-5a103f2f-476c-4f75-9904-942cbde18240'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:37.114225 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5a103f2f-476c-4f75-9904-942cbde18240 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c959ef729d29488181608f29b8e481ed', 'request_id': 'req-5a103f2f-476c-4f75-9904-942cbde18240'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:37.197627 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5a103f2f-476c-4f75-9904-942cbde18240 admin admin] The token cache is being invalidate because project c959ef729d29488181608f29b8e481ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:33:37.197918 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5a103f2f-476c-4f75-9904-942cbde18240 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:37.198551 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5a103f2f-476c-4f75-9904-942cbde18240 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:37.200021 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1434/2860] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:33:36 2022] DELETE /identity/v3/projects/c959ef729d29488181608f29b8e481ed => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:33:37.204844 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75130a4-6ec3-4c52-b2c6-7b3ad72d291e service neutron] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:37.214714 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75130a4-6ec3-4c52-b2c6-7b3ad72d291e service neutron] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:37.271806 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c2a2b-b561-46d1-98c2-493447d57e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:37.272469 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c2a2b-b561-46d1-98c2-493447d57e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:37.272747 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c2a2b-b561-46d1-98c2-493447d57e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:37.273018 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c2a2b-b561-46d1-98c2-493447d57e73 admin admin] PATH_INFO: `/v3/users/0516bc1e95f14fc0a74026ed11f0239a` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:37.274128 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c2a2b-b561-46d1-98c2-493447d57e73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0516bc1e95f14fc0a74026ed11f0239a)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:37.276029 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c2a2b-b561-46d1-98c2-493447d57e73 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:37.479108 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-af9c2a2b-b561-46d1-98c2-493447d57e73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0516bc1e95f14fc0a74026ed11f0239a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:37.540467 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-af9c2a2b-b561-46d1-98c2-493447d57e73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0516bc1e95f14fc0a74026ed11f0239a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:37.553679 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-af9c2a2b-b561-46d1-98c2-493447d57e73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0516bc1e95f14fc0a74026ed11f0239a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:37.554322 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-af9c2a2b-b561-46d1-98c2-493447d57e73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0516bc1e95f14fc0a74026ed11f0239a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:37.561206 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-af9c2a2b-b561-46d1-98c2-493447d57e73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0516bc1e95f14fc0a74026ed11f0239a'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:37.568549 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1427/2861] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:33:37 2022] DELETE /identity/v3/users/0516bc1e95f14fc0a74026ed11f0239a => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:33:37.958476 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a103f2f-476c-4f75-9904-942cbde18240 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:37.959930 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-5a103f2f-476c-4f75-9904-942cbde18240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:37.973519 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a103f2f-476c-4f75-9904-942cbde18240 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:38.030196 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4153db7-5dc5-4a3b-a869-dc7a34570315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:38.030824 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4153db7-5dc5-4a3b-a869-dc7a34570315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:38.031106 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4153db7-5dc5-4a3b-a869-dc7a34570315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:38.031381 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4153db7-5dc5-4a3b-a869-dc7a34570315 admin admin] PATH_INFO: `/v3/projects/92be8ad6f8124077ba999d811edfcbcc` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:38.033013 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4153db7-5dc5-4a3b-a869-dc7a34570315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92be8ad6f8124077ba999d811edfcbcc)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:38.034898 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4153db7-5dc5-4a3b-a869-dc7a34570315 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:38.059481 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:33:38.158808 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c4153db7-5dc5-4a3b-a869-dc7a34570315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92be8ad6f8124077ba999d811edfcbcc', 'request_id': 'req-c4153db7-5dc5-4a3b-a869-dc7a34570315'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:38.164146 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c4153db7-5dc5-4a3b-a869-dc7a34570315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92be8ad6f8124077ba999d811edfcbcc', 'request_id': 'req-c4153db7-5dc5-4a3b-a869-dc7a34570315'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:38.170206 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c4153db7-5dc5-4a3b-a869-dc7a34570315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92be8ad6f8124077ba999d811edfcbcc', 'request_id': 'req-c4153db7-5dc5-4a3b-a869-dc7a34570315'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:38.247654 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c4153db7-5dc5-4a3b-a869-dc7a34570315 admin admin] The token cache is being invalidate because project 92be8ad6f8124077ba999d811edfcbcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:33:38.247872 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c4153db7-5dc5-4a3b-a869-dc7a34570315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:38.248511 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c4153db7-5dc5-4a3b-a869-dc7a34570315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:38.250015 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1435/2862] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:33:37 2022] DELETE /identity/v3/projects/92be8ad6f8124077ba999d811edfcbcc => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:33:38.254883 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3694b80-1ab0-4c17-abe2-54828d9a1146 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:38.255356 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3694b80-1ab0-4c17-abe2-54828d9a1146 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:38.255455 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3694b80-1ab0-4c17-abe2-54828d9a1146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:38.275947 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-a3694b80-1ab0-4c17-abe2-54828d9a1146 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:33:38.277186 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-a3694b80-1ab0-4c17-abe2-54828d9a1146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:38.336205 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1428/2863] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:33:38.344773 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08589870-087b-4298-ab91-a7f7539a9cb8 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:38.345059 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08589870-087b-4298-ab91-a7f7539a9cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:38.345332 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08589870-087b-4298-ab91-a7f7539a9cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:38.364935 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-08589870-087b-4298-ab91-a7f7539a9cb8 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:33:38.366140 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-08589870-087b-4298-ab91-a7f7539a9cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:38.374018 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1436/2864] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:33:38.378477 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3694b80-1ab0-4c17-abe2-54828d9a1146 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:38.388224 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3694b80-1ab0-4c17-abe2-54828d9a1146 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:38.393562 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50068879-8055-4c9e-80e9-58e8c836dca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:38.394154 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50068879-8055-4c9e-80e9-58e8c836dca5 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:38.394432 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50068879-8055-4c9e-80e9-58e8c836dca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:38.394703 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50068879-8055-4c9e-80e9-58e8c836dca5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:38.395340 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50068879-8055-4c9e-80e9-58e8c836dca5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:33:38.395641 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50068879-8055-4c9e-80e9-58e8c836dca5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:38.397253 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50068879-8055-4c9e-80e9-58e8c836dca5 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:38.398682 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:33:38.418324 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1429/2865] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:33:38.423032 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08589870-087b-4298-ab91-a7f7539a9cb8 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:38.432332 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08589870-087b-4298-ab91-a7f7539a9cb8 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:38.437032 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c55227-fffe-4935-b191-1068b8c669ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:38.438113 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c55227-fffe-4935-b191-1068b8c669ac admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:38.438408 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c55227-fffe-4935-b191-1068b8c669ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:38.438684 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c55227-fffe-4935-b191-1068b8c669ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:38.439318 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c55227-fffe-4935-b191-1068b8c669ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:38.441242 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c55227-fffe-4935-b191-1068b8c669ac admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:38.524817 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1437/2866] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:33:38 2022] POST /identity/v3/projects => generated 403 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:33:38.529353 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50068879-8055-4c9e-80e9-58e8c836dca5 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:38.539526 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50068879-8055-4c9e-80e9-58e8c836dca5 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:38.595358 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e497323-fe61-4c9f-bf85-5165408efda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:38.595970 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e497323-fe61-4c9f-bf85-5165408efda7 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:38.596292 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e497323-fe61-4c9f-bf85-5165408efda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:38.596566 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e497323-fe61-4c9f-bf85-5165408efda7 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:38.597183 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e497323-fe61-4c9f-bf85-5165408efda7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:38.599099 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e497323-fe61-4c9f-bf85-5165408efda7 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:38.717602 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1430/2867] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:33:38 2022] POST /identity/v3/users => generated 302 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:33:38.721726 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c55227-fffe-4935-b191-1068b8c669ac admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:38.732284 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c55227-fffe-4935-b191-1068b8c669ac admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:38.736906 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0356f4-cda1-445c-8174-8df7e534f8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:38.737506 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0356f4-cda1-445c-8174-8df7e534f8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:38.737784 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0356f4-cda1-445c-8174-8df7e534f8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:38.738055 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0356f4-cda1-445c-8174-8df7e534f8c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:38.738691 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0356f4-cda1-445c-8174-8df7e534f8c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:38.740357 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0356f4-cda1-445c-8174-8df7e534f8c1 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:38.750116 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1438/2868] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:33:38.754479 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e497323-fe61-4c9f-bf85-5165408efda7 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:38.764364 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e497323-fe61-4c9f-bf85-5165408efda7 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:38.769657 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa0c6c-5e3d-4cee-82be-053a2fc43988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:38.770253 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa0c6c-5e3d-4cee-82be-053a2fc43988 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:38.770529 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa0c6c-5e3d-4cee-82be-053a2fc43988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:38.770801 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa0c6c-5e3d-4cee-82be-053a2fc43988 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:38.771430 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa0c6c-5e3d-4cee-82be-053a2fc43988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:38.773028 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa0c6c-5e3d-4cee-82be-053a2fc43988 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:38.783394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1431/2869] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:33:38.787765 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0356f4-cda1-445c-8174-8df7e534f8c1 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:38.798778 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0356f4-cda1-445c-8174-8df7e534f8c1 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:38.803670 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21894ceb-b074-4de7-8743-883a5a8a44fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:38.804389 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21894ceb-b074-4de7-8743-883a5a8a44fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:38.804671 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21894ceb-b074-4de7-8743-883a5a8a44fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:38.804944 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21894ceb-b074-4de7-8743-883a5a8a44fa admin admin] PATH_INFO: `/v3/projects/a665f682f2ac49c7b816b33eceff2962/users/5c56df766ca644089f672ca7e9a73a7f/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:38.820247 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21894ceb-b074-4de7-8743-883a5a8a44fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a665f682f2ac49c7b816b33eceff2962, user_id=5c56df766ca644089f672ca7e9a73a7f, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:38.822865 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21894ceb-b074-4de7-8743-883a5a8a44fa admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:38.889126 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1439/2870] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:33:38 2022] PUT /identity/v3/projects/a665f682f2ac49c7b816b33eceff2962/users/5c56df766ca644089f672ca7e9a73a7f/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:33:38.894297 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd73676-54ff-4197-b8db-c888b6d0b6c2 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:38.894611 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd73676-54ff-4197-b8db-c888b6d0b6c2 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:38.894913 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd73676-54ff-4197-b8db-c888b6d0b6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:38.913495 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-3fd73676-54ff-4197-b8db-c888b6d0b6c2 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:33:38.914688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-3fd73676-54ff-4197-b8db-c888b6d0b6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:38.979413 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1432/2871] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:33:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:33:38.989848 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21894ceb-b074-4de7-8743-883a5a8a44fa admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:38.991660 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-21894ceb-b074-4de7-8743-883a5a8a44fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:39.055884 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21894ceb-b074-4de7-8743-883a5a8a44fa admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:39.059483 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d0616-6e27-40df-b481-c03face2b274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:39.060116 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d0616-6e27-40df-b481-c03face2b274 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:39.060404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d0616-6e27-40df-b481-c03face2b274 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:39.060682 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d0616-6e27-40df-b481-c03face2b274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:39.070855 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d0616-6e27-40df-b481-c03face2b274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:39.072297 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556d0616-6e27-40df-b481-c03face2b274 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:39.081774 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1440/2872] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:33:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:33:40.320007 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefac817-f17c-4055-8c50-d7a98e3ee72a None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:40.320529 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefac817-f17c-4055-8c50-d7a98e3ee72a None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:40.320639 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefac817-f17c-4055-8c50-d7a98e3ee72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:40.349964 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-fefac817-f17c-4055-8c50-d7a98e3ee72a None None] MFA Rules not processed for user `5c56df766ca644089f672ca7e9a73a7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:33:40.351161 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-fefac817-f17c-4055-8c50-d7a98e3ee72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:40.418387 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1433/2873] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:33:40 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:33:40.423929 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d0616-6e27-40df-b481-c03face2b274 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:40.433879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d0616-6e27-40df-b481-c03face2b274 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:40.439226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73201267-0b66-49a1-8304-15b59bcc9c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:40.439830 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73201267-0b66-49a1-8304-15b59bcc9c29 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:40.440124 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73201267-0b66-49a1-8304-15b59bcc9c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:40.440410 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73201267-0b66-49a1-8304-15b59bcc9c29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:40.441074 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73201267-0b66-49a1-8304-15b59bcc9c29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:40.442991 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73201267-0b66-49a1-8304-15b59bcc9c29 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:40.512913 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1441/2874] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:33:40 2022] POST /identity/v3/projects => generated 405 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:33:40.516802 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefac817-f17c-4055-8c50-d7a98e3ee72a None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:40.522267 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:33:40.528121 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefac817-f17c-4055-8c50-d7a98e3ee72a None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:40.584467 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd307c28-6bc0-4077-b677-fe87dffa302f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:40.585067 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd307c28-6bc0-4077-b677-fe87dffa302f admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:40.585348 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd307c28-6bc0-4077-b677-fe87dffa302f admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:40.585628 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd307c28-6bc0-4077-b677-fe87dffa302f admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:40.586242 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd307c28-6bc0-4077-b677-fe87dffa302f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:40.588171 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd307c28-6bc0-4077-b677-fe87dffa302f admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:40.655642 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1434/2875] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:33:40 2022] POST /identity/v3/users => generated 309 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:33:40.659645 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73201267-0b66-49a1-8304-15b59bcc9c29 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:40.670008 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73201267-0b66-49a1-8304-15b59bcc9c29 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:40.675288 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb6aa3-8412-4555-a910-20987967c34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:40.675888 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb6aa3-8412-4555-a910-20987967c34f admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:40.676284 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb6aa3-8412-4555-a910-20987967c34f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:40.676563 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb6aa3-8412-4555-a910-20987967c34f admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:40.677200 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb6aa3-8412-4555-a910-20987967c34f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:40.678811 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb6aa3-8412-4555-a910-20987967c34f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:40.690864 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1442/2876] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:33:40.694953 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd307c28-6bc0-4077-b677-fe87dffa302f admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:40.704875 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd307c28-6bc0-4077-b677-fe87dffa302f admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:40.709431 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30517fea-cbe9-4f51-bba3-04c996ae6935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:40.710075 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30517fea-cbe9-4f51-bba3-04c996ae6935 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:40.710352 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30517fea-cbe9-4f51-bba3-04c996ae6935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:40.710625 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30517fea-cbe9-4f51-bba3-04c996ae6935 admin admin] PATH_INFO: `/v3/projects/180f630517364837b100e561dc9bc837/users/be7e932465814b31a40002fa83e79772/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:40.725533 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30517fea-cbe9-4f51-bba3-04c996ae6935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=180f630517364837b100e561dc9bc837, user_id=be7e932465814b31a40002fa83e79772, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:40.728267 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30517fea-cbe9-4f51-bba3-04c996ae6935 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:40.774793 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1435/2877] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:33:40 2022] PUT /identity/v3/projects/180f630517364837b100e561dc9bc837/users/be7e932465814b31a40002fa83e79772/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:33:40.778843 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb6aa3-8412-4555-a910-20987967c34f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:40.790057 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb6aa3-8412-4555-a910-20987967c34f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:40.803048 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:33:40.846615 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c5850-04d2-486c-9c57-e5dca1450bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:40.847231 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c5850-04d2-486c-9c57-e5dca1450bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:40.847528 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c5850-04d2-486c-9c57-e5dca1450bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:40.847802 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c5850-04d2-486c-9c57-e5dca1450bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:40.848472 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c5850-04d2-486c-9c57-e5dca1450bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:40.850042 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c5850-04d2-486c-9c57-e5dca1450bf1 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:40.859498 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1443/2878] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:33:40.864229 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30517fea-cbe9-4f51-bba3-04c996ae6935 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:40.874561 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30517fea-cbe9-4f51-bba3-04c996ae6935 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:40.881704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b6625-74d8-4b95-82f8-b477e19c725d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:40.881704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b6625-74d8-4b95-82f8-b477e19c725d admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:40.881704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b6625-74d8-4b95-82f8-b477e19c725d admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:40.881704 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60b6625-74d8-4b95-82f8-b477e19c725d admin admin] PATH_INFO: `/v3/projects/180f630517364837b100e561dc9bc837/users/be7e932465814b31a40002fa83e79772/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:40.882268 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60b6625-74d8-4b95-82f8-b477e19c725d admin admin] RBAC: Authorizing `identity:create_grant(project_id=180f630517364837b100e561dc9bc837, user_id=be7e932465814b31a40002fa83e79772, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:40.885069 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60b6625-74d8-4b95-82f8-b477e19c725d admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:40.895168 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1436/2879] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:33:40 2022] PUT /identity/v3/projects/180f630517364837b100e561dc9bc837/users/be7e932465814b31a40002fa83e79772/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:33:42.231818 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31121086-52b4-4c83-9e32-707ef70e72bd None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:42.232480 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31121086-52b4-4c83-9e32-707ef70e72bd None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:42.232607 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31121086-52b4-4c83-9e32-707ef70e72bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:42.268651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-31121086-52b4-4c83-9e32-707ef70e72bd None None] MFA Rules not processed for user `be7e932465814b31a40002fa83e79772`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:33:42.269970 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-31121086-52b4-4c83-9e32-707ef70e72bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:42.338723 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1444/2880] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:33:42 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:33:43.683540 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b6625-74d8-4b95-82f8-b477e19c725d admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:43.747676 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60b6625-74d8-4b95-82f8-b477e19c725d admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:43.752787 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96188dc4-b320-48e9-81af-c84b777ea34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:43.753399 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96188dc4-b320-48e9-81af-c84b777ea34c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:43.753675 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96188dc4-b320-48e9-81af-c84b777ea34c admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:43.753943 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96188dc4-b320-48e9-81af-c84b777ea34c admin admin] PATH_INFO: `/v3/users/5c56df766ca644089f672ca7e9a73a7f` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:43.755098 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96188dc4-b320-48e9-81af-c84b777ea34c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c56df766ca644089f672ca7e9a73a7f)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:43.757096 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96188dc4-b320-48e9-81af-c84b777ea34c admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:43.907509 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-96188dc4-b320-48e9-81af-c84b777ea34c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c56df766ca644089f672ca7e9a73a7f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:44.019054 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-96188dc4-b320-48e9-81af-c84b777ea34c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c56df766ca644089f672ca7e9a73a7f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:44.021277 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:33:44.031879 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-96188dc4-b320-48e9-81af-c84b777ea34c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c56df766ca644089f672ca7e9a73a7f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:44.032543 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-96188dc4-b320-48e9-81af-c84b777ea34c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c56df766ca644089f672ca7e9a73a7f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:44.039483 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-96188dc4-b320-48e9-81af-c84b777ea34c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c56df766ca644089f672ca7e9a73a7f'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:44.045349 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1437/2881] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:33:43 2022] DELETE /identity/v3/users/5c56df766ca644089f672ca7e9a73a7f => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:33:44.284999 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31121086-52b4-4c83-9e32-707ef70e72bd None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:44.297534 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31121086-52b4-4c83-9e32-707ef70e72bd None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:44.354457 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dae03c-459b-4197-be62-b3e2d39c5978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:44.355099 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dae03c-459b-4197-be62-b3e2d39c5978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:44.355360 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dae03c-459b-4197-be62-b3e2d39c5978 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:44.355632 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dae03c-459b-4197-be62-b3e2d39c5978 admin admin] PATH_INFO: `/v3/projects/a665f682f2ac49c7b816b33eceff2962` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:44.356773 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dae03c-459b-4197-be62-b3e2d39c5978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a665f682f2ac49c7b816b33eceff2962)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:44.358640 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dae03c-459b-4197-be62-b3e2d39c5978 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:44.466511 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:33:44.473141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-13dae03c-459b-4197-be62-b3e2d39c5978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a665f682f2ac49c7b816b33eceff2962', 'request_id': 'req-13dae03c-459b-4197-be62-b3e2d39c5978'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:44.478857 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-13dae03c-459b-4197-be62-b3e2d39c5978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a665f682f2ac49c7b816b33eceff2962', 'request_id': 'req-13dae03c-459b-4197-be62-b3e2d39c5978'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:44.484910 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-13dae03c-459b-4197-be62-b3e2d39c5978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a665f682f2ac49c7b816b33eceff2962', 'request_id': 'req-13dae03c-459b-4197-be62-b3e2d39c5978'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:44.569089 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-13dae03c-459b-4197-be62-b3e2d39c5978 admin admin] The token cache is being invalidate because project a665f682f2ac49c7b816b33eceff2962 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:33:44.569378 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-13dae03c-459b-4197-be62-b3e2d39c5978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:44.569991 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-13dae03c-459b-4197-be62-b3e2d39c5978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:44.571491 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1445/2882] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:33:44 2022] DELETE /identity/v3/projects/a665f682f2ac49c7b816b33eceff2962 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:33:44.575559 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96188dc4-b320-48e9-81af-c84b777ea34c admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:44.577000 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-96188dc4-b320-48e9-81af-c84b777ea34c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:44.590026 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96188dc4-b320-48e9-81af-c84b777ea34c admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:44.646366 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb7899-891b-4e12-a9b8-d2ac500c6ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:44.647002 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb7899-891b-4e12-a9b8-d2ac500c6ef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:44.647301 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb7899-891b-4e12-a9b8-d2ac500c6ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:44.647559 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb7899-891b-4e12-a9b8-d2ac500c6ef8 admin admin] PATH_INFO: `/v3/users/be7e932465814b31a40002fa83e79772` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:44.648715 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb7899-891b-4e12-a9b8-d2ac500c6ef8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be7e932465814b31a40002fa83e79772)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:44.650661 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb7899-891b-4e12-a9b8-d2ac500c6ef8 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:44.811183 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a1eb7899-891b-4e12-a9b8-d2ac500c6ef8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be7e932465814b31a40002fa83e79772'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:44.884269 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a1eb7899-891b-4e12-a9b8-d2ac500c6ef8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be7e932465814b31a40002fa83e79772'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:44.897872 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a1eb7899-891b-4e12-a9b8-d2ac500c6ef8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be7e932465814b31a40002fa83e79772'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:44.899426 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a1eb7899-891b-4e12-a9b8-d2ac500c6ef8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be7e932465814b31a40002fa83e79772'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:44.905678 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-a1eb7899-891b-4e12-a9b8-d2ac500c6ef8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be7e932465814b31a40002fa83e79772'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:44.912834 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1438/2883] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:33:44 2022] DELETE /identity/v3/users/be7e932465814b31a40002fa83e79772 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:33:45.153664 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dae03c-459b-4197-be62-b3e2d39c5978 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:45.155101 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-13dae03c-459b-4197-be62-b3e2d39c5978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:45.167840 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dae03c-459b-4197-be62-b3e2d39c5978 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:45.224300 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b70202b-23d5-4e40-941a-c9bd154f97ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:45.224945 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70202b-23d5-4e40-941a-c9bd154f97ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:45.225232 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70202b-23d5-4e40-941a-c9bd154f97ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:45.225512 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b70202b-23d5-4e40-941a-c9bd154f97ec admin admin] PATH_INFO: `/v3/projects/180f630517364837b100e561dc9bc837` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:45.226687 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70202b-23d5-4e40-941a-c9bd154f97ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=180f630517364837b100e561dc9bc837)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:45.228640 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b70202b-23d5-4e40-941a-c9bd154f97ec admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:45.352405 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5b70202b-23d5-4e40-941a-c9bd154f97ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '180f630517364837b100e561dc9bc837', 'request_id': 'req-5b70202b-23d5-4e40-941a-c9bd154f97ec'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:45.357871 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5b70202b-23d5-4e40-941a-c9bd154f97ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '180f630517364837b100e561dc9bc837', 'request_id': 'req-5b70202b-23d5-4e40-941a-c9bd154f97ec'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:45.364740 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5b70202b-23d5-4e40-941a-c9bd154f97ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '180f630517364837b100e561dc9bc837', 'request_id': 'req-5b70202b-23d5-4e40-941a-c9bd154f97ec'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:45.438782 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5b70202b-23d5-4e40-941a-c9bd154f97ec admin admin] The token cache is being invalidate because project 180f630517364837b100e561dc9bc837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81778) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:33:45.438979 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5b70202b-23d5-4e40-941a-c9bd154f97ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:45.440172 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-5b70202b-23d5-4e40-941a-c9bd154f97ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:45.441928 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1446/2884] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:33:45 2022] DELETE /identity/v3/projects/180f630517364837b100e561dc9bc837 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:33:45.446763 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7301b4c-1ad8-482d-9e9a-cc6011aa0535 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:45.447052 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7301b4c-1ad8-482d-9e9a-cc6011aa0535 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:45.447352 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7301b4c-1ad8-482d-9e9a-cc6011aa0535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:45.468050 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-b7301b4c-1ad8-482d-9e9a-cc6011aa0535 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:33:45.469288 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-b7301b4c-1ad8-482d-9e9a-cc6011aa0535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:45.517265 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:33:45.529043 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1439/2885] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:33:45.536902 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc9db4-6c8f-4c8a-9dac-c43abd3a27d5 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:45.537230 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc9db4-6c8f-4c8a-9dac-c43abd3a27d5 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:45.537555 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc9db4-6c8f-4c8a-9dac-c43abd3a27d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:45.558369 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-51fc9db4-6c8f-4c8a-9dac-c43abd3a27d5 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:33:45.559671 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-51fc9db4-6c8f-4c8a-9dac-c43abd3a27d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:45.568221 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1447/2886] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:33:45.572672 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7301b4c-1ad8-482d-9e9a-cc6011aa0535 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:45.582832 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7301b4c-1ad8-482d-9e9a-cc6011aa0535 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:45.587412 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785b2ff-5833-41cf-98fa-b66415fd08c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:45.588676 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785b2ff-5833-41cf-98fa-b66415fd08c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:45.588676 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785b2ff-5833-41cf-98fa-b66415fd08c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:45.588676 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5785b2ff-5833-41cf-98fa-b66415fd08c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:45.589202 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785b2ff-5833-41cf-98fa-b66415fd08c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81777) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:33:45.589508 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785b2ff-5833-41cf-98fa-b66415fd08c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:45.591098 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5785b2ff-5833-41cf-98fa-b66415fd08c2 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:45.602351 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1440/2887] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:33:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 06 21:33:45.606746 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc9db4-6c8f-4c8a-9dac-c43abd3a27d5 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:45.616628 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc9db4-6c8f-4c8a-9dac-c43abd3a27d5 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:45.621264 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7eece-483c-41c4-b68b-e95b2a4ec8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:45.622004 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7eece-483c-41c4-b68b-e95b2a4ec8ff admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:45.622317 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7eece-483c-41c4-b68b-e95b2a4ec8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:45.622596 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f7eece-483c-41c4-b68b-e95b2a4ec8ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:45.623270 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f7eece-483c-41c4-b68b-e95b2a4ec8ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:45.625208 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f7eece-483c-41c4-b68b-e95b2a4ec8ff admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:45.712346 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1448/2888] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:33:45 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:33:45.716440 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785b2ff-5833-41cf-98fa-b66415fd08c2 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:45.726688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5785b2ff-5833-41cf-98fa-b66415fd08c2 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:45.783285 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e35b2b-3817-4468-8d7c-7b56ac7023b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:45.783905 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e35b2b-3817-4468-8d7c-7b56ac7023b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:45.784222 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e35b2b-3817-4468-8d7c-7b56ac7023b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:45.784505 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e35b2b-3817-4468-8d7c-7b56ac7023b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:45.785143 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e35b2b-3817-4468-8d7c-7b56ac7023b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:45.787067 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e35b2b-3817-4468-8d7c-7b56ac7023b6 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:45.860984 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1441/2889] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:33:45 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:33:45.865898 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7eece-483c-41c4-b68b-e95b2a4ec8ff admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:45.876613 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f7eece-483c-41c4-b68b-e95b2a4ec8ff admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:45.881963 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cbe22-759d-44e5-a239-7d982b57f6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:45.882558 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cbe22-759d-44e5-a239-7d982b57f6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:45.882842 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cbe22-759d-44e5-a239-7d982b57f6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:45.883120 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4cbe22-759d-44e5-a239-7d982b57f6b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:45.883761 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4cbe22-759d-44e5-a239-7d982b57f6b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:45.885479 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4cbe22-759d-44e5-a239-7d982b57f6b1 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:45.895366 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1449/2890] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:33:45.899688 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e35b2b-3817-4468-8d7c-7b56ac7023b6 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:45.910720 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e35b2b-3817-4468-8d7c-7b56ac7023b6 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:45.915617 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5518b-7309-45b8-8645-b3474b4d49cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:45.916250 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5518b-7309-45b8-8645-b3474b4d49cd admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:45.916530 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5518b-7309-45b8-8645-b3474b4d49cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:45.916831 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5518b-7309-45b8-8645-b3474b4d49cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:45.917619 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5518b-7309-45b8-8645-b3474b4d49cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:45.919171 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5518b-7309-45b8-8645-b3474b4d49cd admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:45.932464 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1442/2891] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:33:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:33:45.936603 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cbe22-759d-44e5-a239-7d982b57f6b1 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:45.946555 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4cbe22-759d-44e5-a239-7d982b57f6b1 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:45.951326 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af168e-6956-4fae-82ed-caaf322b371b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:45.951976 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af168e-6956-4fae-82ed-caaf322b371b admin admin] REQUEST_METHOD: `PUT` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:45.952430 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af168e-6956-4fae-82ed-caaf322b371b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:45.952708 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af168e-6956-4fae-82ed-caaf322b371b admin admin] PATH_INFO: `/v3/projects/76ef9e51ecc848b5af1a663013274592/users/267c26eeaa2d46c0b2a379d57879a6f1/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:45.967210 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af168e-6956-4fae-82ed-caaf322b371b admin admin] RBAC: Authorizing `identity:create_grant(project_id=76ef9e51ecc848b5af1a663013274592, user_id=267c26eeaa2d46c0b2a379d57879a6f1, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:45.969861 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af168e-6956-4fae-82ed-caaf322b371b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:45.973413 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:33:46.038832 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1450/2892] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:33:45 2022] PUT /identity/v3/projects/76ef9e51ecc848b5af1a663013274592/users/267c26eeaa2d46c0b2a379d57879a6f1/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:33:46.104575 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700901a1-548c-46b3-91b1-ffcd5be2c2d8 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:46.104856 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700901a1-548c-46b3-91b1-ffcd5be2c2d8 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:46.105129 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700901a1-548c-46b3-91b1-ffcd5be2c2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:46.132723 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-700901a1-548c-46b3-91b1-ffcd5be2c2d8 None None] MFA Rules not processed for user `267c26eeaa2d46c0b2a379d57879a6f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:33:46.133919 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-700901a1-548c-46b3-91b1-ffcd5be2c2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:46.198684 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1443/2893] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:33:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:33:46.203220 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af168e-6956-4fae-82ed-caaf322b371b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:46.265758 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af168e-6956-4fae-82ed-caaf322b371b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:46.270926 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf9bdd-bec2-4ca9-bb68-49b695364704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:46.271535 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf9bdd-bec2-4ca9-bb68-49b695364704 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:46.271813 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf9bdd-bec2-4ca9-bb68-49b695364704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:46.272084 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf9bdd-bec2-4ca9-bb68-49b695364704 admin admin] PATH_INFO: `/v3/projects` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:46.272734 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf9bdd-bec2-4ca9-bb68-49b695364704 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:46.274611 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf9bdd-bec2-4ca9-bb68-49b695364704 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:46.354121 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1451/2894] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:33:46 2022] POST /identity/v3/projects => generated 387 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:33:46.358418 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700901a1-548c-46b3-91b1-ffcd5be2c2d8 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:46.369265 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700901a1-548c-46b3-91b1-ffcd5be2c2d8 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:46.413224 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:33:46.425047 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02404e-0231-425b-afa9-de26f12287b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:46.425653 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02404e-0231-425b-afa9-de26f12287b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:46.425931 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02404e-0231-425b-afa9-de26f12287b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:46.426203 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb02404e-0231-425b-afa9-de26f12287b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:46.426833 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02404e-0231-425b-afa9-de26f12287b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:46.428780 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb02404e-0231-425b-afa9-de26f12287b3 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:46.516775 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1444/2895] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:33:46 2022] POST /identity/v3/users => generated 300 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:33:46.521306 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf9bdd-bec2-4ca9-bb68-49b695364704 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:46.531678 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf9bdd-bec2-4ca9-bb68-49b695364704 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:46.539261 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afdcca-c1b6-4241-ac18-53e986c409a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:46.539261 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afdcca-c1b6-4241-ac18-53e986c409a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:46.539261 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afdcca-c1b6-4241-ac18-53e986c409a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:46.539261 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5afdcca-c1b6-4241-ac18-53e986c409a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:46.539656 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afdcca-c1b6-4241-ac18-53e986c409a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:46.540775 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5afdcca-c1b6-4241-ac18-53e986c409a6 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:46.552884 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1452/2896] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:33:46.557065 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02404e-0231-425b-afa9-de26f12287b3 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:46.567144 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb02404e-0231-425b-afa9-de26f12287b3 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:46.571675 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0459f-f72e-4827-8bec-27131aacedbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:46.572347 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0459f-f72e-4827-8bec-27131aacedbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:46.572626 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0459f-f72e-4827-8bec-27131aacedbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:46.572903 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0459f-f72e-4827-8bec-27131aacedbc admin admin] PATH_INFO: `/v3/projects/e0444c59929b478b9b990ffbc0aaf11e/users/8a39ca723c744424b893a76dd7df372b/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:46.588329 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0459f-f72e-4827-8bec-27131aacedbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0444c59929b478b9b990ffbc0aaf11e, user_id=8a39ca723c744424b893a76dd7df372b, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:46.591095 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0459f-f72e-4827-8bec-27131aacedbc admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:46.661052 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1445/2897] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:33:46 2022] PUT /identity/v3/projects/e0444c59929b478b9b990ffbc0aaf11e/users/8a39ca723c744424b893a76dd7df372b/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:33:46.665147 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afdcca-c1b6-4241-ac18-53e986c409a6 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:46.675177 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5afdcca-c1b6-4241-ac18-53e986c409a6 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:46.730473 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df2a57-02e6-4fe1-b331-eb164dcf7e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:46.731082 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df2a57-02e6-4fe1-b331-eb164dcf7e65 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:46.731364 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df2a57-02e6-4fe1-b331-eb164dcf7e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:46.731636 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df2a57-02e6-4fe1-b331-eb164dcf7e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:46.732439 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df2a57-02e6-4fe1-b331-eb164dcf7e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:46.734079 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df2a57-02e6-4fe1-b331-eb164dcf7e65 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:46.743664 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1453/2898] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:33:46 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:33:46.747958 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0459f-f72e-4827-8bec-27131aacedbc admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:46.758910 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0459f-f72e-4827-8bec-27131aacedbc admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:46.763437 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d650c2-2e17-4ce1-b66c-71ce22081256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:46.764084 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d650c2-2e17-4ce1-b66c-71ce22081256 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:46.764390 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d650c2-2e17-4ce1-b66c-71ce22081256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:46.764661 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d650c2-2e17-4ce1-b66c-71ce22081256 admin admin] PATH_INFO: `/v3/projects/e0444c59929b478b9b990ffbc0aaf11e/users/8a39ca723c744424b893a76dd7df372b/roles/fe9661f095094dd0931e0b96a1d6ef74` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:46.766591 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d650c2-2e17-4ce1-b66c-71ce22081256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0444c59929b478b9b990ffbc0aaf11e, user_id=8a39ca723c744424b893a76dd7df372b, role_id=fe9661f095094dd0931e0b96a1d6ef74)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:46.769948 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d650c2-2e17-4ce1-b66c-71ce22081256 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:46.779899 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1446/2899] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:33:46 2022] PUT /identity/v3/projects/e0444c59929b478b9b990ffbc0aaf11e/users/8a39ca723c744424b893a76dd7df372b/roles/fe9661f095094dd0931e0b96a1d6ef74 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:33:46.790019 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d60fb-25bc-4beb-90d8-28a6dd6d214f None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:46.790310 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d60fb-25bc-4beb-90d8-28a6dd6d214f None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:46.790586 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d60fb-25bc-4beb-90d8-28a6dd6d214f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:46.818405 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-846d60fb-25bc-4beb-90d8-28a6dd6d214f None None] MFA Rules not processed for user `8a39ca723c744424b893a76dd7df372b`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:33:46.819646 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-846d60fb-25bc-4beb-90d8-28a6dd6d214f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:46.868897 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:33:46.886530 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1454/2900] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:33:46 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:33:46.898442 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d650c2-2e17-4ce1-b66c-71ce22081256 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:46.900229 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-43d650c2-2e17-4ce1-b66c-71ce22081256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:46.956727 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d650c2-2e17-4ce1-b66c-71ce22081256 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:46.960353 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103d2c2-962f-479f-85a7-f76cc2f22842 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:46.960951 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103d2c2-962f-479f-85a7-f76cc2f22842 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:46.961229 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103d2c2-962f-479f-85a7-f76cc2f22842 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:46.961498 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103d2c2-962f-479f-85a7-f76cc2f22842 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:46.970126 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103d2c2-962f-479f-85a7-f76cc2f22842 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:46.971590 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103d2c2-962f-479f-85a7-f76cc2f22842 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:46.980671 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1447/2901] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:33:46 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:33:47.046711 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d60fb-25bc-4beb-90d8-28a6dd6d214f None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:47.107726 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d60fb-25bc-4beb-90d8-28a6dd6d214f None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:47.113389 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2945c6-d876-45ee-859d-bd291f7ceb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:47.113580 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2945c6-d876-45ee-859d-bd291f7ceb2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:47.114742 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2945c6-d876-45ee-859d-bd291f7ceb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:47.115020 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2945c6-d876-45ee-859d-bd291f7ceb2f admin admin] PATH_INFO: `/v3/users/267c26eeaa2d46c0b2a379d57879a6f1` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:47.116442 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2945c6-d876-45ee-859d-bd291f7ceb2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=267c26eeaa2d46c0b2a379d57879a6f1)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:47.118344 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2945c6-d876-45ee-859d-bd291f7ceb2f admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:47.353538 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9a2945c6-d876-45ee-859d-bd291f7ceb2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '267c26eeaa2d46c0b2a379d57879a6f1'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:47.447793 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9a2945c6-d876-45ee-859d-bd291f7ceb2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '267c26eeaa2d46c0b2a379d57879a6f1'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:47.460786 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9a2945c6-d876-45ee-859d-bd291f7ceb2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '267c26eeaa2d46c0b2a379d57879a6f1'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:47.461401 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9a2945c6-d876-45ee-859d-bd291f7ceb2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '267c26eeaa2d46c0b2a379d57879a6f1'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:47.468281 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-9a2945c6-d876-45ee-859d-bd291f7ceb2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '267c26eeaa2d46c0b2a379d57879a6f1'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:47.474048 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1455/2902] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:33:47 2022] DELETE /identity/v3/users/267c26eeaa2d46c0b2a379d57879a6f1 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:33:47.478642 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2fb19-57c8-4505-8cf1-738ace3aa85e None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:47.478932 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2fb19-57c8-4505-8cf1-738ace3aa85e None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:47.479212 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2fb19-57c8-4505-8cf1-738ace3aa85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:47.497784 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-5be2fb19-57c8-4505-8cf1-738ace3aa85e None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:33:47.498984 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5be2fb19-57c8-4505-8cf1-738ace3aa85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:47.557071 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1448/2903] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:33:47.567431 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2945c6-d876-45ee-859d-bd291f7ceb2f admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:47.568977 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-9a2945c6-d876-45ee-859d-bd291f7ceb2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:47.625057 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2945c6-d876-45ee-859d-bd291f7ceb2f admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:47.628995 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e66030-45f1-4c99-9634-2f8ddde3cde2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:47.629592 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e66030-45f1-4c99-9634-2f8ddde3cde2 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:47.629870 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e66030-45f1-4c99-9634-2f8ddde3cde2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:47.630141 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e66030-45f1-4c99-9634-2f8ddde3cde2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:47.638975 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e66030-45f1-4c99-9634-2f8ddde3cde2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:47.640404 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e66030-45f1-4c99-9634-2f8ddde3cde2 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:47.650169 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1456/2904] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:33:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:33:48.074119 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2fb19-57c8-4505-8cf1-738ace3aa85e None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:48.078004 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5be2fb19-57c8-4505-8cf1-738ace3aa85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:48.088135 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be2fb19-57c8-4505-8cf1-738ace3aa85e None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:48.092724 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027bc9b-f0c6-4dd1-9e62-c3ccb0d741fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:48.093542 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027bc9b-f0c6-4dd1-9e62-c3ccb0d741fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:48.093679 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027bc9b-f0c6-4dd1-9e62-c3ccb0d741fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:48.093943 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5027bc9b-f0c6-4dd1-9e62-c3ccb0d741fa admin admin] PATH_INFO: `/v3/projects/76ef9e51ecc848b5af1a663013274592` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:48.095261 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027bc9b-f0c6-4dd1-9e62-c3ccb0d741fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=76ef9e51ecc848b5af1a663013274592)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:48.097202 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5027bc9b-f0c6-4dd1-9e62-c3ccb0d741fa admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:48.186394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:33:48.193176 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5027bc9b-f0c6-4dd1-9e62-c3ccb0d741fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76ef9e51ecc848b5af1a663013274592', 'request_id': 'req-5027bc9b-f0c6-4dd1-9e62-c3ccb0d741fa'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:48.260645 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5027bc9b-f0c6-4dd1-9e62-c3ccb0d741fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76ef9e51ecc848b5af1a663013274592', 'request_id': 'req-5027bc9b-f0c6-4dd1-9e62-c3ccb0d741fa'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:48.268876 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5027bc9b-f0c6-4dd1-9e62-c3ccb0d741fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76ef9e51ecc848b5af1a663013274592', 'request_id': 'req-5027bc9b-f0c6-4dd1-9e62-c3ccb0d741fa'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:48.280637 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5027bc9b-f0c6-4dd1-9e62-c3ccb0d741fa admin admin] The token cache is being invalidate because project 76ef9e51ecc848b5af1a663013274592 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:33:48.280934 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5027bc9b-f0c6-4dd1-9e62-c3ccb0d741fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:48.281586 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-5027bc9b-f0c6-4dd1-9e62-c3ccb0d741fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:48.283099 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1449/2905] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:33:48 2022] DELETE /identity/v3/projects/76ef9e51ecc848b5af1a663013274592 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:33:48.287788 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e66030-45f1-4c99-9634-2f8ddde3cde2 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:48.298025 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e66030-45f1-4c99-9634-2f8ddde3cde2 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:48.308339 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:33:48.355119 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb51cda-e2ff-40e8-b5c6-1a88f3f340a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:48.355751 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb51cda-e2ff-40e8-b5c6-1a88f3f340a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:48.356029 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb51cda-e2ff-40e8-b5c6-1a88f3f340a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:48.356377 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb51cda-e2ff-40e8-b5c6-1a88f3f340a4 admin admin] PATH_INFO: `/v3/users/8a39ca723c744424b893a76dd7df372b` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:48.357480 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb51cda-e2ff-40e8-b5c6-1a88f3f340a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a39ca723c744424b893a76dd7df372b)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:48.359369 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb51cda-e2ff-40e8-b5c6-1a88f3f340a4 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:48.617200 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-aeb51cda-e2ff-40e8-b5c6-1a88f3f340a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a39ca723c744424b893a76dd7df372b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:48.706387 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-aeb51cda-e2ff-40e8-b5c6-1a88f3f340a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a39ca723c744424b893a76dd7df372b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:48.718847 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-aeb51cda-e2ff-40e8-b5c6-1a88f3f340a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a39ca723c744424b893a76dd7df372b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:48.719492 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-aeb51cda-e2ff-40e8-b5c6-1a88f3f340a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a39ca723c744424b893a76dd7df372b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:48.726277 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-aeb51cda-e2ff-40e8-b5c6-1a88f3f340a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a39ca723c744424b893a76dd7df372b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:48.732029 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1457/2906] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:33:48 2022] DELETE /identity/v3/users/8a39ca723c744424b893a76dd7df372b => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:33:49.130921 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027bc9b-f0c6-4dd1-9e62-c3ccb0d741fa admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:49.132433 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5027bc9b-f0c6-4dd1-9e62-c3ccb0d741fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:49.145475 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5027bc9b-f0c6-4dd1-9e62-c3ccb0d741fa admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:49.204869 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc83454-d571-4bc9-b85d-cdeaf14706f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:49.205538 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc83454-d571-4bc9-b85d-cdeaf14706f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:49.205814 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc83454-d571-4bc9-b85d-cdeaf14706f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:49.206085 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc83454-d571-4bc9-b85d-cdeaf14706f5 admin admin] PATH_INFO: `/v3/projects/e0444c59929b478b9b990ffbc0aaf11e` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:49.207351 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc83454-d571-4bc9-b85d-cdeaf14706f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0444c59929b478b9b990ffbc0aaf11e)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:49.209297 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc83454-d571-4bc9-b85d-cdeaf14706f5 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:49.322511 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9cc83454-d571-4bc9-b85d-cdeaf14706f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0444c59929b478b9b990ffbc0aaf11e', 'request_id': 'req-9cc83454-d571-4bc9-b85d-cdeaf14706f5'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:49.407624 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9cc83454-d571-4bc9-b85d-cdeaf14706f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0444c59929b478b9b990ffbc0aaf11e', 'request_id': 'req-9cc83454-d571-4bc9-b85d-cdeaf14706f5'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:49.414171 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9cc83454-d571-4bc9-b85d-cdeaf14706f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0444c59929b478b9b990ffbc0aaf11e', 'request_id': 'req-9cc83454-d571-4bc9-b85d-cdeaf14706f5'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:49.425488 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9cc83454-d571-4bc9-b85d-cdeaf14706f5 admin admin] The token cache is being invalidate because project e0444c59929b478b9b990ffbc0aaf11e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:33:49.425772 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9cc83454-d571-4bc9-b85d-cdeaf14706f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:49.429859 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-9cc83454-d571-4bc9-b85d-cdeaf14706f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:49.429859 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1450/2907] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:33:49 2022] DELETE /identity/v3/projects/e0444c59929b478b9b990ffbc0aaf11e => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:33:49.433050 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a19a60-e8a8-406b-96bf-b7cac0ad7c06 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:49.433346 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a19a60-e8a8-406b-96bf-b7cac0ad7c06 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:49.433629 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a19a60-e8a8-406b-96bf-b7cac0ad7c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:49.453010 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-00a19a60-e8a8-406b-96bf-b7cac0ad7c06 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:33:49.454222 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-00a19a60-e8a8-406b-96bf-b7cac0ad7c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:49.512113 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1458/2908] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:33:49.520565 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01297f-326b-480e-9528-41fe096f77a1 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:49.520791 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01297f-326b-480e-9528-41fe096f77a1 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:49.521070 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01297f-326b-480e-9528-41fe096f77a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:49.543117 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-5c01297f-326b-480e-9528-41fe096f77a1 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:33:49.544354 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-5c01297f-326b-480e-9528-41fe096f77a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:49.552433 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1451/2909] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:33:49.556906 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a19a60-e8a8-406b-96bf-b7cac0ad7c06 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:49.566681 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a19a60-e8a8-406b-96bf-b7cac0ad7c06 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:49.571366 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f47c2b-98f4-406f-a5db-e5c34d6994b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:49.571970 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f47c2b-98f4-406f-a5db-e5c34d6994b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:49.572283 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f47c2b-98f4-406f-a5db-e5c34d6994b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:49.572558 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f47c2b-98f4-406f-a5db-e5c34d6994b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:49.573209 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f47c2b-98f4-406f-a5db-e5c34d6994b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:33:49.573512 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f47c2b-98f4-406f-a5db-e5c34d6994b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:49.575090 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f47c2b-98f4-406f-a5db-e5c34d6994b8 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:49.587427 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1459/2910] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:33:49.592910 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01297f-326b-480e-9528-41fe096f77a1 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:49.602825 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01297f-326b-480e-9528-41fe096f77a1 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:49.607498 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66c5c3-ac90-4170-a41d-f7e40d474243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:49.608090 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66c5c3-ac90-4170-a41d-f7e40d474243 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:49.608397 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66c5c3-ac90-4170-a41d-f7e40d474243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:49.608670 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df66c5c3-ac90-4170-a41d-f7e40d474243 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:49.609297 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66c5c3-ac90-4170-a41d-f7e40d474243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:49.611188 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df66c5c3-ac90-4170-a41d-f7e40d474243 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:49.696357 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1452/2911] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:33:49 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:33:49.700545 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f47c2b-98f4-406f-a5db-e5c34d6994b8 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:49.711477 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f47c2b-98f4-406f-a5db-e5c34d6994b8 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:49.727821 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:33:49.766400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e4d43-073e-4cf4-8ddf-b036729a66f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:49.767006 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e4d43-073e-4cf4-8ddf-b036729a66f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:49.767285 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e4d43-073e-4cf4-8ddf-b036729a66f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:49.767559 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e4d43-073e-4cf4-8ddf-b036729a66f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:49.768778 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e4d43-073e-4cf4-8ddf-b036729a66f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:49.770779 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e4d43-073e-4cf4-8ddf-b036729a66f5 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:49.853649 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1460/2912] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:33:49 2022] POST /identity/v3/users => generated 287 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 06 21:33:49.857818 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66c5c3-ac90-4170-a41d-f7e40d474243 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:49.868606 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df66c5c3-ac90-4170-a41d-f7e40d474243 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:49.873300 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb28b0-367b-4a69-8593-d0df4e7825cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:49.873898 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb28b0-367b-4a69-8593-d0df4e7825cb admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:49.874183 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb28b0-367b-4a69-8593-d0df4e7825cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:49.874462 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb28b0-367b-4a69-8593-d0df4e7825cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:49.875100 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb28b0-367b-4a69-8593-d0df4e7825cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:49.876736 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb28b0-367b-4a69-8593-d0df4e7825cb admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:49.887507 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1453/2913] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:33:49.891552 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e4d43-073e-4cf4-8ddf-b036729a66f5 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:49.903149 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e4d43-073e-4cf4-8ddf-b036729a66f5 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:49.907886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9e3a1-04b5-43ce-b040-4d418235573e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:49.908548 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9e3a1-04b5-43ce-b040-4d418235573e admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:49.908830 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9e3a1-04b5-43ce-b040-4d418235573e admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:49.909226 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9e3a1-04b5-43ce-b040-4d418235573e admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:49.909879 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9e3a1-04b5-43ce-b040-4d418235573e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:49.911503 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c9e3a1-04b5-43ce-b040-4d418235573e admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:49.923883 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1461/2914] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:33:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:33:49.928156 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb28b0-367b-4a69-8593-d0df4e7825cb admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:49.938293 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb28b0-367b-4a69-8593-d0df4e7825cb admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:49.943915 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5afcbc-368d-454e-8a21-37cf1045fa48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:49.947498 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5afcbc-368d-454e-8a21-37cf1045fa48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:49.947498 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5afcbc-368d-454e-8a21-37cf1045fa48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:49.947498 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5afcbc-368d-454e-8a21-37cf1045fa48 admin admin] PATH_INFO: `/v3/projects/4a5d30c0aed04ef8afa3a55584c9d88e/users/806f5543d91f43c480bfd031bc88502e/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:49.960516 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5afcbc-368d-454e-8a21-37cf1045fa48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a5d30c0aed04ef8afa3a55584c9d88e, user_id=806f5543d91f43c480bfd031bc88502e, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:49.963265 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5afcbc-368d-454e-8a21-37cf1045fa48 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:49.965572 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:33:50.060686 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1454/2915] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:33:49 2022] PUT /identity/v3/projects/4a5d30c0aed04ef8afa3a55584c9d88e/users/806f5543d91f43c480bfd031bc88502e/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:33:50.072673 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19ab2b-fc9f-4f7f-9a05-6167c2084d25 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:50.072958 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19ab2b-fc9f-4f7f-9a05-6167c2084d25 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:50.073400 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19ab2b-fc9f-4f7f-9a05-6167c2084d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:50.100659 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-2e19ab2b-fc9f-4f7f-9a05-6167c2084d25 None None] MFA Rules not processed for user `806f5543d91f43c480bfd031bc88502e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:33:50.101872 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-2e19ab2b-fc9f-4f7f-9a05-6167c2084d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:50.164478 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1462/2916] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:33:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:33:50.176604 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5afcbc-368d-454e-8a21-37cf1045fa48 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:50.178342 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-dd5afcbc-368d-454e-8a21-37cf1045fa48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:50.235432 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5afcbc-368d-454e-8a21-37cf1045fa48 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:50.239488 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327f12e-108b-488a-a076-852c9845f4ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:50.240106 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327f12e-108b-488a-a076-852c9845f4ac service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:50.240399 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327f12e-108b-488a-a076-852c9845f4ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:50.240674 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327f12e-108b-488a-a076-852c9845f4ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:50.249413 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3327f12e-108b-488a-a076-852c9845f4ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:50.250859 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3327f12e-108b-488a-a076-852c9845f4ac service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:50.260807 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1455/2917] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:33:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:33:50.282866 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19ab2b-fc9f-4f7f-9a05-6167c2084d25 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:50.345802 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19ab2b-fc9f-4f7f-9a05-6167c2084d25 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:50.350394 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0afc0-6715-4327-8723-f85a94f31d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:50.351035 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0afc0-6715-4327-8723-f85a94f31d20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:50.351317 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0afc0-6715-4327-8723-f85a94f31d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:50.351596 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e0afc0-6715-4327-8723-f85a94f31d20 admin admin] PATH_INFO: `/v3/users/806f5543d91f43c480bfd031bc88502e` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:50.352745 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0afc0-6715-4327-8723-f85a94f31d20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=806f5543d91f43c480bfd031bc88502e)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:50.354719 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e0afc0-6715-4327-8723-f85a94f31d20 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:50.518865 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:33:50.532182 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e4e0afc0-6715-4327-8723-f85a94f31d20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '806f5543d91f43c480bfd031bc88502e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:50.607863 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e4e0afc0-6715-4327-8723-f85a94f31d20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '806f5543d91f43c480bfd031bc88502e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:50.622651 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e4e0afc0-6715-4327-8723-f85a94f31d20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '806f5543d91f43c480bfd031bc88502e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:50.623393 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e4e0afc0-6715-4327-8723-f85a94f31d20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '806f5543d91f43c480bfd031bc88502e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:50.630886 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-e4e0afc0-6715-4327-8723-f85a94f31d20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '806f5543d91f43c480bfd031bc88502e'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:50.636926 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1463/2918] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:33:50 2022] DELETE /identity/v3/users/806f5543d91f43c480bfd031bc88502e => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 06 21:33:50.641822 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbaf749-ee82-4c6f-86bf-f38809809d10 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:50.642103 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbaf749-ee82-4c6f-86bf-f38809809d10 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:50.642373 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbaf749-ee82-4c6f-86bf-f38809809d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:50.662883 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-3dbaf749-ee82-4c6f-86bf-f38809809d10 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:33:50.664110 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-3dbaf749-ee82-4c6f-86bf-f38809809d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:50.725121 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1456/2919] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:33:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:33:50.734960 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0afc0-6715-4327-8723-f85a94f31d20 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:50.737051 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-e4e0afc0-6715-4327-8723-f85a94f31d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:50.796641 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e0afc0-6715-4327-8723-f85a94f31d20 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:50.800299 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b7eb3-48ee-4b50-8f2d-5e60286ac296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:50.800907 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b7eb3-48ee-4b50-8f2d-5e60286ac296 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:50.801184 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b7eb3-48ee-4b50-8f2d-5e60286ac296 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:50.801453 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b7eb3-48ee-4b50-8f2d-5e60286ac296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:50.810902 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b7eb3-48ee-4b50-8f2d-5e60286ac296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:50.812362 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b7eb3-48ee-4b50-8f2d-5e60286ac296 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:50.822001 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1464/2920] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:33:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:33:51.239603 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbaf749-ee82-4c6f-86bf-f38809809d10 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:51.247881 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-3dbaf749-ee82-4c6f-86bf-f38809809d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:51.254091 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbaf749-ee82-4c6f-86bf-f38809809d10 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:51.259368 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50da610-3430-4019-b245-e8966f21da20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:51.260599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50da610-3430-4019-b245-e8966f21da20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:51.260599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50da610-3430-4019-b245-e8966f21da20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:51.260599 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50da610-3430-4019-b245-e8966f21da20 admin admin] PATH_INFO: `/v3/projects/4a5d30c0aed04ef8afa3a55584c9d88e` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:51.262786 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50da610-3430-4019-b245-e8966f21da20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a5d30c0aed04ef8afa3a55584c9d88e)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:51.263701 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50da610-3430-4019-b245-e8966f21da20 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:51.422349 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e50da610-3430-4019-b245-e8966f21da20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a5d30c0aed04ef8afa3a55584c9d88e', 'request_id': 'req-e50da610-3430-4019-b245-e8966f21da20'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:51.512435 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e50da610-3430-4019-b245-e8966f21da20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a5d30c0aed04ef8afa3a55584c9d88e', 'request_id': 'req-e50da610-3430-4019-b245-e8966f21da20'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:51.518480 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e50da610-3430-4019-b245-e8966f21da20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a5d30c0aed04ef8afa3a55584c9d88e', 'request_id': 'req-e50da610-3430-4019-b245-e8966f21da20'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:51.530006 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e50da610-3430-4019-b245-e8966f21da20 admin admin] The token cache is being invalidate because project 4a5d30c0aed04ef8afa3a55584c9d88e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:33:51.530296 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e50da610-3430-4019-b245-e8966f21da20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:51.530921 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e50da610-3430-4019-b245-e8966f21da20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:33:51.532483 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1457/2921] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:33:51 2022] DELETE /identity/v3/projects/4a5d30c0aed04ef8afa3a55584c9d88e => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:33:51.537586 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d1663-c32c-49e9-bcf1-4f1c5b60dc6e None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:51.537906 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d1663-c32c-49e9-bcf1-4f1c5b60dc6e None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:51.538183 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946d1663-c32c-49e9-bcf1-4f1c5b60dc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:51.558462 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-946d1663-c32c-49e9-bcf1-4f1c5b60dc6e None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:33:51.559660 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-946d1663-c32c-49e9-bcf1-4f1c5b60dc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:51.622978 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1465/2922] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 06 21:33:51.631590 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eae801-4ca3-48b9-b2a6-b577af8b73ab None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:51.631876 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eae801-4ca3-48b9-b2a6-b577af8b73ab None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:51.632187 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eae801-4ca3-48b9-b2a6-b577af8b73ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:51.651721 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-f0eae801-4ca3-48b9-b2a6-b577af8b73ab None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:33:51.652959 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f0eae801-4ca3-48b9-b2a6-b577af8b73ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:51.660707 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1458/2923] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:33:51.664924 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d1663-c32c-49e9-bcf1-4f1c5b60dc6e None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:51.675191 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946d1663-c32c-49e9-bcf1-4f1c5b60dc6e None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:51.679679 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7cbe3-4dd4-4b4a-a978-d24c055a435b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:51.680310 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7cbe3-4dd4-4b4a-a978-d24c055a435b admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:51.680593 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7cbe3-4dd4-4b4a-a978-d24c055a435b admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:51.680869 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7cbe3-4dd4-4b4a-a978-d24c055a435b admin admin] PATH_INFO: `/v3/domains` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:51.681507 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7cbe3-4dd4-4b4a-a978-d24c055a435b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81778) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 06 21:33:51.681811 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7cbe3-4dd4-4b4a-a978-d24c055a435b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:51.684009 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7cbe3-4dd4-4b4a-a978-d24c055a435b admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:51.696142 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1466/2924] 10.222.0.81 () {58 vars in 1153 bytes} [Tue Sep 6 21:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 06 21:33:51.700419 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eae801-4ca3-48b9-b2a6-b577af8b73ab None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:51.710105 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eae801-4ca3-48b9-b2a6-b577af8b73ab None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:51.714719 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfc260-a4b6-4c1f-96e6-730036f18089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:51.715312 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfc260-a4b6-4c1f-96e6-730036f18089 admin admin] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:51.715593 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfc260-a4b6-4c1f-96e6-730036f18089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:51.715865 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfc260-a4b6-4c1f-96e6-730036f18089 admin admin] PATH_INFO: `/v3/projects` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:51.716533 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfc260-a4b6-4c1f-96e6-730036f18089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:51.718444 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfc260-a4b6-4c1f-96e6-730036f18089 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:51.730573 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:33:51.838528 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1459/2925] 10.222.0.81 () {60 vars in 1153 bytes} [Tue Sep 6 21:33:51 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:33:51.843003 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7cbe3-4dd4-4b4a-a978-d24c055a435b admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:51.853766 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7cbe3-4dd4-4b4a-a978-d24c055a435b admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:51.887205 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:33:51.910338 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa31296-cbfe-44ea-b3b1-c6599db80a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:51.910976 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa31296-cbfe-44ea-b3b1-c6599db80a71 admin admin] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:51.911258 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa31296-cbfe-44ea-b3b1-c6599db80a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:51.911532 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa31296-cbfe-44ea-b3b1-c6599db80a71 admin admin] PATH_INFO: `/v3/users` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:51.912195 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa31296-cbfe-44ea-b3b1-c6599db80a71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:51.914095 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa31296-cbfe-44ea-b3b1-c6599db80a71 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:52.014626 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1467/2926] 10.222.0.81 () {60 vars in 1144 bytes} [Tue Sep 6 21:33:51 2022] POST /identity/v3/users => generated 288 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 06 21:33:52.019347 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfc260-a4b6-4c1f-96e6-730036f18089 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:52.029736 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfc260-a4b6-4c1f-96e6-730036f18089 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:52.034573 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457177f-4359-41f4-81ba-c1d83df7da75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:52.035195 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457177f-4359-41f4-81ba-c1d83df7da75 admin admin] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:52.035472 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457177f-4359-41f4-81ba-c1d83df7da75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:52.036591 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a457177f-4359-41f4-81ba-c1d83df7da75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:52.036591 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457177f-4359-41f4-81ba-c1d83df7da75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:52.038160 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a457177f-4359-41f4-81ba-c1d83df7da75 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:52.048515 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1460/2927] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 06 21:33:52.052734 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa31296-cbfe-44ea-b3b1-c6599db80a71 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:52.062755 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa31296-cbfe-44ea-b3b1-c6599db80a71 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:52.067944 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca490c37-9d33-48d2-835c-08d4b70b97af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:52.068571 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca490c37-9d33-48d2-835c-08d4b70b97af admin admin] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:52.068854 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca490c37-9d33-48d2-835c-08d4b70b97af admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:52.069129 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca490c37-9d33-48d2-835c-08d4b70b97af admin admin] PATH_INFO: `/v3/roles` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:52.069764 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca490c37-9d33-48d2-835c-08d4b70b97af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:52.071341 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca490c37-9d33-48d2-835c-08d4b70b97af admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:52.082438 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1468/2928] 10.222.0.81 () {58 vars in 1122 bytes} [Tue Sep 6 21:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 06 21:33:52.086561 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457177f-4359-41f4-81ba-c1d83df7da75 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:52.096368 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a457177f-4359-41f4-81ba-c1d83df7da75 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:52.100870 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9654c-22d3-45cf-b7b2-672c96b007d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:52.101519 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9654c-22d3-45cf-b7b2-672c96b007d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:52.101824 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9654c-22d3-45cf-b7b2-672c96b007d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:52.102097 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e9654c-22d3-45cf-b7b2-672c96b007d5 admin admin] PATH_INFO: `/v3/projects/d03203c75e42422785de2bca45aa69a4/users/0d00cb51a4f548398567626c6ddee20b/roles/be70fb8abf3148dda8e8e51be3a212e6` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:52.116386 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9654c-22d3-45cf-b7b2-672c96b007d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d03203c75e42422785de2bca45aa69a4, user_id=0d00cb51a4f548398567626c6ddee20b, role_id=be70fb8abf3148dda8e8e51be3a212e6)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:52.119016 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e9654c-22d3-45cf-b7b2-672c96b007d5 admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:52.190908 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1461/2929] 10.222.0.81 () {60 vars in 1483 bytes} [Tue Sep 6 21:33:52 2022] PUT /identity/v3/projects/d03203c75e42422785de2bca45aa69a4/users/0d00cb51a4f548398567626c6ddee20b/roles/be70fb8abf3148dda8e8e51be3a212e6 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:33:52.201117 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dcbff-7f73-4f28-8e7a-2ab2a04b6f70 None None] REQUEST_METHOD: `POST` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:52.201405 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dcbff-7f73-4f28-8e7a-2ab2a04b6f70 None None] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:52.201678 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1dcbff-7f73-4f28-8e7a-2ab2a04b6f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:52.230113 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.auth.core [None req-8c1dcbff-7f73-4f28-8e7a-2ab2a04b6f70 None None] MFA Rules not processed for user `0d00cb51a4f548398567626c6ddee20b`. Rule list: `[]` (Enabled: `True`). {{(pid=81778) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:33:52.231311 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-8c1dcbff-7f73-4f28-8e7a-2ab2a04b6f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:52.295502 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1469/2930] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:33:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:33:52.306821 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9654c-22d3-45cf-b7b2-672c96b007d5 admin admin] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:33:52.308575 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-f8e9654c-22d3-45cf-b7b2-672c96b007d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:33:52.367134 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e9654c-22d3-45cf-b7b2-672c96b007d5 admin admin] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:33:52.370833 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7be5cc-b7d5-45c0-80c9-21b996d8afd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'af9589aaba334db494ed0b036e94062f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:33:52.371533 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7be5cc-b7d5-45c0-80c9-21b996d8afd0 service cinder] REQUEST_METHOD: `GET` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:33:52.371887 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7be5cc-b7d5-45c0-80c9-21b996d8afd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:33:52.372190 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7be5cc-b7d5-45c0-80c9-21b996d8afd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:33:52.382636 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7be5cc-b7d5-45c0-80c9-21b996d8afd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:33:52.384086 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7be5cc-b7d5-45c0-80c9-21b996d8afd0 service cinder] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:33:52.393789 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1462/2931] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:33:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:34:02.292575 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=49,keystone:INSERT=3 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:34:02.389358 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=44,keystone:INSERT=2 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:34:03.928084 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1dcbff-7f73-4f28-8e7a-2ab2a04b6f70 None None] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:34:03.990133 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1dcbff-7f73-4f28-8e7a-2ab2a04b6f70 None None] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:34:03.994626 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303220f-9bfd-4a04-8de4-cfeaaf1b3bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:34:03.995251 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303220f-9bfd-4a04-8de4-cfeaaf1b3bc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:34:03.995532 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303220f-9bfd-4a04-8de4-cfeaaf1b3bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:34:03.995804 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c303220f-9bfd-4a04-8de4-cfeaaf1b3bc3 admin admin] PATH_INFO: `/v3/users/0d00cb51a4f548398567626c6ddee20b` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:34:03.996943 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303220f-9bfd-4a04-8de4-cfeaaf1b3bc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d00cb51a4f548398567626c6ddee20b)` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:34:03.998837 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c303220f-9bfd-4a04-8de4-cfeaaf1b3bc3 admin admin] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:34:04.176957 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c303220f-9bfd-4a04-8de4-cfeaaf1b3bc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d00cb51a4f548398567626c6ddee20b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:34:04.237107 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c303220f-9bfd-4a04-8de4-cfeaaf1b3bc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d00cb51a4f548398567626c6ddee20b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:34:04.250366 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c303220f-9bfd-4a04-8de4-cfeaaf1b3bc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d00cb51a4f548398567626c6ddee20b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:34:04.251068 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c303220f-9bfd-4a04-8de4-cfeaaf1b3bc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d00cb51a4f548398567626c6ddee20b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:34:04.258048 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.notifications [None req-c303220f-9bfd-4a04-8de4-cfeaaf1b3bc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d00cb51a4f548398567626c6ddee20b'} {{(pid=81778) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:34:04.264481 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1470/2932] 10.222.0.81 () {58 vars in 1224 bytes} [Tue Sep 6 21:34:03 2022] DELETE /identity/v3/users/0d00cb51a4f548398567626c6ddee20b => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:34:04.268922 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc71850-c1a8-4546-b028-868259ef1294 None None] REQUEST_METHOD: `POST` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:34:04.272446 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc71850-c1a8-4546-b028-868259ef1294 None None] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:34:04.272446 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc71850-c1a8-4546-b028-868259ef1294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:34:04.289665 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.auth.core [None req-1bc71850-c1a8-4546-b028-868259ef1294 None None] MFA Rules not processed for user `9b67efb35ae049b5aa789d6ba0205b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81777) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 06 21:34:04.290953 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1bc71850-c1a8-4546-b028-868259ef1294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:34:04.350443 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1463/2933] 10.222.0.81 () {58 vars in 958 bytes} [Tue Sep 6 21:34:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 06 21:34:04.360402 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303220f-9bfd-4a04-8de4-cfeaaf1b3bc3 admin admin] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:34:04.361809 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-c303220f-9bfd-4a04-8de4-cfeaaf1b3bc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:34:04.418093 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c303220f-9bfd-4a04-8de4-cfeaaf1b3bc3 admin admin] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:34:04.421961 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5eab4-5b9b-4d2a-b0fa-47caf4995477 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9aebd6c7ef24f42949918c99a72722d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:34:04.422552 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5eab4-5b9b-4d2a-b0fa-47caf4995477 service neutron] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:34:04.422830 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5eab4-5b9b-4d2a-b0fa-47caf4995477 service neutron] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:34:04.423108 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5eab4-5b9b-4d2a-b0fa-47caf4995477 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:34:04.432742 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5eab4-5b9b-4d2a-b0fa-47caf4995477 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:34:04.434112 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5eab4-5b9b-4d2a-b0fa-47caf4995477 service neutron] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:34:04.443976 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1471/2934] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:34:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:34:04.843320 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc71850-c1a8-4546-b028-868259ef1294 None None] Authenticating user token {{(pid=81777) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:34:04.844882 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.fernet_utils [None req-1bc71850-c1a8-4546-b028-868259ef1294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81777) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:34:04.858397 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc71850-c1a8-4546-b028-868259ef1294 None None] Validating token access rules against request {{(pid=81777) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:34:04.862995 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0830b78-d6e0-4c96-8721-d7f4d677f7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b67efb35ae049b5aa789d6ba0205b2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e0790087f9147d99a7f175c2c23386d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81777) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:34:04.863657 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0830b78-d6e0-4c96-8721-d7f4d677f7ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:34:04.863938 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0830b78-d6e0-4c96-8721-d7f4d677f7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:34:04.864252 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0830b78-d6e0-4c96-8721-d7f4d677f7ad admin admin] PATH_INFO: `/v3/projects/d03203c75e42422785de2bca45aa69a4` {{(pid=81777) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:34:04.865391 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0830b78-d6e0-4c96-8721-d7f4d677f7ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=d03203c75e42422785de2bca45aa69a4)` {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:34:04.867394 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0830b78-d6e0-4c96-8721-d7f4d677f7ad admin admin] RBAC: Authorization granted {{(pid=81777) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:34:04.976819 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e0830b78-d6e0-4c96-8721-d7f4d677f7ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd03203c75e42422785de2bca45aa69a4', 'request_id': 'req-e0830b78-d6e0-4c96-8721-d7f4d677f7ad'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:34:05.037412 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e0830b78-d6e0-4c96-8721-d7f4d677f7ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd03203c75e42422785de2bca45aa69a4', 'request_id': 'req-e0830b78-d6e0-4c96-8721-d7f4d677f7ad'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:34:05.043695 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e0830b78-d6e0-4c96-8721-d7f4d677f7ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd03203c75e42422785de2bca45aa69a4', 'request_id': 'req-e0830b78-d6e0-4c96-8721-d7f4d677f7ad'} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:34:05.054914 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e0830b78-d6e0-4c96-8721-d7f4d677f7ad admin admin] The token cache is being invalidate because project d03203c75e42422785de2bca45aa69a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81777) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 06 21:34:05.055204 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e0830b78-d6e0-4c96-8721-d7f4d677f7ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:34:05.055829 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG keystone.notifications [None req-e0830b78-d6e0-4c96-8721-d7f4d677f7ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81777) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 06 21:34:05.057334 dv-cinder-749155-11-smb devstack@keystone.service[81777]: [pid: 81777|app: 0|req: 1464/2935] 10.222.0.81 () {58 vars in 1233 bytes} [Tue Sep 6 21:34:04 2022] DELETE /identity/v3/projects/d03203c75e42422785de2bca45aa69a4 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 06 21:34:14.439463 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:34:15.052484 dv-cinder-749155-11-smb devstack@keystone.service[81777]: DEBUG dbcounter [-] [81777] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81777) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 06 21:35:51.196426 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5eab4-5b9b-4d2a-b0fa-47caf4995477 service neutron] Authenticating user token {{(pid=81778) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 06 21:35:51.197866 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-83f5eab4-5b9b-4d2a-b0fa-47caf4995477 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:35:51.286938 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5eab4-5b9b-4d2a-b0fa-47caf4995477 service neutron] Validating token access rules against request {{(pid=81778) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 06 21:35:51.347445 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865f35c-46e0-41eb-9915-6b835659bcfd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3295306746f4552837f1bb12b2c500f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '002e09339d4e49ce98434571d3b64248', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81778) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 06 21:35:51.348059 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865f35c-46e0-41eb-9915-6b835659bcfd service placement] REQUEST_METHOD: `GET` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 06 21:35:51.348410 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865f35c-46e0-41eb-9915-6b835659bcfd service placement] SCRIPT_NAME: `/identity` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 06 21:35:51.348688 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865f35c-46e0-41eb-9915-6b835659bcfd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81778) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 06 21:35:51.350430 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.fernet_utils [None req-1865f35c-46e0-41eb-9915-6b835659bcfd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81778) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 06 21:35:51.362121 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865f35c-46e0-41eb-9915-6b835659bcfd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 06 21:35:51.363689 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865f35c-46e0-41eb-9915-6b835659bcfd service placement] RBAC: Authorization granted {{(pid=81778) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 06 21:35:51.374316 dv-cinder-749155-11-smb devstack@keystone.service[81778]: [pid: 81778|app: 0|req: 1472/2936] 10.222.0.81 () {60 vars in 1365 bytes} [Tue Sep 6 21:35:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 06 21:36:01.369411 dv-cinder-749155-11-smb devstack@keystone.service[81778]: DEBUG dbcounter [-] [81778] Writing DB stats keystone:SELECT=58 {{(pid=81778) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}